ceana
Uploaded by
4 SLIDES
246 VUES
40LIKES

SysML World Cup: A New Challenge for ML Researchers to Solve Systems Problems

DESCRIPTION

The SysML World Cup aims to unleash machine learning researchers to tackle complex systems problems more rigorously. By framing challenges effectively and creating benchmarks, participants will compete for recognition while advancing the field. Leading experts such as Peter Bonik, Jeff Chase, Nitesh Chawla, Rebecca Isaacs, and Emre Kiciman will guide this innovative competition. This initiative recognizes the unique aspects of systems problems that are compelling to the ML community and challenges researchers to think critically about domain knowledge, problem definition, and solution discovery.

1 / 4

Télécharger la présentation

SysML World Cup: A New Challenge for ML Researchers to Solve Systems Problems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

Playing audio...

  1. SysML World Cup? • Purpose? • Unleash ML researchers to solve systems problems? • Frame the problems more rigorously? • Shape some benchmarks to shape the field? • Win the prize? • Who will play? Peter Bonik, Jeff Chase, Nitesh Chawla, Rebecca Isaacs, Emre Kiciman

  2. Why a new game? • There are existing annual “cup” challenges in the ML community. • KDD • Why not offer “packaged” systems challenges to KDD cup? • Would meet most of the goals. • How much of the domain knowledge / structure / context can/should we “launder out”? • How black are the boxes? • Which is harder: defining the problem or finding the solution?

  3. Nature of the challenges • What makes the systems problems interesting to ML researchers? What are the unique / interesting / hard aspects of these problems? • Self-optimizing  adaptation • Self-healing  unbalanced training sets • Dueling control loops • Risk management? (reasoning about probabilities)

  4. More Q than A • How to frame a SysML cup challenge? • How much domain context? • Do the “clusters” of research in this area lead to multiple separate challenges? • Show me the data! • And supersize me. • How to frame the “why button” as a Grand Challenge? • More wine?

More Related