NeurIPS 2019 Accepted Competitions
Below you will find a brief summary of competitions @ NeurIPS2019. Regular competitions take place before the NeurIPS, whereas live competitions will have their final phase during the competition session @NeurIPS2019. All prizes are tentative and depend solely on the organizing team of each competition and the corresponding sponsors.
Please note that all information is subject to change, please contact the organizers of each competition directly for more information.
| Competition | Summary | Prelim. phase | Main P. Starts | Comp. ends | Contact | Prizes |
| Causality for Climate (C4C) |
A causal understanding of climatic interactions is of high societal relevance from identifying causes of extreme events to process understanding and weather forecasting. This competition comprises a number of multivariate time series datasets featuring major challenges of climate data from time delays and nonlinearity to nonstationarity and selection bias. The competition aims to open up new interdisciplinary research pathways by improving our scientific understanding of Earth’s climate, while also driving method development and benchmarking in the computer science community. |
Jul 31 | Oct 11 | Oct 31 |
|
$10,000USD |
| Reconnaissance Blind Chess | Build the best AI bot to play reconnaissance blind chess, a challenge for making optimal decisions in the face of uncertainty. Reconnaissance blind chess is like chess except a player does not know where her opponent's pieces are a priori. Rather, she can covertly sense a chosen 3x3 square of the board each turn and also learn partial information from captures. | August, 13 | Oct 21 | Oct, 31 | Ryan Gardner | $1,000USD |
| Automated Deep Learning (AutoDL) | The AutoDL challenge aims taking the automate the design of deep learning (DL) methods to solve generic tasks. This is a challenge with “code submission”: machine learning algorithms are trained and tested on a challenge platform on data invisible to the participants. We target applications such as speech, image, video, and text, for which DL methods have had great success recently, to drive the community to work on automating the design of DL models. Raw data will be provided, formatted in a uniform tensor manner, to encourage participants to submit generic algorithms. We will impose restrictions on training time and resources to push the state-of-the-art further. We will provide a large number of pre-formatted public datasets and set up a repository of data exchange to enable meta-learning. | Apr 29 | Aug 1 | Oct 31 | Zhengying Liu | ~$10,000USD |
| 3D Object Detection over HD Maps for Autonomous Cars | Autonomous cars are expected to dramatically redefine the future of transportation. The 3D Perception system of the autonomous car is a critical keystone upon which high level autonomy functions depend. This competition is designed to help advance the state of the art in 3D object detection by focusing research on this topic in the context of autonomous cars, specifically by sharing the full modality of sensor data available to typical autonomous cars, and by providing access to a high fidelity HD map. | Sep 12 | Nov 12 | Vinay Shet | ~25,000USD | |
| MicroNet: Large-Scale Model Compression Competition | Contestants will compete to build the most efficient models that solve ImageNet classification, CIFAR-100 classification, or WikiText-103 language modeling. The competition is focused on efficient inference, and uses a theoretical metric rather than measured inference speed to score entries. We hope that this encourages a mix of submissions that are useful on today’s hardware and that will also guide the direction of new hardware development. | May 31 | Sep 30 | Trevor Gale | TBA | |
| The Animal-AI Olympics | The Animal-AI Olympics translates tasks from animal cognition into tests for AI. We provide a fully configurable 3D environment in which we have built 100 hidden food-retrieval tasks inspired by work in comparative cognition. Participants only know the ten categories we are testing for along with the objects included in the tests and have to submit an agent capable of robust food-retrieval behaviour from pixel inputs alone. Part of the challenge is developing sensible environment configurations as well as mimicking animal-like cognitive abilities. | Apr 30 | Jun 30 | Nov 1 | Matthew Crosby | ~20,000USD + 10,000USD in cloud credits |
| Traffic4cast -- Traffic Map Movie Forecasting | Predict high resolution traffic flow volume, heading, and speed on a whole city map looking 15 minutes into the future! Kicking off a series of annual competitions, this year's data is based on 100 billion probe points from 3 cities mapped in 5 minute intervals, showing trends across weekdays and seasonal effects. Improved traffic predictions are of great social, environmental, and economic value, while also advancing our general ability to capture the simple implicit rules underlying a complex system and model its future states. | May 1 | June 1 | Oct 1 | David Kreil |
~17,000USD + 2 resea. fellowships up to 12 months + compl. registrations |
| Robot open-Ended Autonomous Learning (REAL) | Open-ended learning aims to build learning machines and robots that are able to acquire skills and knowledge in an incremental fashion in a certain environment. This competition addresses autonomous open-ended learning with a focus on simulated robot systems that: (a) acquire a sensorimotor competence that allows them to interact with objects and physical environments; (b) learn in a fully autonomous way, i.e. with no human intervention (e.g., no tasks or reward functions) on the basis of mechanisms such as curiosity, intrinsic motivations, task-free reinforcement learning, self-generated goals, and any other mechanism that might support autonomous learning. The competition challenge will feature two phases: during an initial ""intrinsic phase"" the system will have a certain time to freely explore and learn in an environment containing multiple objects, and then during an ""extrinsic phase"" the quality of the autonomously acquired knowledge will be measured with tasks unknown at design time and during the intrinsic phase. | Jun 3 | Oct 15 | Emilio Cartoni | TBA | |
| Learn to Move: Walk Around | The third series of a NeurIPS competition to develop human-level versatile locomotion controllers, which is a grand challenge in biomechanics, neuroscience, and robotics. This year, the main task is to develop a controller for a 3D human musculoskeletal simulation model to walk or run following velocity commands. In addition to the solution with the highest reward, we will award solutions that use novel learning techniques and biomechanical knowledge. | May 20 | Oct 20 | Seungmoon Song | TBA | |
| CellSignal: Disentangling biological signal from experimental noise in cellular images | The task is to correctly classify images of populations of human cells as exhibiting one of 1,108 different treatments in the dataset RxRx1. RxRx1 consists of 125,514 high-resolution 512x512 6-channel fluorescence microscopy images of cells under these treatments across 4 cell types and 51 different runs of the same experimental design. These images exhibit technical nuisance factors specific to each experiment called batch effects that confound the classification task. The data is split into training and test sets by experiment, so good classifiers will need to separate relevant biological factors from the batch effect factors in order to generalize outside of the training data. | Jun 27 | Sep 27 | Berton Earnshaw |
$13,000USD + 1 NVIDIA Quadro RTX 8000 GPU + 2 NVIDIA Titan V GPUs +Lambda Quad 4-GPU workstation |
|
| Advancing State-of-the-art Learning Approaches for Disentangled Representations | Learning deep representations in which different semantic aspects of data are structurally disentangled is of central importance for advancing artificial intelligence. Despite the clear necessity and benefits of disentangled representations, recent benchmarks on simulated datasets have exposed severe limitations of state-of-the-art approaches. In this NeurlPS challenge we will explicitly address (i) unsupervised learning with unsupervised model selection (ii) role of supervision and (iii) impact and application of disentanglement on real-world images. | Jun 28 | Sep 24 | Stefan Bauer | 20,0000 Euro + Best paper award JMLR proc. | |
| MineRL Sample Efficient RL from Human Priors | A challenge requiring participants to develop sample efficient reinforcment and imitation learning algorithms to solve a complex task in Minecraft, a rich open-world environment featuring sparse-rewards, embodied multi-agent interactions, long-term planning, vision, navigation, and explicit and implicit sub-task hierarchies. The competition features two components: 1) the ObtainDiamond task, a sequential decision making environment requiring an agent to collect a necessary set of requisite items, explore, and mine diamonds only using observations from its first-person perspective; and (2) the MineRL-v0 dataset, a large-scale collection of over 60 million state-action pairs of human demonstrations that can be resimulated into embodied agent trajectories with arbitrary modifications to game state and visuals. Participants will compete to develop systems which solve the ObtainDiamond task with a limited number of samples (4-days worth) from a new Minecraft simulator called MineRLEnv which modifies the Malmo simulator to be synchronous and extremely efficient. Submissions will be evaluated by being trained and then run from scratch by the competition organizers in a fixed cloud-computing in environment to ensure that truly sample-efficient algorithms are developed. | Jun 1 | William Guss | TBA |
| Competition | Summary | Prelim. phase | Qualif. phase | Live comp. | Contact | Prizes |
| Game of Drones | Game of Drones is a multi-drone racing tournament conducted in the high-fidelity simulation environment AirSim. Participants will have the choice of three tiers: Planning only, Perception only, or Full Autonomous Racing. The aim is to combine challenges from adversarial planning and real-time perception and to encourage fusing learning- and model-based approaches. | Jul 1 | Nov 21 |
Dec 11 |
Keiko Nagami | ~12,000USD |
| Live Malaria Challenge | In the NeurIPS Live Malaria Challenge we are looking for participants to apply machine learning tools to determine novel solutions which could impact malaria policy in Sub Saharan Africa. Specifically, how should combinations of interventions be deployed under budget constraints to impact lives saved and the prevalence of the malaria parasite in a simulated environment. | Dec 9 | Dec 11 | Oliver Bent | TBA | |
| Pommerman Year 2: Radio. | Pommerman: Train a team of communicative agents to play Bomberman in a partially observed setting. Compete against other teams. | Nov 8 | Cinjon Resnick | ~15,000USD in Google Cloud Credits | ||
| AI Driving Olympics 3 | The third edition of the AI Driving Olympics is designed to probe the state of the art in all areas of autonomous vehicles. This year we will have 3 events: 1) Urban - based on the duckietown platform, 2) Racing - inspired by the AWS DeepRacer platform, and 3) Advanced sensing - using the nuScenes dataset. For each event we provide the necessary tools in the form of simulators, logs, code templates, baseline implementations and low-cost and low barrier of entry access to robotics hardware. | Sep 15 | Nov 1 | Dec 11 | Liam Paull | TBA |
NeurIPS 2019 Call for Competitions
We invite proposals for the Neural Information Processing Systems 2019 (NeurIPS 2019) competition track to be held in Vancouver, Canada. After the success of the past two years, a third edition of the competition track will be held at NeurIPS 2019. We solicit competition proposals on any topic of interest to the NeurIPS community. We especially encourage competition proposals from emerging new fields or new application domains related to NeurIPS. Interdisciplinary topics that will attract a significant cross-section of the community are especially highly encouraged.
As in previous years, there will be two types of competitions:
-
Standard data science competitions, where participants will compete to obtain the best score on a machine learning task of interest to the NeurIPS community based on a problem and data defined and released by the organizers of the competition.
-
Live competitions, which will be held in a “science-fair” manner at NeurIPS 2019. Participants will present live demos at NeurIPS 2019 which apply methodology to an application domain defined by the organizers of the live competition.
There will be a competition track at NeurIPS 2019, co-located with the conference workshops, where competition results will be presented and discussed. Competition organizers will asked to propose a tentative schedule for presentation of the competition and its results during an assigned time slot; NeurIPS will provide coffee breaks and, if necessary, poster facilities. Competition organizers and participants will be invited to contribute a book chapter the upcoming NeurIPS 2019 Competition Volume of the Springer Series on Challenges in Machine Learning (pending acceptance).
For any additional questions please contact the NeurIPS 2019 competition chair.
PROPOSAL SUBMISSION
Standard data science and live competition proposals must both be submitted via CMT at: https://cmt3.research.microsoft.com/COMPNEURLPS2019
Please carefully follow the provided Latex template when preparing proposals.
REVIEWING AND SELECTION PROCESS
A competition program committee will be formed, consisting of experts on both machine learning and on challenge organization. Each proposal will be reviewed by at least three members of the committee. The factors that will be considered when evaluating proposals include:
-
Task chosen: Impact, originality, relevance to the NeurIPS community will all be considered. Tasks that include humanitarian and/or positive societal impact are especially highly encouraged this year, although other topics relevant to the NeurIPS community will also be considered. If humanitarian projects are submitted, the involvement of the community in question is strongly desired, and “parachute science” is strongly discouraged.
-
Protocol of competition: Feasibility of the task chosen, soundness of the evaluation criteria, and clarity and fairness of the competition rules will all be considered.
-
Logistics: Schedule, plan for attracting competition participants, and experience and diversity of the organizers will all be considered. The specific plan for attracting participants of groups under-represented at NeurIPS will be considered.
IMPORTANT DATES
-
Competition proposal submission deadline: March 8, 2019
-
Acceptance notification: March 30, 2019
-
Competition track: December, 2019
ADDITIONAL COMMENTS
-
Competition organizers should propose a timeline for running the competition to ensure that participants have enough time to contribute a high-quality entries. It is recommended that competitions be completed by end of October, 2019 at the absolute latest.
-
Competition organizers that require help or suggestions regarding competition platforms for running the competition can contact the competition chair for advice.
COMPETITION CHAIR
Hugo Jair Escalante, INAOE-CINVESTAV, ChaLearn, hugo.jair@gmail.com