Introduction To Meta-Kaggle And Human-AI Teams
Introduction To Meta-Kaggle And Human-AI Teams


Meta-Kaggle is a dataset released by Kaggle, an online machine learning competition platform. It includes a range of information on the competitions they have run, including participants, scoreboard results, code written, and more, all compiled into any easy to access SQL database. In this training, participants will be introduced to the dataset, accessing it with SQL commands, and using the dataset to train a model with the Python toolbox SKLearn. I will also describe some research performed as a portion of Project Alloy, in which the dataset was used to predict when code will fail to run.

Project Alloy (funded by DARPA’s Agile Teams program) aimed to develop and implement intelligent machine agents that team with humans (creating hybrid teams) in meaningful and supportive ways. Hosting challenges on a citizen science competition platform provided a unique environment to develop and test hybrid team hypotheses. By dynamically sensing of each team’s state and progress towards a solution, we enabled testing hypothesis formulated about hybrid team management. The combination of team performance monitoring and leaderboard scoring transformed the contest platform into a machine intelligence laboratory. Agents with the ability formulate compelling teams, predict code failures, and provide feedback on model vulnerabilities were created to serve as AI teammates during the competition. By providing machine agents that augment or substitute human roles, we explored a tighter synthesis of human and machine leading to greater resilience and agility under changing project goals and constraints.


Coming soon!

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google