open data talk at the world bank
TRANSCRIPT
Anthony GoldbloomKaggle
Making data science a sport
Photo by mikebaird, www.flickr.com/photos/mikebaird
Competitions are judged on objective criteria
Competition Mechanics
“In less than a week, Martin O’Leary, a PhD student in glaciology, outperformedthe state-of-the-art algorithms”
“The world’s brightest physicists have been working for decades on solving one of the great unifying problems of our universe”
Kaggle’s Dark Matter Competition on the White House blog
User base: 60,000 data scientists
Our User Base
• neural networks• logistic regression• support vector machine• decision trees• ensemble methods• adaBoost• Bayesian networks
• genetic algorithms• random forest• Monte Carlo methods• principal component analysis• Kalman filter• evolutionary fuzzy modeling
Users apply different techniques
EXAMPLE ESSAY QUESTION —
We all understand the benefits of laughter. For example, someone once said, “Laughter is the shortest distance between two people.”
Many other people believe that laughter is an important part of any relationship. Tell a true story in which laughter was one element or part.
“Have you ever experienced a time with your friends or family where you laughed so hard your stomach hurt, and your eyes were filled with tears? Laughing is something every person needs.
A great laugh can make a persons day and put a smile on their face. If no one laughed the world would be a terribly sad place. My friends and I are always laughing, to the point where were rolling on the ground, clutching our stomachs laughing.”
Automated results by
the winning algorithm are
as reliable as manual
assessment by teachers.
Probability of going to hospital in the next six months
& Obesity
Diabetes
& Hypertension
& High Cholesterol
RTA Competition: Travel Time Prediction
Boehringer Ingelheim Competition: Data
Mutates Molecule +1700 fields
True Molecule2
False Molecule3
True Molecule4
True Molecule 5
…
True 0
Is it a lemon?
