machine learning an introduction. what is learning? herbert simon: “learning is any process by...

16
Machine Learning An Introduction

Upload: stella-riley

Post on 12-Jan-2016

214 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Machine Learning

An Introduction

Page 2: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

What is Learning? Herbert Simon: “Learning is any process by

which a system improves performance from experience.”

What is the task? Classification Problem solving / planning / control

Page 3: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Classification Assign object/event to one of a given finite set of

categories. Medical diagnosis Credit card applications or transactions Fraud detection in e-commerce Worm detection in network packets Spam filtering in email Recommended articles in a newspaper Recommended books, movies, music, or jokes Financial investments DNA sequences Spoken words Handwritten letters Astronomical images

Page 4: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Problem Solving / Planning / Control Performing actions in an environment in

order to achieve a goal. Solving calculus problems Playing checkers, chess, or backgammon Balancing a pole Driving a car or a jeep Flying a plane, helicopter, or rocket Controlling an elevator Controlling a character in a video game Controlling a mobile robot

Page 5: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Learning from DataThe world is driven by data.

Germany’s climate research centre generates 10 petabytes per year Google processes 24 petabytes per day The Large Hadron Collider produces 60 gigabytes per minute (~12

DVDs) There are over 50m credit card transactions a day in the US alone.

Page 6: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Learning from Data

Data is recorded from some real-world phenomenon. What might we want to do with that data?

Prediction - what can we predict about this phenomenon?

Description - how can we describe/understand this phenomenon in a

new way?

Page 7: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Learning from Data

How can we extract knowledge from data to help humans take decisions?

How can we automate decisions from data?

How can we adapt systems dynamically to enable better user experiences?

Write code to explicitlydo the above tasks

Write code to make the computerlearn how to do the tasks

Page 8: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Using machine learning to detect spam emails

To: [email protected] YOUR DIPLOMA TODAY!If you are looking for a fast and cheap way to get a diploma, this is the best way out for you. Choose the desired field and degree and call us right now: For US: 1.845.709.8044 Outside US: +1.845.709.8044 "Just leave your NAME & PHONE NO. (with CountryCode)" in the voicemail. Our staff will get back to you in next few days!

ALGORITHMNaïve BayesRule mining

Page 9: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Using machine learning to recommend books

ALGORITHMSCollaborative FilteringNearest NeighbourClustering

Page 10: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Using machine learning to identify faces and expressions

ALGORITHMSDecision Trees

Adaboost

Page 11: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Boundary Detection

Is this a boundary?

Page 12: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Image CategorizationTraining Labels

Training Images

Classifier

Training

Training

Image Features

Image Features

Testing

Test Image

Trained

Classifier

Trained Classifier Outdoor

Prediction

Slide: Derek Hoiem

Page 13: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

ML for working with social network data ML for working with social network data: detecting

fraud, predicting click-thru patterns, targeted advertising, etc etc etc .

ALGORITHMSSupport Vector MachinesCollaborative filteringRule mining algorithmsMany many more….

Page 14: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

ML for mobile

Page 15: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Machine Learning (etc.) Driving a car Recognising spam emails Recommending books Reading handwriting Recognising speech, faces, etc.

How would you write these programs?Would you want to?!?!?!?

Page 16: Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Machine Learning Problems