introduction to machine learning

CS494/594, Fall 200711:10 AM – 12:25 PM

Claxton 205

Machine Learning

Slides adapted (and extended) from:

ETHEM ALPAYDIN© The MIT Press, 2004

[email protected]://www.cmpe.boun.edu.tr/~ethem/i2ml

2

What is Learning? and Why Learn ?Machine learning is programming computers to optimize a performance criterion using example data or past experience.Learning is used when:

Human expertise does not exist (navigating on Mars),Humans are unable to explain their expertise (speech recognition)Solution changes in time (routing on a computer network)Solution needs to be adapted to particular cases (user biometrics)

But, not always appropriateFor example, there is no need to “learn” to calculate payroll

3

What We Talk About When We Talk About“Learning”Learning general models from data of particular examples Data is cheap and abundant (data warehouses, data marts); knowledge is expensive and scarce. Example in retail: Customer transactions to consumer behavior:

People who bought “Da Vinci Code” also bought “The Five People You Meet in Heaven” (www.amazon.com)

Build a model that is a good and usefulapproximation to the data.

4

Data Mining: Application of Machine Learning to Large Databases

(also called “Knowledge Discovery in Databases (KDD)”)Retail: Market basket analysis, Customer relationship management (CRM)Finance: Credit scoring, fraud detectionManufacturing: Optimization, troubleshootingMedicine: Medical diagnosisTelecommunications: Quality of service optimizationBioinformatics: Motifs, alignmentWeb mining: Search engines...

5

Relevant Disciplines for Machine LearningArtificial IntelligenceBayesian methodsComputational complexity theoryControl theoryInformation theoryStatisticsPhilosophyPsychology…

6

Some Types of Machine Learning Learning Associations: Find relationships in the dataSupervised Learning: We want to learn a mapping from the input to the output; correct values are provided by supervisor

ClassificationRegression

Unsupervised Learning: We have only input data; we want to find regularities in the data.Reinforcement Learning: Learn a policy that maps states to actions.

7

Learning AssociationsExample: Shopping basket analysis P (Y | X ) probability that somebody who buys X also buys Y where X and Y are products/services.

We learn Association Rule: P ( chips | soda ) = 0.7

Use this Association Rule like this:Target customers who bought X, but not Y

Try to convince them to buy Y

8

Classification(a type of supervised learning)

Example: Credit scoringDifferentiating between low-risk and high-riskcustomers from their income and savings

Main application: prediction

Discriminant: IF income > θ1 AND savings > θ2THEN low-risk ELSE high-risk

9

Classification: ApplicationsAlso known as: Pattern recognition

Face recognition: Pose, lighting, occlusion (glasses, beard), make-up, hair style Character recognition: Different handwriting styles.Speech recognition: Temporal dependency.

Use of a dictionary or the syntax of the language. Sensor fusion: Combine multiple modalities; eg, visual (lip image) and acoustic for speech

Gesture recognition: Different hand shapes.Medical diagnosis: From symptoms to illnesses.Brainwave understanding: From signals to “states” of thoughtReading text:…

10

Example Pattern Recognition:Face Recognition

Training examples of a person

Test images

AT&T Laboratories, Cambridge UKhttp://www.uk.research.att.com/facedatabase.html

11





12

Example Pattern Recognition:Character Recognition

Want to learn how to recognize characters, even if written in different ways by different people

13





14

Example Pattern Recognition:Speech Recognition

15





16

Example Pattern Recognition:Gesture Recognition

17





18

Example Pattern Recognition:Medical Diagnosis

Inputs: relevant info about patient, symptoms, test results, etc.

Output: Expected illness or risk factors

19





20

Example Pattern Recognition:Interpreting Brainwaves

EEG electrodes reading brain waves: Rotation task, left brain

Resting task, with eye blink Counting task

Rotation task, right brain

21





22

Example Pattern Recognition:Reading text

Can you read this?Aircndcog to a rseerhcaer at Cbiardmge Urensvitiy, it dsoen't mtetar in waht oderr the letrtes in a wrod are, the olny ipnaotmrt tihng is taht the fsrit and lsat lteter be at the rgiht plcae. The rset can be a toatl mses and you can slitl raed it wutohit porlebm. Tehy spectluae taht tihs is bseuace the hmaun mnid deos not raed erevy leettr by iesltf but the wrod as a whloe. Wtehehr tihs is ture or not is a ponit of deabte.

Clearly, the brain has learned syntax and semantics of language, including contextual dependencies, to make sense of of this ☺

For fun: Here’s a web page where you can create your own jumbled text: http://www.stevesachs.com/jumbler.cgi

http://www.stevesachs.com/jumbler.cgi

23

Regression(another type of supervised learning)

Example: Predict price of a used car

(Input) x : car attributes (e.g., mileage)(Output) y : priceOur task: learn the mapping from input to output

We know basic g ( ) modelWe want to learn appropriate values for θ parameters that minimize the error in the approximation:

y = g (x | θ )

Here, a linear regression function:

y = wx+w0

x: mileage

y: p

rice

24

Example Regression Applications

Navigating a car: Angle of the steering wheel (CMU NavLab)Kinematics of a robot arm

α1= g1(x,y)α2= g2(x,y)

α1

α2

(x,y)

Response surface design(using function optimization)

25

Supervised Learning: Handy UsesPrediction of future cases: Use the rule to predict the output for future inputs

Knowledge extraction: We can deduce an explanation about the process underlying the data

Compression: The rule is simpler than the data it explains

Outlier detection: We can find instances that do not obey the rule, and are thus exceptions (e.g., to detect fraud)

26

Unsupervised LearningLearning “what normally happens”No output available (i.e., we don’t know the “right” answer)Clustering (density estimation): Grouping similar instancesExample applications:

Customer segmentation in CRM (Customer Relationship Management)

Company may have different marketing approaches for different groupings of customers

Image compression: Color quantizationInstead of using 24 bits to represent 16 million colors, reduce to 6 bits and 64 colors, if the image only uses those 64 colors.

Bioinformatics: Learning motifs (i.e., sequences of amino acids that occur repeatedly in proteins)

27

Reinforcement Learning

Learning a policy: A sequence of actions to take, given the current state No supervised output, but delayed reward is providedCredit assignment problemGame playingRobot in a mazeMultiple agents, partial observability, ...

28

Where is Machine Learning Headed?

Today: tip of the icebergFirst-generation algorithms: neural networks, decision trees, regression…Applied to well-formatted databasesBudding industry

Opportunity for tomorrow: enormous impactLearn across full mixed-media dataLearn across multiple internal databases, plus the web and newsfeedsLearn by active experimentationLearn decisions rather than predictionsCumulative, lifelong learningProgramming languages with learning embedded?

29

Resources: Datasets

UCI Repository: http://www.ics.uci.edu/~mlearn/MLRepository.html

UCI KDD Archive: http://kdd.ics.uci.edu/summary.data.application.html

Statlib: http://lib.stat.cmu.edu/

Delve: http://www.cs.utoronto.ca/~delve/

http://www.ics.uci.edu/~mlearn/MLRepository.html

http://kdd.ics.uci.edu/summary.data.application.html

http://lib.stat.cmu.edu/

http://www.cs.utoronto.ca/~delve/

30

Resources: Journals

Journal of Machine Learning ResearchMachine LearningNeural ComputationNeural NetworksIEEE Transactions on Neural NetworksIEEE Transactions on Pattern Analysis and Machine IntelligenceAnnals of StatisticsJournal of the American Statistical Association...

31

Resources: ConferencesInternational Conference on Machine Learning (ICML)

ICML07: http://oregonstate.edu/conferences/icml2007/European Conference on Machine Learning (ECML) and European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD)

ECML/PKDD07: http://www.ecmlpkdd2007.org/Neural Information Processing Systems (NIPS)

NIPS07: http://nips.cc/Uncertainty in Artificial Intelligence (UAI)

UAI07: http://www.cs.duke.edu/uai07/Computational Learning Theory (COLT)

COLT07: http://www.learningtheory.org/colt2007/International Joint Conference on Artificial Intelligence (IJCAI)

IJCAI07: http://www.ijcai-07.org/International Conference on Neural Networks (Europe)

ICANN07: http://www.icann2007.org/...

http://oregonstate.edu/conferences/icml2007/

http://www.ecmlpkdd2007.org/

http://nips.cc/

http://www.cs.duke.edu/uai07/

http://www.learningtheory.org/colt2007/

http://www.ijcai-07.org/

http://www.icann2007.org/

32

Our First Learning Study:Neural Networks

But first, we’ll look at some general issues in designing a machine learning system

For next time, read chapter 1 (if time allows, also start reading chapter 4)

First project topic we’re working toward (after introduction): Implementing a neural network for character recognition

introduction to machine learning

Documents

example pattern recognition

speech gesture recognition

example data

learning associations

different handwriting

different people

different hand shapes

data mining

INFO 1998: Introduction to Machine LearningINFO 1998: Introduction to Machine Learning. Lecture 9: Clustering and Unsupervised Learning INFO 1998: Introduction to Machine Learning

Clustering UNSUPERVISED LEARNING INTRODUCTION Machine Learning

Introduction to Key Machine Learning Technologies · Introduction to Key Machine Learning Technologies Ken Shioiri [Summary] Machine learning, typically represented by Deep Learning,

Machine Learning: Machine Learning: Introduction Introduction

Introduction to statistical machine learning · Introduction to Machine Learning Lecturer: Ji Liu Thank Jerry Zhu for sharing his slides. What is Machine Learning? • Machine learning

Introduction to Machine Learning - udel.eduudel.edu/~amotong/teaching/machine learning...Introduction to Machine Learning Amo G. Tong 7 Deep Learning •What are deep learning methods?

Machine learning Introduction

Machine Learning 1 - Introduction

Machine Learning Introduction Slide

COMP 562: Introduction to Machine Learning · Introduction to Machine Learning Machine learning: What and Why? Quiz: De ning the Learning Task "Machine Learning is the study of algorithms

Machine Learning Introduction Machine learningbejar/ia/transpas/teoria.mti/6-AP-aprendizaj… · Machine Learning Introduction Types of machine learning Inductive Learning: Models

An Introduction to Machine Learning - GitHub Pages · Introduction Machine learning The machine learning process What’s machine learning History Supervised learning Non-supervised

Introduction to Machine Learning Lecture 13mohri/mlu/mlu_lecture_13.pdf · Introduction to Machine Learning Lecture 13 ... Introduction to Machine Learning page 2 Multi-Class Classiﬁcation

Machine Learning Introduction

INTRODUCTION to Machine Learning

Introduction to Machine Learning

Introduction to Machine Learning · Introduction to Machine Learning CMSC 422 MARINE CARPUAT [email protected]

Machine Learning - Introduction to Machine Learningmpetrik/teaching/intro_ml_17_files/class1.pdf · Machine Learning Introduction to Machine Learning Marek Petrik January 26, 2017

Dhruv Madeka Introduction Theoretical Machine Learning · (learning) through experience. Theoretical Machine Learning Dhruv Madeka Introduction What is Machine Learning? Some useful

CS7267 Machine Learning introduction to machine learning

Introduction Machine Learning

MACHINE LEARNING AN INTRODUCTION - Sas Institute · 2016-03-11 · MACHINE LEARNING - AN INTRODUCTION WHAT IS MACHINE LEARNING? Wikipedia: Machine learning, a branch of artificial

Introduction to Machine Learning summaryicarus.csd.auth.gr/.../05/Introduction-to-Machine-Learning-Summary.p… · Introduction to Machine Learning General notations: • ∈ℝ :ML

Machine Learning - Introduction

1. Introduction to Machine - lis-lab.fr › bernard.espinasse › ... · § 1. Introduction to Machine Learning § Machine Learning Problem § Machine Learning: Supervised & Unsupervised

Introduction to Machine Learning

Machine Learning and Data Mining: Lecture Noteshertzman/411notes.pdf · CSC 411 / CSC D11 Introduction to Machine Learning 1 Introduction to Machine Learning Machine learning is a