![Page 1: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/1.jpg)
8/20/18
1
Machine Learning
StephanRobert|HEIG-Vd|SummerUniversity2018
Few good books (Not necessary to buy them, just download them. Free access)
![Page 2: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/2.jpg)
8/20/18
2
Few good books (Not necessary to buy them, just download them. Free access)
• Machine Learning, Tom Mitchell• Machine Learning, Kevin Murphy
Web page and links... Lectureslidesandhandouts
Documentation,links,softwareresources
Announcementsandschedule
Email(labs)
Slidesathttp://www.stephan-robert.ch/teaching/machine-learning
![Page 3: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/3.jpg)
8/20/18
3
… and links...
Kaggle.com(competitions,jobs,…)
Datascience.net
Python tutorials and books
docs.python.org/3/tutorial/index.html
wiki.python.org/moin/IntroductoryBooks
![Page 4: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/4.jpg)
8/20/18
4
Python environment
Pythonrelease3.6
AnacondaNavigator(Jupyter,Ipython,Spyder,…)
Python libraries
Numpy
Pandas
Matplotlib
Scikit-learn
Scipy
![Page 5: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/5.jpg)
8/20/18
5
Syllabus
Lesson1:IntroductiontoMachineLearning,GradientDescent(costfunction,manyvariables)
Lesson2:Linearregression,logisticregression
Lesson3:Supportvectormachines
Lesson4:Unsupervisedlearning(PCA,k-means,K-nearestneighbor,classification)
Homeworks
HW1:GradientDescent
HW2:Linearandlogisticregression
HW3:SupportVectorMachines
HW4:Unsupervisedlearning
![Page 6: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/6.jpg)
8/20/18
6
Eachgroupofstudents(1-2studentspergroup)mustwritetheirowncodefortheprogrammingpart.Pleasedon’tsearchforanswersontheweb,Google,previousyears’homeworks,etc.D0n’tpostthemeither!
HW1,2,3:Groupoftwostudents(1fromSNU+1fromHEIG-Vd)
HW4:Individual
Homeworks
Grading
• 4homeworks
![Page 7: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/7.jpg)
8/20/18
7
Machine Learning is changing the world
© Emily Fox
Few videos...
• NVIDIA Press Event at CES 2018https://www.youtube.com/watch?v=P3BjB5-Y4JM
![Page 8: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/8.jpg)
8/20/18
8
What is Machine Learning?
• Study of algorithms that improve their performances at some tasks with experience
Supervised learning
• Knowledgeofoutput
Learningwiththepresenceofanexpert(e.g.SupportVectorMachines,DecisionTrees,NeuralNetworks,BayesianClassifiers,…)
![Page 9: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/9.jpg)
8/20/18
9
ExampleofhousespricesinLausanne
House price prediction Supervised learning: regression
House price prediction Supervised learning
![Page 10: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/10.jpg)
8/20/18
10
House price prediction Supervised learning
House price prediction Supervised learning
![Page 11: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/11.jpg)
8/20/18
11
Spam filtering Supervised learning: classification
NotSpamTextofemail,IPSource,… Spam
input output
Other examples Supervised learning: classification
• Sentimentanalysis• Personalizedmedicaldiagnosis(multiple
outputs:flu,healthy,…)
![Page 12: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/12.jpg)
8/20/18
12
Stock prediction Supervised learning
Depends on recent historyof stock market, newsevents,…
(Vodafone)
Unsupervised learning
• NoKnowledgeofoutput
Learningwithoutthepresenceofanexpert(e.gk-means,clusteringapproaches,…)
![Page 13: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/13.jpg)
8/20/18
13
Unsupervised learning
news.google.com
Unsupervised learning
Clusteringimages,groupas:
• Clouds• Mountains• Roads
![Page 14: Machine Learning - Stephan Robert€¦ · Lesson 1: Introduction to Machine Learning, Gradient Descent (cost function, many variables) Lesson 2: Linear regression, logistic regression](https://reader035.vdocuments.net/reader035/viewer/2022062922/5f07a36a7e708231d41dfc45/html5/thumbnails/14.jpg)
8/20/18
14
Unsupervised learning
Otherexamples
• UsersonWebsites(groups,activities)• Words(Firstnames,lastnames,location
words,…)