cs 6140: machine learning · • 4/20: final exam • addi@onal office hours: – 4.17, 4-5pm,...

56
CS 6140: Machine Learning Spring 2017 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: [email protected]

Upload: others

Post on 28-Mar-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What

CS6140:MachineLearningSpring2017

Instructor:LuWangCollegeofComputerandInforma@onScience

NortheasternUniversityWebpage:www.ccs.neu.edu/home/luwang

Email:[email protected]

Page 2: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What

Logis@cs•  GradesforA2isout.

•  Nextweek:courseprojectpresenta@on.

•  Thefinalreportisdueon4/24.Allassignmentshavetobeinby4/29.

•  4/20:finalexam

•  Addi@onalofficehours:–  4.17,4-5pm,(Lu,448WVH)–  4.18,11am-12pm,(TA,166WVH)–  4.19,4-5pm,(Lu,448WVH)

Page 3: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What

Whatwelearnedlast@me

•  Introduc@ontoReinforcementLearning•  TheReinforcementLearningProblem•  MarkovDecisionProcess

Page 4: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 5: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 6: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 7: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 8: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 9: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 10: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 11: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 12: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 13: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 14: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 15: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 16: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 17: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 18: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 19: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 20: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 21: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 22: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 23: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 24: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 25: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 26: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 27: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 28: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 29: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What

Today’sOutline

•  PlanningbyDynamicProgramming– Policyevalua@onandpolicyimprovement– Valueitera@on

[SlidestakenfromDavidSilver’sreinforcementlearningcourse]

Page 30: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 31: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 32: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 33: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 34: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 35: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 36: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 37: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 38: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 39: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 40: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 41: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 42: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 43: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 44: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 45: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 46: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 47: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 48: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 49: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 50: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 51: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 52: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 53: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 54: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 55: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What
Page 56: CS 6140: Machine Learning · • 4/20: final exam • Addi@onal office hours: – 4.17, 4-5pm, (Lu, 448 WVH) – 4.18, 11am-12pm, (TA, 166 WVH) – 4.19, 4-5pm, (Lu, 448 WVH) What