![Page 1: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/1.jpg)
1
Machine Learning (Extended)Dr. Ata Kaban
• Algorithms to enable computers to learn – Learning = ability to improve performance automatically
through experience– Experience = previously seen examples
• Interdisciplinary field– AI– Probability & Statistics– Information theory– Philosophy– Control theory– Psychology– Neurobiology, etc
![Page 2: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/2.jpg)
2
What is the Learning Problem?
![Page 3: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/3.jpg)
3
Example: Which word a person is thinking about?
FMRI brain activity data:
Source: Tom Mitchell's research pages
![Page 4: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/4.jpg)
4
Example: Find a specified object
![Page 5: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/5.jpg)
5
![Page 6: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/6.jpg)
6
1
2 3 4
5 6 7 8 910
11
9000
1800
2700 4500
810880 720
880
648
600
2128
282
2390 1800 2400
180023902400
72
University of Ulster
Department
InformationStudent
CSScience
&Arts
InternationalOffice Library
Under-graduate
Graduate
Jobs
200 300S
E
9000
Start
Exit
122128
Register
![Page 7: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/7.jpg)
7
s
1
s
2
s
3
s
4
x
1
x
2
x
3
x
4
a
11
a
12
a
13a
14
![Page 8: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/8.jpg)
8
What is the Learning problem?
Learning = improving with experience at some task– Improve at task T
– With respect to performance measure P
– Based on experience E
• Example: Learning to play checkers– T: play checkers
– P: % of games won in world tournament
– E: opportunity to play against self
![Page 9: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/9.jpg)
9
• Example: Learning to recognise faces– T: recognise faces– P: % of correct recognitions– E: opportunity to make guesses and being told
what the truth was
• Example: Learning to find clusters in data– T: finding clusters– P: compactness of the groups detected– E: opportunity to see a large set of data
![Page 10: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/10.jpg)
10
Types of training experience
• Direct or indirect
• With a teacher or without a teacher
• An eternal problem: is the training experience representative of the performance goal? – it needs to be.
![Page 11: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/11.jpg)
11
Forms of Machine Learning
• Supervised learning: uses a series of examples with direct feedback
• Unsupervised learning: no feedback
• Reinforcement learning: indirect feedback, after many examples
Q: For the examples given, can you distinguish which type of learning they belong to?
![Page 12: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/12.jpg)
12
Focus of the module
• Understanding the fundamental principles– Types of ML tasks – General algorithms and how they work– Which method is good for what and why– What ML methods can and cannot do– Open research problems
• This module is NOT a course on teaching to use a particular software package
![Page 13: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/13.jpg)
13
Prerequisites
Mathematical Techniques for Computer Science (or equivalent)
Introduction to AI (or equivalent)
![Page 14: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/14.jpg)
14
Syllabus
1.Overview of machine learning. Basic notions, literature
2.Supervised learning Generative methods Discriminative methods Computational learning theory basics Boosting and ensemble methods 3.Unsupervised learning Clustering Learning for structure discovery 4.Reinforcement learning basics 5.Topics in learning from high dimensional data and large scale learning
![Page 15: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/15.jpg)
15
Literature
• Machine Learning (Mitchell)• A first course in Machine Learning (Rogers &
Girolami)• Support Vector Machines and Other Kernel-Based
Learning Methods (Cristianini, Shawe-Taylor) • Modelling the Web (Baldi, Smyth)• Artificial Intelligence … (Russell, Norvig)
+math refreshers on the ML module's website
![Page 16: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/16.jpg)
16
Some achievements of ML
• Programs that can:– Recognize spoken words– Predict recovery rates of pneumonia patients– Detect fraudulent use of credit cards– Drive autonomous vehicles– Play games like backgammon – approaching
the human champion!
![Page 17: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/17.jpg)
Assessment
Machine Learning: 20% Coursework; 80% exam.
Coursework: “Type 1” (i.e. pen & paper) - one class test (15%) - one take-home test (5%)
![Page 18: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/18.jpg)
Assessment
Machine Learning Extended: 40% Coursework; 60% exam.
– All of the previous– “Type 2” (i.e. computer based problems) These consist of 4 pieces of work, handed out throughout
the term, with deadline at the end of term.
![Page 19: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/19.jpg)
Classes, web site
• 2 hours / week• Some are lectures and some are exercise classes.• Module home page: http://www.cs.bham.ac.uk/~axk/ML_new.htm• The content currently there is from last year, and the page will be
updated as we go along. However it gives you a good idea of what to expect in terms of content, level of difficulty, types of assignments etc.
• Contains some math refreshers you might find useful: Linear Algebra & Probability Theory for Machine Learning
![Page 20: 1 Machine Learning (Extended) Dr. Ata Kaban Algorithms to enable computers to learn –Learning = ability to improve performance automatically through experience](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ef65503460f94c09f3f/html5/thumbnails/20.jpg)
Office hours• The time for my weekly office hours is communicated on
my timetable (watch for possible changes):
• Location: UG32• What office hours are and aren’t for
– Yes: ask me concrete questions to clarify something that has not been clear to you from the lecture
– Yes: seek advice on your solutions to the given exercises
– Yes: seek advice on further readings on related material not covered in the lecture
– No: ask me to solve the exercises– No: ask me to repeat a lecture
http://www.cs.bham.ac.uk/~axk/timetable.html