will deep learning lead to ai? - haytham fayek · ml / ai melbourne meetup - august 2017. what is...
TRANSCRIPT
![Page 1: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/1.jpg)
Will Deep Learning Lead to AI?Haytham Fayek
ML / AI Melbourne Meetup - August 2017
![Page 2: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/2.jpg)
What is Artificial Intelligence?
2
![Page 3: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/3.jpg)
What is Intelligence?
The ability to perceive information, and to retain it as knowledge to be applied towards adaptive behaviors within an
environment or context.
3Haytham Fayek, Will Deep Learning Lead to AI?
Work In Progress
![Page 4: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/4.jpg)
What is Artificial Intelligence?
4Haytham Fayek, Will Deep Learning Lead to AI?
Think Like Human Behave Like Human
Think Rationally Act Rationally
[*] Images from various online sources
![Page 5: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/5.jpg)
AI
5Haytham Fayek, Will Deep Learning Lead to AI?
Learning
Meta-Learning
Perception
Attention
Memory
Reasoning
Planning
Emotion
Communication
Narrow AIvs
Strong AI
![Page 6: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/6.jpg)
What is Deep Learning?
6Haytham Fayek, Will Deep Learning Lead to AI?
The hierarchical learning of feature representations
[*] Images from various online sources
![Page 7: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/7.jpg)
Notation
7
![Page 8: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/8.jpg)
Notation
8Haytham Fayek, Will Deep Learning Lead to AI?
Linear Operation:
Non-Linear Operation:
![Page 9: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/9.jpg)
Notation
9Haytham Fayek, Will Deep Learning Lead to AI?
A Convolutional Layer:
A Fully-Connected Layer:
![Page 10: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/10.jpg)
Notation
10Haytham Fayek, Will Deep Learning Lead to AI?
x
h
y
![Page 11: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/11.jpg)
Notation
11Haytham Fayek, Will Deep Learning Lead to AI?
x
h
y
Find W that minimizes L:
![Page 12: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/12.jpg)
Notation
12Haytham Fayek, Will Deep Learning Lead to AI?
[*] http://www.asimovinstitute.org/neural-network-zoo/
Feedforward Neural Network (DNN)
Convolutional Neural Network (ConvNets)
Recurrent Neural Network(RNN) Long Short-term Memory
(LSTM-RNN)
Residual Network (ResNets)
![Page 13: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/13.jpg)
Learning
13
![Page 14: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/14.jpg)
LearningSupervised Learning
Pick a model, loss function & training scheme.Train a large model on lots of labeled data.
14Haytham Fayek, Will Deep Learning Lead to AI?
[1] Zeiler & Fergus, Visualizing and Understanding Convolutional Neural Networks, 2013
![Page 15: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/15.jpg)
LearningReinforcement Learning
15Haytham Fayek, Will Deep Learning Lead to AI?
![Page 16: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/16.jpg)
LearningReinforcement Learning
16
[2] Heess et al., Emergence of Locomotion Behaviours in Rich Environments, 2017
Haytham Fayek, Will Deep Learning Lead to AI?
![Page 17: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/17.jpg)
Perception
17
![Page 18: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/18.jpg)
PerceptionSupervised Learning has made strides in Perception: Speech Recognition, Computer Vision, Natural Language Processing.
Each modality requires a fair amount of specialized engineering.
18Haytham Fayek, Will Deep Learning Lead to AI?[*] Images from respective papers: He et al. 2015, Hannun et al. 2014
![Page 19: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/19.jpg)
PerceptionA single model with good results on multiple tasks in multiple domains.
Tasks: Object Recognition, translation, image captioning, speech recognition, parsing, ..
Components:● Convolutional Layers● Attention Mechanism● Mixture of Experts
19
[3] Kaiser et al., One Model to Learn Them All, 2017
Haytham Fayek, Will Deep Learning Lead to AI?
![Page 20: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/20.jpg)
Perception
20
[4] Kaiser et al., One Model to Learn Them All, 2017
Haytham Fayek, Will Deep Learning Lead to AI?
![Page 21: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/21.jpg)
Attention
21
![Page 22: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/22.jpg)
Attention
22Haytham Fayek, Will Deep Learning Lead to AI?
Allows selective processing of input to avoid clutter and simplify computation.
Allows processing of complex input in nonlinear ways.
Attention can make our models more interpretable.
[5] Cho et al., Describing Multimedia Content using Attention Based Encoder Decoder Networks, 2015
![Page 23: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/23.jpg)
Attention
23Haytham Fayek, Will Deep Learning Lead to AI?
[6] Xu et al., Show, Attend and Tell: Neural Image Caption Generation with Visual Attention, 2015
Image Caption Generation
![Page 24: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/24.jpg)
Memory
24
![Page 25: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/25.jpg)
MemoryNeural Turing Machine
An LSTM Controller
Read / Write Heads using Attention (NN)
An External Memory
Can learning simple algorithms such as copying & sorting
25Haytham Fayek, Will Deep Learning Lead to AI?
[7] Graves et al., Neural Turing Machine, 2015
![Page 26: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/26.jpg)
Reasoning
26
![Page 27: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/27.jpg)
ReasoningProcess very unstructured complex (multi-modal) input
Deliberate and infer relations
Store Knowledge
Output unstructured output
27Haytham Fayek, Will Deep Learning Lead to AI?
[8] Johnson et al., Learning and Executing Programs for Visual Reasoning , 2017
![Page 28: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/28.jpg)
ReasoningVisual Question Answering (VQA)
28Haytham Fayek, Will Deep Learning Lead to AI?
[9] Yang et al., Stacked Attention for Image Question Answering, 2015
![Page 29: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/29.jpg)
ReasoningVisual Question Answering (VQA)
29Haytham Fayek, Will Deep Learning Lead to AI?
[9] Yang et al., Stacked Attention for Image Question Answering, 2015
![Page 30: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/30.jpg)
ReasoningVisual Question Answering (VQA)
30Haytham Fayek, Will Deep Learning Lead to AI?
[8] Johnson et al., Learning and Executing Programs for Visual Reasoning , 2017
![Page 31: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/31.jpg)
ReasoningVisual Question Answering (VQA)
31Haytham Fayek, Will Deep Learning Lead to AI?
[8] Johnson et al., Learning and Executing Programs for Visual Reasoning , 2017
![Page 32: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/32.jpg)
Meta-Learning
32
![Page 33: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/33.jpg)
Meta-LearningLearning to Learn
33Haytham Fayek, Will Deep Learning Lead to AI?
[*] Ravi et al., Optimization as a Model for Few-Shot Learning, 2017
![Page 34: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/34.jpg)
Meta-LearningLearning to Learn
34Haytham Fayek, Will Deep Learning Lead to AI?
[*] Ravi et al., Optimization as a Model for Few-Shot Learning, 2017
![Page 35: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/35.jpg)
Meta-LearningLearning to Learn
35Haytham Fayek, Will Deep Learning Lead to AI?
[10] Kirkpatrick et al., Overcoming catastrophic forgetting in neural networks, 2017
![Page 36: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/36.jpg)
Will Deep Learning Lead to AI?
36
![Page 37: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/37.jpg)
RemarksSupervised learning works!
Current models require sophisticated engineering and big data.
Unsupervised learning and reinforcement learning remain challenging paradigms.
Lots of challenging questions remain to be answered or even asked!
37Haytham Fayek, Will Deep Learning Lead to AI?
![Page 38: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/38.jpg)
Thank you
38
![Page 39: Will Deep Learning Lead to AI? - Haytham Fayek · ML / AI Melbourne Meetup - August 2017. What is Artificial Intelligence? 2. What is Intelligence? The ability to perceive information,](https://reader034.vdocuments.net/reader034/viewer/2022042914/5f4d3d26ff61e3609a1f8146/html5/thumbnails/39.jpg)
Will Deep Learning Lead to AI?@haythamfayek