soumith chintala, artificial intelligence research engineer, facebook at mlconf nyc - 4/15/16
TRANSCRIPT
![Page 1: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/1.jpg)
Predicting the Future using Deep Adversarial Networks
Soumith ChintalaFacebook AI Research
Learning With No Labeled Data
![Page 2: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/2.jpg)
Overviewof the talk
• The problem at hand • What are the benefits? • How did we solve it • What have we achieved • What’s left?
![Page 3: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/3.jpg)
You are here
![Page 4: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/4.jpg)
You are here
Walk here!
![Page 5: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/5.jpg)
Route 1
![Page 6: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/6.jpg)
Route 2
![Page 7: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/7.jpg)
Route 3
![Page 8: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/8.jpg)
Let’s Train a Route Generator
![Page 9: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/9.jpg)
Route Generator
Training Data
![Page 10: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/10.jpg)
Linear Regressor with Mean-square Error
Route Generator
RouteGenerator
![Page 11: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/11.jpg)
Linear Regressor with Mean-square Error
Route Generator
RouteGeneratornoise
![Page 12: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/12.jpg)
Linear Regressor with Mean-square Error
Route Generator
RouteGeneratornoise Route
![Page 13: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/13.jpg)
Linear Regressor with Mean-square Error
Route Generator
RouteGeneratornoise Route Optimizer
Training Data
Loss: MSE
![Page 14: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/14.jpg)
Route Generator
Training Data
![Page 15: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/15.jpg)
Linear Regressor with Mean-square Error
Route Generator
Eh?
![Page 16: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/16.jpg)
Linear Regressor with Mean-square Error
Route Generator
Eh?
![Page 17: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/17.jpg)
Linear Regressor with Mean-square Error
Route Generator
Eh? Eh?
![Page 18: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/18.jpg)
Linear Regressor with Mean-square Error
Route Generator
Eh? Eh? Eh?
![Page 19: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/19.jpg)
Linear Regressor with Mean-square Error
Route Generator
Eh? Eh? Eh? Eh?
![Page 20: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/20.jpg)
Linear Regressor with Mean-square Error
Route Generator
Eh? Eh? Eh? Eh? Eh?
![Page 21: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/21.jpg)
Linear Regressor with Mean-square Error
Route Generator
Problem!Converges to the mean
of training samples
![Page 22: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/22.jpg)
Linear Regressor with Mean-square Error
Route Generator
Which is not a valid route!
Problem!Converges to the mean
of training samples
![Page 23: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/23.jpg)
Linear Regressor with Mean-square Error
Route Generator
Let’s try again!
![Page 24: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/24.jpg)
Linear Regressor with Route Validator
Route Generator
RouteGenerator
noiseRoute Optimizer
Training Data
Loss: MSEpoints
![Page 25: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/25.jpg)
Route Generator
RouteGenerator Route Optimizer
Training Data
Loss: Valid Route
Linear Regressor with Route Validator
noise
points
![Page 26: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/26.jpg)
Route Generator
RouteGenerator Route Optimizer
Training Data
Loss: Valid Route
Linear Regressor with Route Validator
noise
points
![Page 27: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/27.jpg)
Route Generator
RouteGenerator Route Optimizer
Training Data
Loss: Valid Route
Linear Regressor with Route Validator
????
noise
points
![Page 28: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/28.jpg)
Generator
Generator Sample Optimizer
Training Data
Loss: Looks Real????
noise
points
![Page 29: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/29.jpg)
Generator
Generatornoise Sample Optimizer
Training Data
Loss: Looks Real
![Page 30: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/30.jpg)
Generator
Generatornoise SampleClassification
Loss
Training Data
Learnt Real/Fake Cost function
Discriminator
![Page 31: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/31.jpg)
Generator
Generatornoise SampleClassification
Loss
Training Data
Neural Net
Discriminator
Neural Net
![Page 32: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/32.jpg)
Generator
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Trained via Gradient Descent
![Page 33: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/33.jpg)
Generator
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Optimizing to fool D
![Page 34: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/34.jpg)
Generator
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Optimizing to not get fooled by G
![Page 35: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/35.jpg)
![Page 36: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/36.jpg)
![Page 37: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/37.jpg)
![Page 38: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/38.jpg)
Route 4
![Page 39: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/39.jpg)
Route Crazy!
![Page 40: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/40.jpg)
Route Crazy! But valid.
![Page 41: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/41.jpg)
![Page 42: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/42.jpg)
Generator
Generatornoise
SampleClassification
Loss
Training Data
Discriminator
Optimizing to not get fooled by G
class
![Page 43: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/43.jpg)
![Page 44: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/44.jpg)
![Page 45: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/45.jpg)
Generator
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Optimizing to not get fooled by G
![Page 46: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/46.jpg)
Generator
Generatornoise SampleClassification
Loss
Training Data
Discriminator
Optimizing to not get fooled by G
MSE Loss
![Page 47: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/47.jpg)
![Page 48: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/48.jpg)
![Page 49: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/49.jpg)
![Page 50: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/50.jpg)
![Page 51: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/51.jpg)
![Page 52: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/52.jpg)
![Page 53: Soumith Chintala, Artificial Intelligence Research Engineer, Facebook at MLconf NYC - 4/15/16](https://reader031.vdocuments.net/reader031/viewer/2022030314/588a28951a28abb21f8b6a27/html5/thumbnails/53.jpg)
Uses
• Unsupervised Learning • Learn when there’s little labeled data
• Planning • Look-ahead to take better decisions