big data app meetup 2016-06-15
TRANSCRIPT
![Page 1: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/1.jpg)
Practical TensorFlowIllia Polosukhin, Google Research@ilblackdragon
![Page 2: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/2.jpg)
Why Machine Learning?
★ Allows to solve problems we don’t have exact solution for.○ E.g. recommendations, predictions, clustering.
★ Given y = F(X), where we observe y, we can estimate F.
★ Becomes better with more data ○ when hard coded solution usually becomes worse with more
code :)
![Page 3: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/3.jpg)
Google Products Using Machine Learning
![Page 4: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/4.jpg)
Big Data Challenges
★Variety of data★Learning many things at once★Small data where matters
![Page 5: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/5.jpg)
Deep LearningInput
Out
![Page 6: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/6.jpg)
Input
Out
Deep Learning for Perception Tasks
![Page 7: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/7.jpg)
Input
Out
Deep Learning for Perception Tasks
![Page 8: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/8.jpg)
Input
Out
Deep Learning for Perception Tasks
![Page 9: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/9.jpg)
Input
Out
Deep Learning for Perception Tasks
![Page 10: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/10.jpg)
Input
Out
Deep Learning for Perception Tasks
![Page 11: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/11.jpg)
Deep Learning combines many components
Predictions
GoogLeNet
Recurrent Neural Network
![Page 12: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/12.jpg)
Deep Learning: Leverage pre-training
![Page 13: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/13.jpg)
What is TensorFlow?
![Page 14: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/14.jpg)
![Page 15: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/15.jpg)
TensorFlow Ecosystem
Researchers Developers
Data Scientists
![Page 16: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/16.jpg)
TensorFlow Core Execution Engine
CPU GPU Android iOS ...
C++ FrontendPython Frontend ...
![Page 17: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/17.jpg)
TensorFlow: Google backed
★ Google supported (growing army of engineers are working on improving it).
★ Used in 100s of products across Google
![Page 18: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/18.jpg)
How can I use this?
TensorFlow Learn
![Page 19: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/19.jpg)
Simple example:
How can I use this?
![Page 20: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/20.jpg)
Predictive Example
Going to deep neural network is easy:
![Page 21: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/21.jpg)
Understanding Images
![Page 22: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/22.jpg)
Image Classification
![Page 23: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/23.jpg)
![Page 24: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/24.jpg)
Recommendation Example
![Page 25: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/25.jpg)
Recommendation Example
Image Description Item User
N layers of convolutions RNN encoder Item
embeddingsUser
embeddings
Concatenate
N fully connected layers Item embeddings P(item)
![Page 26: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/26.jpg)
![Page 27: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/27.jpg)
![Page 28: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/28.jpg)
![Page 29: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/29.jpg)
Scaling Out
TensorFlow scales with number of Machines.
You can use Google Cloud ML or Docker containers in VMs.https://arxiv.org/abs/1604.00981
![Page 30: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/30.jpg)
TensorFlow Serving: Serving models in production
Open Source project.
Check it out:
http://github.com/tensorflow/serving
![Page 31: Big data app meetup 2016-06-15](https://reader036.vdocuments.net/reader036/viewer/2022070510/58ac5c301a28ab8e258b6189/html5/thumbnails/31.jpg)
Questions?
Illia Polosukhin@ilblackdragon
#TensorFlowhttp://github.com/tensorflow/tensorflow
http://tensorflow.org