deep learning on aws with tensorflow - aws online tech talks

40
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Guy Ernest, Principal Solutions Architect, Amazon AI Oct 24, 2017 Introduction to Deep Learning on AWS with TensorFlow

Upload: amazon-web-services

Post on 21-Jan-2018

626 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Guy Ernest, Principal Solutions Architect, Amazon

AIOct 24, 2017

Introduction to Deep Learning

on AWS with TensorFlow

Page 2: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why Deep Learning?

Why Now?

Why Cloud?

Why Amazon?

Why You?

Why TensorFlow?

Why Keras?

Why Not a Demo?

Page 3: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why Deep Learning?

Page 4: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Page 5: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Neural Style Transfer

Page 6: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Neural Style Transfer

Page 7: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Neural Style Transfer

Page 8: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Neural Style Transfer

Page 9: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why Now?

Page 10: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Fast Compute

Ubiquitous Data

Advanced Learning Algorithms

Page 11: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why Cloud?

Page 12: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The circle of ML

Front-End team

Data Engineering team

Analysts / DS team

DevOps team

Business Problem

Data

ML Model

ML Application

Page 13: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The circle of ML

Front-End team

Data Engineering team

Analysts / DS team

DevOps team

Business Problem

Data

ML Model

ML Application

S3

EMR

Kinesis *

Redshift

Athena

Glue

ECSLambda

API-GW

Code *

DMS

EB

P2

Spot

Batch IoT

GreenGrass

FPGA

Edge

Snowball

Page 14: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AWS Snowball Edge

100T Data Transport Device

With On-board Compute

Page 15: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why Amazon?

Page 16: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Page 17: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Artificial Intelligence At AmazonThousands Of Employees Across The Company Focused on AI

Discovery &

Search

Fulfilment &

Logistics

Enhance

Existing Products

Define New

Categories Of

Products

Bring Machine

Learning To All

Page 18: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Page 19: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Page 20: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks
Page 21: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

• Applied Research

• Core Research

• Alexa

• Demand Forecasting

• Risk Analytics

• Search

• Recommendations

• AI Services | Rek, Lex, Polly

• Q&A Systems

• Supply Chain Optimization

• Advertising

• Machine Translation

• Video Content Analysis

• Robotics

• Lots of Computer Vision..

• NLP / NLU

Just a few Deep Learning Use Cases at Amazon…

Page 22: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Running AI In Production on AWS Today

Page 23: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Pinterest

Visual Search

Page 24: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Pinterest Lens

Page 25: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks
Page 26: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Recommendations & Ranking At Netflix

Personalized ranking,

page generation,

search, similarity, ratings

In 140 new countries,

simultaneously

Page 27: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why You?

Page 28: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon AIIntelligent Services Powered By Deep Learning

Page 29: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

More in

2017

Infrastructure CPU

Engines MXNet TensorFlow Caffe Theano Pytorch CNTK

ServicesAmazon Polly

Platforms

IoT

Speech

Mobile

Amazon

ML

Spark &

EMRKinesis Batch ECS

GPU

More in

2017

Chat

Amazon Lex

Amazon AI: Machine Learning In The Hands Of Every Developer

Amazon Rekognition

Vision

Page 30: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

More in

2017

Infrastructure CPU

Engines MXNet TensorFlow Caffe Theano Pytorch CNTK

ServicesAmazon Polly

Platforms

IoT

Speech

Mobile

Amazon

ML

Spark &

EMRKinesis Batch ECS

GPU

More in

2017

Chat

Amazon Lex

Amazon AI: Machine Learning In The Hands Of Every Developer

Amazon Rekognition

Vision

Page 31: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why TensorFlow?

Page 32: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

TensorFlow Execution Engine

Python Frontend

Deep Learning Layers

Keras API

Canned Estimators

TensorFlow Layers

with tf.Session() as sess:

sess.run(init)

sess.run(optimizer)

tf.layers.dense(…)

tf.layers.conv2d(…)

Page 33: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Execution

Graph

TensorFlow Execution Engine

Page 34: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why are we here?

Why Keras?

Page 35: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

TensorFlow Execution

Engine

Python Frontend

Deep Learning Layers

Keras API

Canned Estimators

Keras Example

from keras.models import Sequential

model = Sequential()

from keras.layers import Dense, Activation

model.add(Dense(units=64, input_dim=100))

model.add(Activation('relu'))

model.add(Dense(units=10))

model.add(Activation('softmax'))

model.compile(loss='categorical_crossentropy',

optimizer='sgd', metrics=['accuracy'])

model.fit(x_train, y_train, epochs=5, batch_size=32)

Page 36: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

“Sounds great!

How can we get started?”

Page 37: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Code WalkthroughMNIST (Hello World) with Keras on Tensorflow

Page 38: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AWS Deep Learning AMI: One-Click GPU Deep Learning

Up To 40,000

CUDA Cores

Python 3 Notebooks

& Examples

(and others)(Volta at launch)

Scale for

Training

TensorFlow,

Apache MXNet

Page 39: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Learn more:

AWS Deep Learning AMIs: https://aws.amazon.com/amazon-ai/amis/

TensorFlow on AWS: https://aws.amazon.com/tensorflow/

Page 40: Deep Learning on AWS with TensorFlow - AWS Online Tech Talks

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Thank You!