aws re:invent 2017 ml re:cap - amazon web...
TRANSCRIPT
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Christian Petters, Solutions Architect
December 2017
AWS re:Invent 2017 ML re:Cap
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU(P3 Instances)
MobileCPUIoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNetPyTorch
Cognitive
ToolkitKeras
Caffe2
& CaffeTensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMakerAWS
DeepLens
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU(P3 Instances)
MobileCPUIoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNetPyTorch
Cognitive
ToolkitKeras
Caffe2
& CaffeTensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMakerAWS
DeepLens
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon RekognitionImage Recognition and Analysis powered by
Deep Learning allows search, verification,
and organization millions of images
Potential Use Cases
Searchable Image Library Detect Inappropriate Content in Images
Face-based User Verification Sentiment Analysis
Facial Recognition Celebrity Identification
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition Video Analysis Service
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Continuous Feature Releases
Real-Time Face Recognition
Crowd-Mode Face Detection
Support for Recognition of Text
Improved Face Detection
Image Moderation
Celebrity Detection
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon PollyTurn text into lifelike speech using deep
learning technologies to synthesize
speech that sounds like a human voice
Potential Use Cases
Content Creation Education & E-learning
Mobile & Desktop Applications Customer Contact Center
Internet of Things (IoT) Accessibility
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Language ServicesSeveral new services launched to
speed the development of language
processing and translation in
applications
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe (Preview)
Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for
developers to add speech to text capability to their applications
Time StampsSupport for both
regular & telephony
audio
Punctuation
& formatting
§
S3 Integration Recognize
Multiple
Speakers
Custom
Vocabulary
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend: Natura l Language
Process ing
😃
Sentiment Entities Languages Key phrases Topic modeling
POWERED BY DEEP
LEARNING
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A m a z o n . c o m , I n c . i s l o c a t e d i n
S e a t t l e , W A a n d w a s f o u n d e d J u l y
5 t h , 1 9 9 4 b y J e f f B e z o s . O u r
c u s t o m e r s l o v e b u y i n g e v e r y t h i n g
f r o m b o o k s t o b l e n d e r s a t g r e a t
p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m : O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h
A m a z o n C o m p r e h e n d : E x t r a c t I n s i g h t f r o m Te x t
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Translate: Machine Translation
Neural Machine Translation between English and:
• Spanish
• Portuguese
• Chinese
• French
• German
• Arabic
… with more languages to follow
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
F u l l y m a n a g e d T o p i c
m o d e l i n g s e r v i c e
E x t r a c t u p t o 1 0 0 t o p i c s
f r o m a c o r p u s o f d o c u m e n t s
A u t o m a t i c a l l y o r g a n i z e s
d o c u m e n t s i n t o t h e t o p i c s
Amazon Comprehend: Topic Model ing
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Example of translating between languages:
Context aware: knows not to
translate “Amazon” to
“Amazonas“ (Amazon Jungle)
Learns to re-order words &
phrases according to the
grammar of each language
"Amazon Web Services is a collection of cloud computing services"
“Amazon Web Services es una colección de servicios de computación en la nube”
Amazon Translate: Machine Translation
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon LexConversational interfaces for your
applications, powered by the same
Natural Language Understanding
(NLU) & Automatic Speech Recognition
(ASR) models as Alexa
Potential Use Cases
Appointment Booking Customer Support
Informational Services Access Enterprise Data
Chatbots Voice Assistant
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU(P3 Instances)
MobileCPUIoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNetPyTorch
Cognitive
ToolkitKeras
Caffe2
& CaffeTensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMakerAWS
DeepLens
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
A fully managed service that enables data scientists and developers to quickly and
easily build machine-learning based models into production smart applications.
1 2 3 4
I I I I
Notebooks Service Algorithms Training Service Hosting Service
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sagemaker: High Performance ML Algorithms
• Many of the current ML algorithms do not scale well
• Managing DL algorithms at scale is a different challenge
• Our goal: Provide common ML algorithms that outperform
current implementations by 10x (faster). Algorithms such as:
• Matrix Factorization, Regression, Principle
Component Analysis, K-Means Clustering, Gradient
Boosted Machines, and more
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A new way to learn
Custom built for deep learning
Broad Framework Support
Deploy models from Amazon SageMaker
Integrated with AWS
Full programmable with AWS Lambda
AWS DeepLens ( G A)
W o r l d ’ s f i r s t d e e p l e a r n i n g e n a b l e d v i d e o c a m e r a f o r d e v e l o p e r s
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Vision:
Rekognition Image
Rekognition Video
Speech:
Polly
Transcribe
Language:
Lex Translate
Comprehend
AWS ML Stack
Application
Services
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU(P3 Instances)
MobileCPUIoT
(Greengrass)
Apache
MXNetPyTorch
Cognitive
ToolkitKeras
Caffe2
& CaffeTensorFlow Gluon
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMakerAWS
DeepLens
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Support for all major frameworks
AWS Deep Learning AMI
Apache MXNet
Torch
Cognitive
ToolkitKeras
TheanoCaffe2
& Caffe
TensorFlow
Amazon EC2
AnacondaIntel MKL
Nvidia CUDA &
cuDNN
Python2 &
Python3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Open source deep learning interface which allows
developers to easily and quickly build machine learning
models, without compromising performance
Provides a clear, concise API for defining machine
learning models using a collection of pre-built, optimized
neural networks
Developers will find this interface familiar, since machine
learning models can be defined and manipulated just
like any other data structure
Data scientists and researchers will value the ability to
build prototypes quickly and utilize dynamic neural
network graphs for entirely new model architectures
AWS and Microsoft
announced Gluon
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Model
Training
Inference
in the Cloud
Inference
at the Edge
Infrastructure to support model build and deploy
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Train model in the cloud Run model at the edge
AWS
Greengrass
AWS IoT
Tesla V100
120 TFLOPS
Amazon
EC2
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fully integrate ML services into your applications, leveraging your
existing business data assets, your streaming data, your data lakes,
and your operational systems
Use blueprints for what has been done to achieve what is possible...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Questions!