building smart applications with conversational interfaces and …... · 2019-03-01 · building...
TRANSCRIPT
![Page 1: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/1.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Building Smart Applications with Conversational Interfaces and Language ServicesAlex Casalboni
![Page 2: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/2.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
About me
• Software Engineer & Web Developer• Startupper for 4.5 years• Serverless Lover & AI Enthusiast• ServerlessDays Organizer• AWS Customer since 2013
![Page 3: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/3.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Put machine learning in the hands of every developer
Our mission
![Page 4: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/4.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Our Approach
Customer-focusedroadmap (90%+)
Most popular frameworks (Tensorflow, MXNET)
200+ new launchesduring 2018
Wide range of services in production
Security and analytics capabiities
Embedded Research & Development
![Page 5: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/5.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
Amazon ML Stack
A I S E R V I C E SR E K O G N I T I O N
I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N
V I D E O
Vis ion Speech Chatbots
A M A Z O N S A G E M A K E R
B U I L D T R A I N
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
D E P L O YM L S E R V I C E S
F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e
E C 2 P 3 & P 3 d n
E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I CI N F E R E N C E
Language Forecast ing Recommendat ions
![Page 6: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/6.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AI capabilitiesVision
Speech-to-Text (STT)
Text-to-Speech (TTS)
Natural Language Understanding
Language Translation
Uniform programming interfacefor text and voice apps
![Page 7: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/7.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AI capabilities on AWS *Vision
Speech-to-Text (STT)
Text-to-Speech (TTS)
Natural Language Understanding
Language Translation
Chatbot Interface
Amazon Rekognition
Amazon Transcribe
Amazon Polly
Amazon Comprehend
Amazon Translate
Amazon Lex
* and more!
![Page 8: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/8.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Audio Input
End-to-end workloads (media)
trigger
store
in cascade
call aggregate analyze
![Page 9: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/9.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Add intelligent image and videoanalysis to your applications
![Page 10: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/10.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deep Learning-Based Image and Video Analysis
![Page 11: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/11.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Optical Character Recognition (OCR)
![Page 12: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/12.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Object & Scene Detection
![Page 13: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/13.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Facial Analysis
![Page 14: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/14.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Face Search/Comparison
![Page 15: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/15.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Marinus Analytics uses facial recognition to stop human trafficking
“Now with Traffic Jam’s FaceSearch, powered by
Amazon Rekognition, investigators are able to take effective action by
searching through millions of records in seconds to find
victims.”
![Page 16: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/16.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Discover insights and relationships in text
![Page 17: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/17.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
NLU Functionalit ies
Sentiment Entities LanguagesKeyphrases Topic
modeling
Syntax
![Page 18: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/18.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EnglishItalianFrench
GermanPortuguese
Suppor ted Languages
![Page 19: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/19.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Syntax detection$ aws comprehend detect-syntax
--language-code 'en' --text 'I love cloud!’{
"SyntaxTokens": [
{
"TokenId": 1,
"Text": "I",
"BeginOffset": 0,
"EndOffset": 1,
"PartOfSpeech": {
"Tag": "PRON",
"Score": 0.9999802112579346
}
},
...
![Page 20: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/20.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Sentiment Analysis$ aws comprehend detect-sentiment
--language-code 'en' --text 'I love cloud!’
{
"Sentiment": "POSITIVE”,
"SentimentScore": {
"Mixed": 0.012617903761565685,
"Positive": 0.9599817991256714,
"Neutral": 0.021758323535323143,
"Negative": 0.005641999188810587
}
}
![Page 21: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/21.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
« Amazon Comprehend helps us analyzethe key sentiments, objects, and geos in our30 million plus reviews & testimonies. Nowwe are able to discover new insights into theunique experiences available at eachproperty, so our customers can make thebest decision possible for their travel.”
Matt Fryer, VP and Chief Data Science Officer, Hotels.com
![Page 22: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/22.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Extract health information from patient notes, clinical trial reports, and other electronic health records
![Page 23: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/23.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Turn text into lifelike speech using deep learning
![Page 24: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/24.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Polly
• Content creation• Mobile & desktop
applications• Internet of Things (IoT)• Education & e-learning• Telephony• Game development
Use cases
• 58 voices across 28 languages
• Lip-syncing & text highlighting
• Fine-grained voice control• Custom vocabularies• Available in 17 AWS Regions
Key features
![Page 25: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/25.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
“With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices
available on the market.”
Severin HackerCTO, Duolingo
![Page 26: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/26.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Yes, natural language translation
![Page 27: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/27.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Supported languages *
ArabicSimplified Chinese
FrenchGermanSpanish
Portuguese
JapaneseTraditional Chinese
ItalianRussianTurkishCzech
* 417 translation combinations
DanishDutchFinnishSwedishPolish
Hebrew
![Page 28: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/28.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
«We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believethat Amazon Translate presents a quick, efficient and most importantly, accuratesolution. »
Matt Fryer, VP and Chief Data Science Officer, Hotels.com
![Page 29: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/29.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Turn speech into text
![Page 30: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/30.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EnglishItalianFrenchSpanish
Portuguese
Suppor ted Languages
![Page 31: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/31.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Use cases
Call centers
Subtitles for VOD
Broadcast closed captions
Transcribe meetings
![Page 32: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/32.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
ringDNA• End-to-end communications platform for
sales teams. • Hundreds of enterprise organizations
use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate.
Speech to Text"A critical component of RingDNA’s Conversation AIrequires best of breed speech-to-text to delivertranscriptions of every phone call. RingDNA isexcited about Amazon Transcribe since itprovides high-quality speech recognition at scale,helping us to better transcribe every call to text "
Howard Brown, CEO & Founder, RingDNA
https://www.youtube.com/watch?v=1ZJ_f1bDdog
![Page 33: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/33.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Conversational interfaces for your applications powered by the same deep learning technologies as Alexa
![Page 34: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/34.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Lex
End to End
Speech to Intent
ASR+NLU integrated into one
API
Dialog Management
Native support &maintains context
Text to Speech
Amazon Polly integrated into API
Business Logic
Native integration with AWS Lambda
Deployment
One click deployment
Security
Encrypted data in transit & at rest
Scale
Completely managed service
Analytics
Monitor and improve
End to End
![Page 35: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/35.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
![Page 36: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/36.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
OCR++ service to extract data from virtually any document(No ML experience required)
![Page 37: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/37.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Textract: How it works
![Page 38: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/38.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Accurate time-series forecasting service(No ML experience required)
![Page 39: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/39.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The perils of poor predictions in forecasting
TIME
SALES
FORECAST
SALES
![Page 40: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/40.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Historical dataSupply chain, inventory, etc.
Customized forecasting API
Inspect data
Identify features
Selectfrom 8
algorithms
SelectHyperparameters
Host models
Loaddata
Trainmodels
Optimizemodels
Related “causal” dataWeather, special offers, product
details
Amazon Forecast
Amazon Forecast: How it works
![Page 41: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/41.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real-time personalization and recommendation service(No ML experience required)
![Page 42: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/42.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Activity stream from app
Views, signups, conversion, etc.
InventoryArticles, products,
videos, etc.
Demographics (optional)
LOAD DATA(EMR Cluster)
INSPECT DATA
IDENTIFY FEATURES
SELECTALGORITHMS
SELECTHYPERPARAMETERS
TRAINMODELS
OPTIMIZEMODELS
HOST MODELS
BUILD FEATURESTORE
CREATEREAL-TIME
CACHES
Customizedpersonalization &recommendation
API
F u l l y m a n a g e d b y A m a z o n P e r s o n a l i z e
Amazon Personalize
Age, location, etc.
Amazon Personalize: How it works
![Page 43: Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building Smart Applications with Conversational Interfaces and Language Services. Alex Casalboni](https://reader034.vdocuments.net/reader034/viewer/2022042221/5ec7d8af721a6d486206c24d/html5/thumbnails/43.jpg)
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.