디지털혁신을위한기술 그리고인재상 - kosta kosta keynote.pdfai/machine learning on...
TRANSCRIPT
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
김효정 솔루션즈 아키텍트/상무, AWS
2018 Feb. 23
디지털혁신을위한기술그리고인재상
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
목차
• 모두를 위한 혁신(Innovation for everyone)
• 새로운 통찰력의 발견(Unlocking new today)
• 클라우드, AI 그리고 데이터 중심 문제 해결(Cloud, AI, Data-driven problem solving)
• 디지털 혁신을 위한 인재상(Leadership principles)
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
모두를 위한 혁신(Innovation for everyone)
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The
Institutional
YES!
INNOVATION AT THE EDGE
Enable everyone to innovate
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The
Institutional
YES!
Translating Sign Language to Speech
• Bluetooth enabled gloves
• Records hand position and
movement
• Uses deep learning to
match gestures with words
• Text to speech
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
새로운 통찰력의 발견(Unlocking new today)
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fulfilment &
Logistics
Amazon 그리고 고객 중심 혁신
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon 그리고 고객 중심 혁신
Fulfilment &
Logistics
Search &
Discovery
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon 그리고 고객 중심 혁신
Fulfilment & Lo
gisticsExisting
Products
Search & Disco
very
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon 그리고 고객 중심 혁신
Fulfilment &
LogisticsExisting
Products
New
Products
Search &
Discovery
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Edge compute allows for real-time
decisions to be made in-vehicle, driven by
computer vision and deep learning
Sense and Avoid Technology
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
클라우드, AI, 데이터 중심 문제 해결(Cloud, AI, Data-driven problem solving)
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS 플랫폼 - 서비스로서 제공되는 혁신(Innovation as a service)
CORE SERVICES
Integrated Networking
Rules Engine
Device Shadows
Device SDKs
Device Gateway
Registry
Local Compute
Custom Model
Training & Hosting
Conversational Chatbots
Virtual Desktops
App Streaming
Schema Conversion
Image & Scene Recognition
Sharing & Collaboration
Exabyte-Scale
Data Migration
Text to Speech
Corporate Email Application Migration
Database Migration
Regions
Availability Zones
Points of Presence
Data Warehousing
Business Intelligence
Elasticsearch
Hadoop/Spark
Data Pipelines
Streaming Data
Collection
ETLStreaming Data
Analysis
Interactive SQL
Queries
Queuing & Notifications
Workflow
Transcoding
Deep Learning(Apache MXNet,
TensorFlow, & others)
Server MigrationCommunications
MARKETPLACE
Business Apps Business Intelligence DevOps Tools Security Networking StorageDatabases
API Gateway
Single Integrated Console
Identity
Sync
Mobile Analytics
Mobile App Testing
Targeted Push Notifications
One-click App Deployment
DevOps Resource Management
Application Lifecycle Management
Containers
Triggers
Resource Templates
Build & Test
Analyze & Debug
Identity Management
Key Management
& Storage
Monitoring & Logs
Configuration Compliance
Web Application Firewall
Assessment
& Reporting
Resource & Usage Auditing
Access Control
Account Grouping
DDOS
Protection
TECHNICAL & BUSINESS SUPPORT
SupportProfessional
ServicesOptimization Guidance
Partner
EcosystemTraining & Certification
Solutions Management Account ManagementSecurity & Billing Reports
Personalized Dashboard
Monitoring
Manage Resources
Data Integration
Integrated Identity & Access
Integrated Resource & Deployment Management
Integrated Devices& Edge Systems
Resource Templates
Configuration Tracking
Server Management
Service Catalogue
Search
MIGRATIONHYBRID ARCHITECTUREENTERPRISE APPSMACHINE LEARNINGIoTMOBILE SERVICESDEV OPSANALYTICS
APP SERVICES
INFRASTRUCTURE SECURITY & COMPLIANCE MANAGEMENT TOOLS
ComputeVMs, Auto-scaling, Load Balancing, Containers,
Virtual Private Servers,
Batch Computing, Cloud
Functions, Elastic GPUs,
Edge Computing
StorageObject, Blocks, File, Archivals, Import/Export, Exabyte-scale
data transfer
CDN
DatabasesRelational, NoSQL, Caching, Migration,
PostgreSQL compatible
NetworkingVPC, DX, DNS
Facial Recognition & Analysis
Facial Search
Patching
Contact Center
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Deep Learning will enable AI
Eventually everything connects
IoT / Mobile / Cameras / APIs
Large amounts of data will be
processed in real-time
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Perform tasks which normally require human intelligence and the ability for a computer system to adapt to humans
and interact in a natural manner, rather than humans adapting to a system
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AI/Machine Learning on AWSApplication Developers
Amazon Rekognition
Amazon Machine Learning
Amazon Polly
Amazon LexNatural Language Understanding (NLU)
& Automatic Speech Recognition (ASR)
Image and Video Recognition & Analysis
Text-to-Speech
Managed Machine Learning
AWS Deep Learning AMIUse and scale deep learning
frameworks quickly and easily
Data Scientists & ResearchersAmazon SageMakerFully managed end-to-end machine learning
service
Amazon TranscribeAutomatic speech recognition (ASR)
Amazon TranslateNeural machine translation service
Amazon ComprehendDiscover insights and relationships in text
AWS DeepLens
Amazon EC2 P3 instances provide
6X better performance than any
other GPU-based instances in the
market today.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Extract rich metadata from visual content
Object and Scene
DetectionFacial
Analysis
Face
Comparison
Facial
Recognition
Celebrity
Recognition
Image
Moderation
Amazon Rekognition
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition: Object & Scene Detection
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition: Facial Detection
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition: Facial Comparison
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition: Facial Search
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekogn i t ion Video
Features
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekogn i t ion Video
Object, Scene and Activity Detection
Blowing a candle Drinking
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekogn i t ion Video
Activity recognition
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekogn i t ion Video
Person Tracking
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekogn i t ion Video
Live Streaming Face Recognition
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data-Driven Problems
Building a ML system
• Data pre-processing, training, AB testing, model hosting, retraining
• How do I select the right algorithm?
• How do I tune the right variables?
• Are Spark ML algorithms well baked?
• DL algorithms are hard to use
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Visualization &
Analysis
Business Problem –
Data Collection
Data Integration
Data Preparation &
Cleaning
Feature Engineering
Model Training &
Parameter Tuning
Model Evaluation
Are Business
Goals met?
Model Deployment
Monitoring &
Debugging
– Predictions
YesNo
Data
Augm
enta
tio
n
Fe
atu
re
Augm
enta
tio
n
Re-training
ML problem framing
머신러닝 프로세스
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Visualization &
Analysis
Business Problem –
Data Collection
Data Integration
Data Preparation &
Cleaning
Feature Engineering
Model Training &
Parameter Tuning
Model Evaluation
Are Business
Goals met?
Model Deployment
Monitoring &
Debugging
– Predictions
YesNo
Data
Augm
enta
tio
n
Fe
atu
re
Augm
enta
tio
n
Re-training
ML problem framing
탐색: 분석
•정확한질문을만들는데도움을주는것• Domain Knowledge
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Visualization &
Analysis
Business Problem –
Data Collection
Data Integration
Data Preparation &
Cleaning
Feature Engineering
Model Training &
Parameter Tuning
Model Evaluation
Are Business
Goals met?
Model Deployment
Monitoring &
Debugging
– Predictions
YesNo
Data
Augm
enta
tio
n
Fe
atu
re
Augm
enta
tio
n
Re-training
ML problem framing
통합: 데이터 아키텍처
•데이터플렛폼구현• Amazon S3
• AWS Glue
• Amazon Athena
• Amazon EMR
• Amazon Redshift Spectrum
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Visualization &
Analysis
Business Problem –
Data Collection
Data Integration
Data Preparation &
Cleaning
Feature Engineering
Model Training &
Parameter Tuning
Model Evaluation
Are Business
Goals met?
Model Deployment
Monitoring &
Debugging
– Predictions
YesNo
Data
Augm
enta
tio
n
Fe
atu
re
Augm
enta
tio
n
Re-training
ML problem framing
왜 SageMaker를 만들었나 – 학습 환경 제공
• 노트북환경구성및관리
• 학습클러스터구성및관리
• 데이터커넥터작성
• 대용량데이터를수용할수있는확장성있는 ML 알고리즘
• 여러노드를사용할수있는분산 ML 학습알고리즘
• 모델결과물에대한보안
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Visualization &
Analysis
Business Problem –
Data Collection
Data Integration
Data Preparation &
Cleaning
Feature Engineering
Model Training &
Parameter Tuning
Model Evaluation
Are Business
Goals met?
Model Deployment
Monitoring &
Debugging
– Predictions
YesNo
Data
Augm
enta
tio
n
Fe
atu
re
Augm
enta
tio
n
Re-training
ML problem framing
왜 SageMaker를 만들었나 – 배포 환경 제공
• 인퍼런스클러스터구성및운영
• 인퍼런스 API를확장성있게구성하고운영하기
• 모델예측결과에대한모니터링과디버깅
• 모델버저닝과성능추적
• 새로운모델을운영환경에A/B 테스팅형태로배포
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
완전 관리 및자동 스케일링
배포
원클릭 배포
생성
JupyterNotebook 기반
서비스
고성능알고리즘미리 제공
원클릭데이터훈련
훈련
Hyperparameter최적화
데이터과학자와개발자들이스마트어플리케이션에사용될머신러닝기반의모델을빠르고쉽게만들도록해주는
완전관리형서비스
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Machine Learning - Managed machine learning service
• Easy to use, managed machine learning service built
for developers
• Classification
Sentiment analysis – Do people like my new product?
• Linear Regression
Trend prediction – How much revenue next month?
• Clustering
Recommendation - Other people bought this!
• Association
Market basket analysis – Bundled products
• Use data in Amazon S3, Amazon RDS or Amazon
Redshift
• Provides batch or real-time predictions
Amazon Machine
Learning
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DeepLens : DL-enabled video camera
Develop ML skills using hands-on computer vision tutorials and
pre-built models
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
기존의 컴퓨터 비전 클라이언트 개발 환경
Rasberry Pi PC (Laptop) 스마트폰
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DEEPLENS는단지 비디오 카메라가
아닙니다 .
…세계 최초의딥러닝 활용가능한
개발자 키트입니다 .
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
디지털 혁신을 위한 인재상(Leadership principles)
Amazon
Leadership
Principles
Customer Obsession
Ownership
Invent and Simplify
Are Right, A Lot
Learn and Be Curious
Hire and Develop the Best
Insist on the Highest Standards
Think Big
Bias for Action
Frugality
Earn Trust
Dive Deep
Have Backbone; Disagree and Commit
Deliver Results
2 Pizza Teams
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
”미래는이미우리곁에와있다. 단지널리퍼져있지않을뿐이다”
-윌리엄깁슨
Nikola Tesla, 1926
“무선통신기술이완벽하게
적용된다면, 지구는하나로연결된
거대한하나의브레인을갖게될
것입니다…”
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
IoT & 에지 컴퓨팅
+
무선 & 모바일 테크놀로지+
머신 러닝 & AI
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
지속적실험(Experiment Continuously)
+모든것을측정(Measure Relentlessly)
+학습(Learn)
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
감사합니다!