s u m m i t - amazon web services...video streams, amazon rekognition, and amazon cloudwatch lex...

S U MM I TB E R L I N

Rise of Robotics:Innovating the Future with IoT & AI

Özkan Can, AWS - Senior Solutions Architect

@_ozzc

A W S S U M M I T B e r l i n

Agenda

• Cloud Robotics

• Robot Development

• Robot Collaboration

• Reinforcement Learning

Robotics trendsin 2018

Robotics is undergoing fundamental change in collaboration, autonomous

mobility, and increasing intelligence

Source: IDTechEx

• Logistics

• Construction

• Retail

• Hospitality

• Healthcare

Robots are being put to work every

day across many industries

• Agriculture

• Energy Management

• Oil and Gas

• Facilities Management

• Household chores

By 2023, it’s estimated that mobile autonomous robots will emerge as the standard for logistic and fulfillment processes

By 2030, 70% of all mobile material handling equipment will be autonomous

Mobile roboticstrends 2018

We are at the beginning of an inflection point, where expected growth in the use of mobile robots will increase by almost tenfold over the next 2–3 years, but…

Cloud Robotics

Robotic development is difficult and time consuming

Requires machine learning expertise for intelligent functions

Many prototyping iterations

Days spent setting up and configuring

Months to building a realistic simulation environment

Duplicated efforts integrating an application management system

Robotic development cycle

2) Develop robotics

application

1) Select robotics software

framework

4) Deploy and manage

application

3) Test and simulate

application

AWS RoboMaker

A service that makes it easy for developers to develop, test, and deploy robotics applications, as well as build intelligent robotics functions using cloud services

AWS RoboMaker service suite

Development Environment

Simulation Cloud Extensions for ROS Fleet Management

Robot Operationg System (ROS) Primer

Robot Hardware

Robot Application

ROS is an open-source,

meta-operating system for your robot.

https://wiki.ros.org

ROS Nodes

ROSMaster

ROSNodes

/topicsROS

NodesROS

ROSNodes

ROS Nodes

ROSMaster

ROSNodes

/topicsROS

NodesROS

ROSNodes

Hello World Node Publisher

1 import rospy

2 from std_msgs.msg import String

3 pub = rospy.Publisher('chatter', String, queue_size=10)

4 rospy.init_node('talker', anonymous=True)

5 rate = rospy.Rate(10) # 10hz

6 while not rospy.is_shutdown():

7 hello_str = "hello world %s" % rospy.get_time()

8 pub.publish(hello_str)

9 rate.sleep()

Hello World Node Subscriber

1 import rospy

2 from std_msgs.msg import String

3 def callback(data):

4 rospy.loginfo(rospy.get_caller_id() + "I heard %s", data.data)

5 rospy.init_node('listener', anonymous=True)

6 rospy.Subscriber("chatter", String, callback)

7 rospy.spin()

AWS RoboMaker Investment in ROS

Actively guiding the development of the newest version of ROS (ROS2) via representation on the Technical Steering Committee (TSC) of OSRF

Investment to provide Long Term Support (LTS) for ROS2

• LTS maintains backwards compatibility

• LTS allows developers to release commercial and production-level products on ROS2

Investment to increase ROS2 packages

• Packages are reusable and provide unique robotics functions such as mapping and navigation

• AWS driving migration of 113 critical packages identified for ground mobility robots to ROS2 by the first ROS2 LTS release

Leading the security and logging design of ROS2 and contribution to the ROS2 core messaging system, Data Distribution Service (DDS)

AWS RoboMaker Architecture

ROS/ROS2

DevelopmentEnvironment

SimulationFleet

ManagementCloud Extensions

for ROS

AWS RoboMaker

Cloud Extensions for ROS

Cloud extensions written as ROS packages automatically create connections and make API calls to AWS services, such as Amazon Lex, Amazon Polly, Amazon Kinesis Video Streams, Amazon Rekognition, and Amazon CloudWatch

LEXspeech

recognition

speech

generation

KINESIS

STREAMS

streams

REKOGNITION

image and video

analysis

CLOUDWATCH

logging and

monitoring

Amazon CloudWatch extension in operation

ROS Nodes

and topics

AWS Cloud

Node logic

Temporary

security

credential

Stored

credential

… or …

Collaboration through IoT Services

To securely connect devices to the AWS cloud & other devices at scale

To fully integrate with other AWS services to reason

on top of the data (Analytics, Databases, AI, etc.)

To route, process, and act upon data from connected devices

AWS IoT Core is a managed service that lets connected devices easily

and securely interact with cloud applications and other devices.

To enable applications to interact with devices even

when they are offline

AWS IoT Core

Edge Cloud

Law of Economics

Law of Physics

Law of the Land

AWS IoT Greengrass

AWS IoT Greengrass extends AWS IoT onto your devices, so that they can act

locally on the data they generate, while still taking advantage of the cloud.

AWS IoT ROS Extension

https://github.com/aws-robotics/aws-iot-bridge-example

AWS IoT CoreAWS IoT Greengrass

Fleet Management

AWS IoT CoreAWS IoT Greengrass

AWS RoboMaker

Deploy

ArtificialIntelligence

MachineLearning

ReinforcementLearning

SupervisedLearning

UnsupervisedLearning

Reinforcement learning in the broader AI context

Machine Learning Overview

SUPERVISED UNSUPERVISED REINFORCEMENT

Reinforcement Learning in the real world

Reward positive behavior

Don’t reward negative behavior

The result!

Reinforcement Learning use cases

AUTONOMOUS CARS FINANCIAL TRADING DATACENTER COOLINGFLEET LOGISTICS

What is Reinforcement Learning?

How does learning happen?VALUE FUNCTION

POLICY FUNCTION

RL Algorithms – Value Approximation

CHALLENGE Explore all (state, action, outcome) combinations in a real world race to create the value function

RL Algorithms – Value Approximation

CHALLENGE Explore all (state, action, outcome) combinations in a real world race to create the value function.

VERDICT Not possible

SOLUTION Approximate the value function using supervised learning. Use data from exploration to create a model capable of estimating the likely cumulative reward for all possible actions in a state.

The action with the highest cumulative reward,

is the best action.

RL Algorithms – Policy Approximation

ALTERNATIVE Try to directly map actions to states without using a value function.

HOW Use supervised learning to train a policy function model that returns the best action for any state.

How do we know this is a good action? Because it gave the highest reward. Keep improving our model in the direction of the highest reward.

FAMOUS EXAMPLE

Dota2 Challenge - OpenAI Five

Reinforcement Learning Algorithms Compared

Value Approximation Policy Approximation

AdvantagesMore stable performance when it works, and tends to

converge on global optimum

Effective in continuous action spaces, can learn stochastic policies,

and faster convergence

DisadvantagesDifficult to converge if too many (state, action)

combinations, slower convergence in general, and

can’t learn stochastic properties

Typically converges to a local rather than global optimum, high

variance in estimating the gradient adversely affects stability, and

evaluating a policy is generally inefficient

Examples Q-Learning, Deep Q Network, Deep Double Q Network Policy Gradient, Proximal Policy Optimization (PPO)

Amazon SageMaker

Amazon SageMaker is a fully-managed servicethat covers the entire machine learningworkflow to label and prepare your data, choose an algorithm, train the algorithm, tune and optimize it for deployment, makepredictions, and take action.

Amazon SageMaker RL

Amazon SageMaker RL builds on top ofAmazon SageMaker, adding pre-packaged RL toolkits and making it easy to integrate anysimulation environment.

• Intel Coach

• Ray RLLib

• TensorFlow,…

• Support for Open Source and

Commercial Environments

Pre-Packaged RL Toolkits

• OpenAI Gym

• MXNet

AWS Cloud

gateway

Models

Simulation

Metrics

Simulation Architecture

Gazebo

Gazebo is an open-source,

Robot simulation tool.

https://gazebosim.org

Interactions with Simulator

In Closing

Accelerate development time

with zero infrastructure provisioning

through AWS services for

Cloud Robotics.

• AWS Robomaker

• AWS IoT Core

• AWS IoT Greengrass

• Amazon SageMaker RL

Cloud Robotics on AWS

GO BUILD!

Özkan Can, AWS - Senior Solutions Architect

@_ozzc

s u m m i t - amazon web services...video streams, amazon rekognition, and amazon cloudwatch lex...

Documents

optimizing the quality of scalable video streams on p2p

amazon rekognition - 개발자 안내서 · 2020-02-07 ·...

media streams: an iconic visual language for video...

digital video media by: david owens. introduction to video...

media streams: an iconic visual language for video...

detection of illicit content in video streams niall rea &...

code development for processing video streams

seventh framework programme theme ict -2007.8.3 - … ·...

awsの機械学習サービスとamazon sagemaker...

dynamic depth of field on live video streams: a stereo

face localization from video streams face localization from

real time video analytics with infosphere streams, opencv...

supporting zoomable video streams with dynamic region-of...

transcoding live adaptive video streams at a massive · pdf...

adaptive encoding of zoomable video streams based on user

multiplexing the elementary streams of h.264 video and mpeg4...

panduan pelaksanaan rekognition, validation and

introducing amazon rekognition, amazon polly and amazon lex

media streams: an iconic visual language for video...

statistical multiplexer of vbr video streams 31.12.2002 by...