accelerating deployment of autonomous delivery robots ... · •some of the important lessons from...

30
Accelerating Deployment of Autonomous Delivery Robots using Model Based Design Dr. Erik Wilhelm KYBURZ Switzerland 02.06.2020

Upload: others

Post on 06-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Accelerating Deployment of Autonomous Delivery

Robots using Model Based Design

Dr. Erik Wilhelm

KYBURZ Switzerland 02.06.2020

Page 2: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

A well-established brand

02.06.2020

Page 3: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Why Autonomous Delivery?

02.06.2020

• Must be:

–Cheaper

– Faster

–More reliable

– ... More personal?

Page 4: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Four functional prototypes in 24 Months

02.06.2020

• Mobile depot box (eT1 / eT2)

• Sensors

– 2D Lidar

– Ultrasonic

– 360 camera

– GPS

– Bump-stop

• Autonomous delivery agent (eT3)

• Sensors

– 3D Lidar

– Ultrasonic

– Infraded

– INS

– Bump-stop

• Flexible delivery system (eT4)

• Sensors

– 3D Lidar (2x)

– Ultrasonic (12x)

– Infrared (12x)

– Radar

– GPS (INS)

– 360 Cameras (localization)

– 360 Cameras (comprehension)

– Time-of-flight camera

– Bump-stop

Page 5: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Economics of Delivery Robots

• Robots should be operated for long shifts without disengagement with cheap sensors

02.06.2020

Page 6: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

eT4: Autonomous delivery platform

02.06.2020

Page 7: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Autonomous System Design Challenges

02.06.2020

High availability Approved safety

Image: sick.comImage: ABC news

Test coverage

Image: youtube.com

Page 8: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Safety-centered workflow

• This workflow allows SIL2 certifiable code to be generated using model-based design

• Review and testing occurs within each phase and before each release

02.06.2020

Specifications Model Based Design Code Generation Compilation

Page 9: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Incumbent

100 – 200 ms

Infer Act

02.06.2020

Sense

Page 10: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Challenger

40 ms

20– 40 ms

20 ms 300 ms

50 - 600 ms 20 ms

1 ms

300 ms

650 – 820 ms

02.06.2020

Infer ActSense

Page 11: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Does it have to be head to head?

02.06.2020

Page 12: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Redundancy for sensor systems

02.06.2020

Page 13: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Integrated code-level functional specification

02.06.2020

Page 14: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Corner Cases

02.06.2020

Image: drivingtests.co.nz

Image: arstechnica.com

Image: sick.com

Page 15: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Safety Solution

• Kyburz toolchain uses layered verification techniques and model-based design

• All requirements are easily documented for traceability

System Specification

Module Specification

Unit Specification Unit Tests

Module Tests

System TestsROS Gazebo + SIL environment (Multiphysics)

Co-simulation of Testbenches

Simulink Test

02.06.2020

Page 16: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Unit Testing

02.06.2020

• Unit testing linked with requirements closes the V

Page 17: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Safety Example: LiDAR (Light Detection and Ranging)

02.06.2020

Laser

Page 18: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Complexity Management

02.06.2020

Page 19: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Internal laser reflections

1. On even ground predictable rings are

formed

2. Detectable obstacles modulate the ring

form

3. Undetectable close objects create

gaps in the rings

02.06.2020

Solution:

Page 20: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Near-field LiDAR object detection

02.06.2020

1. We receive a 16x1024 point cloud

in 3 dimensions

Algorithm:

Page 21: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Objekterkennung mit LIDAR

02.06.2020

Algorithm:

1. We receive a 16x1024 point cloud

in 3 dimensions

2. We remove points which are

echoed by the robot itself

Page 22: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Objekterkennung mit LIDAR

02.06.2020

Algorithm:

1. We receive a 16x1024 point cloud

in 3 dimensions

2. We remove points which are

echoed by the robot itself

3. We extract the lowest three rings

Page 23: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Objekterkennung mit LIDAR

02.06.2020

Algorithm:

1. We receive a 16x1024 point cloud

in 3 dimensions

2. We remove points which are

echoed by the robot itself

3. We extract the lowest three rings

4. And search for ring shapes

Page 24: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Objekterkennung mit LIDAR

02.06.2020

Algorithm:

1. We receive a 16x1024 point cloud

in 3 dimensions

2. We remove points which are

echoed by the robot itself

3. We extract the lowest three rings

4. And search for ring shapes

5. Everything which is not part of a

ring is classified as an obstacle

Page 25: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Objekterkennung mit LIDAR

02.06.2020

Algorithm:

1. We receive a 16x1024 point cloud

in 3 dimensions

2. We remove points which are

echoed by the robot itself

3. We extract the lowest three rings

4. And search for ring shapes

5. Everything which is not part of a

ring is classified as an obstacle

6. Gaps in the rings are then also

classified as obstacles

Page 26: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Simulation and Model-based Design

Inputs Outputs

Controller Logic

02.06.2020

Page 27: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Vehicle in Action

02.06.2020

Page 28: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Summary

• Kyburz was able to produce four functional prototypes in a span of

24 months using Model Based Design

• Some of the important lessons from this presentation:

– Document and ensure adequate process is followed

– Establish workflow which enables high safety integrity levels to

be reached

– Test at unit, module, and system level

• Success depends on effort multipliers (i.e. tools) as well as

structured process

• Stay tuned for further deployments

02.06.2020

Page 29: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Dr. Erik Wilhelm

KYBURZ Switzerland 11.04.2019

Accelerating Deployment of Autonomous Delivery

Robots using Model Based Design

Page 30: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish

Q & A - Thank you for your attention

02.06.2020