accelerating deployment of autonomous delivery robots ... · •some of the important lessons from...
TRANSCRIPT
![Page 1: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/1.jpg)
Accelerating Deployment of Autonomous Delivery
Robots using Model Based Design
Dr. Erik Wilhelm
KYBURZ Switzerland 02.06.2020
![Page 2: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/2.jpg)
A well-established brand
02.06.2020
![Page 3: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/3.jpg)
Why Autonomous Delivery?
02.06.2020
• Must be:
–Cheaper
– Faster
–More reliable
– ... More personal?
![Page 4: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/4.jpg)
Four functional prototypes in 24 Months
02.06.2020
• Mobile depot box (eT1 / eT2)
• Sensors
– 2D Lidar
– Ultrasonic
– 360 camera
– GPS
– Bump-stop
• Autonomous delivery agent (eT3)
• Sensors
– 3D Lidar
– Ultrasonic
– Infraded
– INS
– Bump-stop
• Flexible delivery system (eT4)
• Sensors
– 3D Lidar (2x)
– Ultrasonic (12x)
– Infrared (12x)
– Radar
– GPS (INS)
– 360 Cameras (localization)
– 360 Cameras (comprehension)
– Time-of-flight camera
– Bump-stop
![Page 5: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/5.jpg)
Economics of Delivery Robots
• Robots should be operated for long shifts without disengagement with cheap sensors
02.06.2020
![Page 6: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/6.jpg)
eT4: Autonomous delivery platform
02.06.2020
![Page 7: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/7.jpg)
Autonomous System Design Challenges
02.06.2020
High availability Approved safety
Image: sick.comImage: ABC news
Test coverage
Image: youtube.com
![Page 8: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/8.jpg)
Safety-centered workflow
• This workflow allows SIL2 certifiable code to be generated using model-based design
• Review and testing occurs within each phase and before each release
02.06.2020
Specifications Model Based Design Code Generation Compilation
![Page 9: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/9.jpg)
Incumbent
100 – 200 ms
Infer Act
02.06.2020
Sense
![Page 10: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/10.jpg)
Challenger
40 ms
20– 40 ms
20 ms 300 ms
50 - 600 ms 20 ms
1 ms
300 ms
650 – 820 ms
02.06.2020
Infer ActSense
![Page 11: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/11.jpg)
Does it have to be head to head?
02.06.2020
![Page 12: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/12.jpg)
Redundancy for sensor systems
02.06.2020
![Page 13: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/13.jpg)
Integrated code-level functional specification
02.06.2020
![Page 14: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/14.jpg)
Corner Cases
02.06.2020
Image: drivingtests.co.nz
Image: arstechnica.com
Image: sick.com
![Page 15: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/15.jpg)
Safety Solution
• Kyburz toolchain uses layered verification techniques and model-based design
• All requirements are easily documented for traceability
System Specification
Module Specification
Unit Specification Unit Tests
Module Tests
System TestsROS Gazebo + SIL environment (Multiphysics)
Co-simulation of Testbenches
Simulink Test
02.06.2020
![Page 16: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/16.jpg)
Unit Testing
02.06.2020
• Unit testing linked with requirements closes the V
![Page 17: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/17.jpg)
Safety Example: LiDAR (Light Detection and Ranging)
02.06.2020
Laser
![Page 18: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/18.jpg)
Complexity Management
02.06.2020
![Page 19: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/19.jpg)
Internal laser reflections
1. On even ground predictable rings are
formed
2. Detectable obstacles modulate the ring
form
3. Undetectable close objects create
gaps in the rings
02.06.2020
Solution:
![Page 20: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/20.jpg)
Near-field LiDAR object detection
02.06.2020
1. We receive a 16x1024 point cloud
in 3 dimensions
Algorithm:
![Page 21: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/21.jpg)
Objekterkennung mit LIDAR
02.06.2020
Algorithm:
1. We receive a 16x1024 point cloud
in 3 dimensions
2. We remove points which are
echoed by the robot itself
![Page 22: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/22.jpg)
Objekterkennung mit LIDAR
02.06.2020
Algorithm:
1. We receive a 16x1024 point cloud
in 3 dimensions
2. We remove points which are
echoed by the robot itself
3. We extract the lowest three rings
![Page 23: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/23.jpg)
Objekterkennung mit LIDAR
02.06.2020
Algorithm:
1. We receive a 16x1024 point cloud
in 3 dimensions
2. We remove points which are
echoed by the robot itself
3. We extract the lowest three rings
4. And search for ring shapes
![Page 24: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/24.jpg)
Objekterkennung mit LIDAR
02.06.2020
Algorithm:
1. We receive a 16x1024 point cloud
in 3 dimensions
2. We remove points which are
echoed by the robot itself
3. We extract the lowest three rings
4. And search for ring shapes
5. Everything which is not part of a
ring is classified as an obstacle
![Page 25: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/25.jpg)
Objekterkennung mit LIDAR
02.06.2020
Algorithm:
1. We receive a 16x1024 point cloud
in 3 dimensions
2. We remove points which are
echoed by the robot itself
3. We extract the lowest three rings
4. And search for ring shapes
5. Everything which is not part of a
ring is classified as an obstacle
6. Gaps in the rings are then also
classified as obstacles
![Page 26: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/26.jpg)
Simulation and Model-based Design
Inputs Outputs
Controller Logic
02.06.2020
![Page 27: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/27.jpg)
Vehicle in Action
02.06.2020
![Page 28: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/28.jpg)
Summary
• Kyburz was able to produce four functional prototypes in a span of
24 months using Model Based Design
• Some of the important lessons from this presentation:
– Document and ensure adequate process is followed
– Establish workflow which enables high safety integrity levels to
be reached
– Test at unit, module, and system level
• Success depends on effort multipliers (i.e. tools) as well as
structured process
• Stay tuned for further deployments
02.06.2020
![Page 29: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/29.jpg)
Dr. Erik Wilhelm
KYBURZ Switzerland 11.04.2019
Accelerating Deployment of Autonomous Delivery
Robots using Model Based Design
![Page 30: Accelerating Deployment of Autonomous Delivery Robots ... · •Some of the important lessons from this presentation: –Document and ensure adequate process is followed –Establish](https://reader034.vdocuments.net/reader034/viewer/2022042409/5f26b451f6003d1f63082c27/html5/thumbnails/30.jpg)
Q & A - Thank you for your attention
02.06.2020