elektronische sinne und künstliche intelligenz für … · senses for safety driver assistance...
TRANSCRIPT
Senses for Safety
Driver assistance systems help save lives
Chassis & Safety | Advanced Driver Assistance Systems
Elektronische Sinne und Künstliche Intelligenzfür das Automatisierte Fahren
Donnerstag, 11. Mai 2017, 18:00 Uhr
Graf-Zeppelin-Haus Friedrichshafen
Public
BU ADAS 11 May 2017
2Dr. Thomas Brohm © Continental AG
Your SpeakerDr. Thomas Brohm› born 1963 in Stuttgart, Germany
› graduate degree and PhD in physics
› 23 years in automotive, 18 years at Continental
› head of engineering, business unit ADAS
source: VARTA AG
Public
BU ADAS 11 May 2017
3Dr. Thomas Brohm © Continental AG
near
far
distant
individual
mobility
machinepilotself
near
source: mercedes.com
images: pixabay.com
Public
BU ADAS 11 May 2017
4Dr. Thomas Brohm © Continental AG
Benefits of Assisted and Automated DrivingSafetyEfficiencyAvailability
source: bmwblog.com
source: cbc.ca source: ourdailybreadalbany.com
Public
BU ADAS
0
5
10
15
20
25
1953 1958 1963 1968 1973 1978 1983 1988 1993 1998 2003 2008 2013 2018
11 May 2017
5Dr. Thomas Brohm © Continental AG
1973: Safety Seat Belt
1978: ABS
1995/96: ESC, BA, Euro NCAP
1982: Airbag
1985: Front Passenger Airbag
1998: ACC2001: LDW
* Federal Statistics Office, Germany (Destatis);
ABS - Anti-lock Brake System, ESC - Electronic Stability Control , BA - Brake Assist, ACC - Adaptive Cruise Control, LDW - Lane Departure Warning, AEB – Autonomous Emergency Braking
10
00
Fa
taliti
es
pe
r Y
ea
r
2006: AEB
Evolution of Vehicle Safety TechnologiesFatal Accidents in Germany 1953-2016*
Public
BU ADAS 11 May 2017
6Dr. Thomas Brohm © Continental AG
Benefits of Assisted and Automated DrivingSafety
EfficiencyAvailability
Public
BU ADAS 11 May 2017
7Dr. Thomas Brohm © Continental AG
Benefits of Assisted and Automated DrivingSafetyEfficiency
Availability
source: gosanangelo.comsource: carinsurancecomparison.com
source: bast.de
Public
BU ADAS 11 May 2017
8Dr. Thomas Brohm © Continental AG
Electronic Senses for Assisted and Automated DrivingUltrasonicRadarLidarCamera
SHORT RANGE RADAR
SURROUND VIEW
& ULTRASONICHIGH – RESOLUTION
FLASH LIDAR
CAMERA (opt. LIDAR) ASS./AUT. DRIVING
CONTROL UNIT
LONG RANGE RADAR
STEREO CAMERA
eHorizon
cloud
services
Public
BU ADAS 11 May 2017
9Dr. Thomas Brohm © Continental AG
Electronic Senses for Assisted and Automated DrivingUltrasonic
RadarLidarCamera
Capturing the
Enviromment
Public
BU ADAS 11 May 2017
10Dr. Thomas Brohm © Continental AG
0
0,5
1
1,5
2
WeatherRobustness
Dark & GlarePerformance
Image Range& Resolution
Rel. VelocityMeasurement
ObjectClassification
3D ShapeDetection
Electronic Senses for Assisted and Automated DrivingUltrasonic
RadarLidarCamera
Public
BU ADAS 11 May 2017
11Dr. Thomas Brohm © Continental AG
environment sensing
field of view (h x v)
wavelength
resolution
luminosity range *
blind periods
3D perception
sense-plan-act time **
raw data rate
data processing
* instantaneous ** unexpected obstacle
human driver
160° x 130°
400 – 700 nm
0.02°
100 k : 1
5%
mental reconstruction
2 s
[ 10 Mbit/s ]
[ >10 Pflops ]
[ ] digital equivalent
self-driving car
360° x 120°
400 – 1000 nm
0.03°
10 bn : 1
0%
direct measurement *
0.5 s
10 Gbit/s
10 Tflops
* with radar & lidar
Electronic Senses for Assisted and Automated DrivingMachines Outperform Humans in Environment Sensing
Public
BU ADAS 11 May 2017
12Dr. Thomas Brohm © Continental AG
Electronic Senses for Assisted and Automated DrivingHumans Have Excellent Object Detection Capabilities
Queen Elizabeth II
Human Vision
Pattern Recognition
System trained by
Human Learning
lookalikes
false positive
true negative
source: 21entertainment.co.uk
source: royal-lookalikes.co.uk
real ones
true positive
false negative
source: gala.de
source: mirror.co.uk
Public
BU ADAS 11 May 2017
13Dr. Thomas Brohm © Continental AG
Electronic Senses for Assisted and Automated DrivingMachines Have Limited Object Detection Capabilities
Queen Elizabeth II
lookalikes
false positive
true negative
real ones
true positive
false negative
Computer Vision
Pattern Recognition
System trained by
Machine Learning
Public
BU ADAS 11 May 2017
14Dr. Thomas Brohm © Continental AG
From Environment Sensing to Scene UnderstandingMachines Learn to Improve
Object Detection
by Feature Classification
3D Reconstruction
by Structure-from-Motion
+Computer Vision
classical methods
Scene Understanding
=Road
Road Boundary Car
Pedestrian
Semantic Segmentation
by Deep Neural Network
+
enhanced by
Deep Neural Networks
Public
BU ADAS 11 May 2017
15Dr. Thomas Brohm © Continental AG
the vehicle environment and state
The Chain of Effects Asssisted and Automated Driving are based on
and decide the
actions along the path
with actuatorsand control systems
Public
BU ADAS 11 May 2017
16Dr. Thomas Brohm © Continental AG
From Assisted to Automated DrivingDriving Functions for Many Scenarios
Safety Functions
Maneuvering Functions
Cruising Functions
Public
BU ADAS 11 May 2017
17Dr. Thomas Brohm © Continental AG
From Assisted to Automated DrivingDriving Functions for Many Scenarios
control
authority
human
(low)
machine
(high)
driver
(automation)
driving
scenarios
regular
long
huge
hazard
short
low
type
duration
complexity
SAE J3016
UN-ECE, FMVSS
Public
BU ADAS 11 May 2017
18Dr. Thomas Brohm © Continental AG
From Assisted to Automated Driving
Level 0
Level 1
Level 2
Level 3
Level 4
Level 5
Driver Only
Assisted
PartialAutomation
ConditionalAutomation
HighAutomation
FullAutomation
Chauffeur
Assistant
Robot
Driver Only
Assistant
Chauffeur
‘Vehicle supports the driver.
Driver must monitor the system at all times.’
‘Vehicle performs driving functions
partially or fully.’
Source: SAE J3016
Public
BU ADAS 11 May 2017
19Dr. Thomas Brohm © Continental AG
From Assisted to Automated Driving Enabling Developments
Testing andValidation
Public
BU ADAS 11 May 2017
20Dr. Thomas Brohm © Continental AG
From Assisted to Automated DrivingEnabling Developments
Sensors and Actuators
p
t
Public
BU ADAS 11 May 2017
21Dr. Thomas Brohm © Continental AG
From Assisted to Automated DrivingEnabling Developments
Car2X andeHorizon
Public
BU ADAS 11 May 2017
22Dr. Thomas Brohm © Continental AG
From Assisted to Automated Driving Enabling Developments
Human MachineInterface
source: mercedes-benz.com
Public
BU ADAS 11 May 2017
23Dr. Thomas Brohm © Continental AG
From Assisted to Automated DrivingEnabling Developments
Cognitive Systems
source: salon.com
Public
BU ADAS 11 May 2017
24Dr. Thomas Brohm © Continental AG
Mercedes: ‚intelligent drive‘
Nissan: ‚intelligent driving‘
Ford: ‚smarter safer driving‘
Toyota: ‚safety sense‘
Hyundai: ‚ intelligent safety‘
Audi: ‚piloted drive‘
Volvo: ‚drive me‘
Honda: ‚ automated drive‘
BMW: ‚connected drive‘
Uber: ‚autonomous taxi‘
Tesla: ‚autopilot‘
Google: ‚self-driving car‘
source: mercedes-benz.com
source: media.blog.alliance-rnault-nissan.com
source: autoguide.com
source: toyotoaoforlando.com
source: drive.com.au
source: audi-mediacenter.com
source: carsuk.net
source: caradvice.com.au
source: bimmertoday.de
source: wired.com
source: wccftech.com
source: engadget.com
Public
BU ADAS 11 May 2017
25Dr. Thomas Brohm © Continental AG
Lindau Ulm
RiemerlingMemmingen
Frankfurt
Ingolstadt
Continental Business Unit ADAS in Germany
Continental
Geschäftsbereich
Fahrerassistenzsysteme
Peter-Dornier-Str. 10
88131 Lindau, Germany
Telefon +49 8382 9699 200
www.continental-automotive.de