in sprints towards autonomous driving....in sprints towards autonomous driving | december 2017. page...

19
December 2017 IN SPRINTS TOWARDS AUTONOMOUS DRIVING. BMW GROUP TECHNOLOGY WORKSHOPS.

Upload: others

Post on 26-Jun-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

December 2017

IN SPRINTS TOWARDS AUTONOMOUS DRIVING.BMW GROUP TECHNOLOGY WORKSHOPS.

Page 2: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

AUTOMATED DRIVING OPENS NEW OPPORTUNITIES FOR CUSTOMERS AND COMMUNITY.

In sprints towards Autonomous Driving | December 2017. Page 2

LESS TRAFFIC

LESS ACCIDENTS

LESS EMISSIONS

MORE TIME

MORE FLEXIBILITY

MORE COMFORT

MORE SAFETY

NEW MOBILITY CONCEPTS CAR AS EXTENDED LIVING SPACE

Page 3: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

THE DEVELOPMENT OF TODAY’S ASSISTED FUNCTIONS TO TOMORROWS AUTONOMOUS DRIVING EQUALS A TECHNOLOGICAL QUANTUM LEAP.

In sprints towards Autonomous Driving | December 2017. Page 3

Driver

No assistance

Transfer of responsibilityIndividual Machine

Hands off

Semi-automated

Feet off

Assistance

Eyes off

Highly automated

Attention off

Fully automated

Passenger

Autonomous

20 1 3 4 5

(L 0) (L 2)(L 1) (L 3) (L 4) (L 5)

Transfer of responsibility

Page 4: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

Artificial Intelligence

AI

PAD

Autonomous

Driving Campus

agile

HAD/ FAD fleet

Sensors

Backend /Data storage

Autonomous

driving

User Interface

Agile development

Core cooperation

Development partners

BMW HAS CREATED A STRONG SETTING FOR THE DEVELOPMENT OF AUTONOMOUS DRIVING TO SHAPE THE FUTURE OF MOBILITY.

Page 5: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

In sprints towards Autonomous Driving | December 2017. Page 5

SENSORS: CAMERA, RADAR, LIDAR.

OBJECT FUSION.

ROAD MODEL.

DRIVING STRATEGY/PLANNING.

COOPERATION.

OEMs

AUTONOMOUS DRIVING.

CENTIMETER PRECISION.

REAL-TIME CAPABLE.

HIGHLY AVAILABLE AND RELIABLE.

HD-MAP.

OEM-COOPERATION.

ULTRA LOW LATENCY.

ULTRA HIGH RELIABILITY.

ULTRA HIGH DATA RATES.

INFRASTRUCTURE 5G.

5G AUTOMOTIVEASSOCIATION.

SENSORS: CAMERA, RADAR, LIDAR.

COMPLEXITY REDUCTION.

FLEXIBILITY.

FUTURE-PROOF INTERFACE.

SENSOR STANDARD.

INTERNATIONAL BOARDS & ASSOCIATIONS.

CROSS-INDUSTRIAL PARTNERSHIPS NEEDED FOR A SUCCESSFUL DEVELOPMENT OF THE AUTONOMOUS DRIVING.

Page 6: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

In sprints towards Autonomous Driving | December 2017. Page 6

Other cross-industrial partners

OEMs/

Tier 1 partners

Platform

Software Backend

Sensors

Core

cooperation

Non exclusive platform

FOR A FAST SUCCESS, BMW WILL DEVELOP A NON EXCLUSIVE PLATFORM FOR THE MARKET TOGETHER WITH ITS PARTNERS.

Page 7: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

THE WINNING FORMULA IS TO ADOPT A LEAN AND AGILE MIND-SET,BOTH ACROSS THE ORGANIZATION AND WITHIN COLLABORATIONS.

In sprints towards Autonomous Driving | December 2017. Page 7

Highly efficient agileproduct development.

Central base for workshops,simulation and validation.

Interdisciplinary teamworkfor common targets.

New organizationmodels.

Short distances,fast communication.

Scalable and openfor partners.

Page 8: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

Tomorrow.Today.

THE CHANGE WE ARE DRIVING FORWARD IS NOT ONLY ABOUT TECHNOLOGY, IT’S ALSO ABOUT WORKING MODELS.

In sprints towards Autonomous Driving | December 2017. Page 8

Component

responsibility

Component

responsibility

Component responsibility

Component

responsibility

Component responsibility

Component

responsibility

Component

responsibility

Component responsibility

C o m p onent

re sp o n sibil ityC o m p onent

re sp o n sibil ity

C o m p onent

re sp o n sibil ity

C o m p onent

re sp o n sibil ity

C o m p onent

re sp o n sibil ity

C o m p onent

re sp o n sibil ity

C o m p onent

re sp o n sibil ity

C o m p onent

re sp o n sibil ity

C o m p onent

re sp o n sibil ity

Focus on components and cascaded responsibility. Focus on features with end-to-end responsibility.

Page 9: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

CORE OF THE AUTONOMOUS DRIVING TECHNOLOGY IS THE END-TO-END ARCHITECTURE.

In sprints towards Autonomous Driving | December 2017. Page 9

Page 10: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

BMW TAKES THE SENSOR SETUP TO A NEW LEVEL TO RELIABLY DETECT ALL RELEVANT OBJECTS IN URBAN ENVIRONMENTS – TARGET SENSOR SETUP WILL CONTAIN 44 SENSORS.

Page 10In sprints towards Autonomous Driving | December 2017.

Tri-FocalCamera

Front-SideCamera

Short RangeRadar

Lidar

Rear-Facing Camera

LidarFull-Range Radar

Front-SideCamera

Front-SideCamera

Short RangeRadar

Front-SideCamera

Tri-FocalCamera

Short RangeRadar

Lidar

GPS Antenna

Lidar

Full-Range Radar

Not shown: 360° Surround-View Cameras, 360° Ultrasound Coverage, 1x Rear Camera, 2x Rear Lidar, 2x Full-Range Radar.

Lidar

Page 11: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING ARE INDISPENSABLE TO SUCCESSFULLY UNDERSTAND AND TRAIN THE RIGHT DRIVING BEHAVIOR.

Page 11In sprints towards Autonomous Driving | December 2017.

ARTIFICIAL INTELLIGENCE

FLEETDATA

BACKEND

275/459275/459

205/310165/345

Labeling of Training Data

On-Board

Evolution Through Training

Perception, Sensor fusion

Plan Execution, Motion Control Mission and Trajectory Planning

Simulation and Sign-off

Scene Understanding

MODELUPDATE

Off-Board

Page 12: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

Training – Backend Labeled

training-data

Sensors

Forward Pass

Not

Parked

1000 x

MACHINE LEARNING BY EXAMPLE – PARKED VEHICLE CLASSIFICATION.

Page 12In sprints towards Autonomous Driving | December 2017.

Backward Pass

Parked

Execution – On board

Forward Pass

???

Learned model

Parked

Sensors

Page 13: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

DATA DRIVEN DEVELOPMENT REQUIRES STATE OF THE ART DATA CENTERS.

In sprints towards Autonomous Driving | December 2017. Page 13

Currently ~ 85 PB storage

capacity – 10x larger network

gateways into INTEL than ever

before.

12/2017 07/2019 07/2025

> 200 PB

200 PB70 PB

Data center

End of 2017 70 PB data

capacity at BMW, target

capacity of 200 PB in 2019

compares with 770 km CDs.

INTEL Campeon

Storage capacity

Ramp-up of capacity up to

200 PB until 2019, with

flexibility of further capacity

increase.

Page 14: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

SAFETY FIRST: SEVERAL MILLION KILOMETERS WITHOUT ACCIDENTSTO BE COMPLETED – SIMULATION AND HUGE DATA STORAGE IS REQUIRED.

In sprints towards Autonomous Driving | December 2017. Page 14

Driving simulation.

Several

Million

KM

Driving Test

Simulation

Driving Simulation

Hardware Testing.

Test on Proofing Ground.

FAD: 5 TB / h 40 TB / d - 8h / 5d running

HAD: 2 TB / h 16 TB / d - 8h / 5d running

Prototype vehicle build up.

HAD FAD

25

2016 2017 2018 2019 2020 2021

13

7 15

30

50 50 50

135135

90

50

Global Development Fleet.

DATA CENTER

Page 15: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

SAFETY FIRST: SEVERAL MILLION KILOMETERS WITHOUT ACCIDENTSTO BE COMPLETED – SIMULATION AND HUGE DATA STORAGE IS REQUIRED.

In sprints towards Autonomous Driving | December 2017. Page 15

SiL – Software in the Loop.

Fast Feedback for Developer

Test safety-relevant Scenarios

Performance of new Features

WE PERFORM UP TO 2 MILLION SCENARIOS PER DAY!

HiL – Hardware in the Loop.

Evidence of Safety-Aspects

Virtual Integration in the Lab-Car

Real Hardware in simulated Environment

Page 16: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

FOR DATA COLLECTION AND TEST DRIVES A MODERN TEST FLEET OF 40 VEHICLES IN 2017 ON BASIS OF 7 SERIES WAS BUILD, WORLD WIDE TESTDRIVES STARTED.

Page 16

Mission: testing, developing and collecting data.

Prototypes as critical to success developing tools.

Data Driven Development.

In sprints towards Autonomous Driving | December 2017.

Page 17: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

MODERN VEHICLE INTEGRATION LAB FOR VEHICLE TEST FLEET AT THE AUTONOMOUS DRIVING CAMPUS.

In sprints towards Autonomous Driving | December 2017. Page 17

Perfect realization in Vehicle Integration Lab at AD Campus: Ingestion and flashing of the prototypes

Page 18: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

BMW WILL PAVE THE WAY TOWARDS AUTONOMOUS DRIVING WITH A GO LIVEOF THE HAD AND FAD FUNCTIONS STARTING WITH THE iNEXT IN 2021.

AD Campus

Munich

40 HAD/ FAD

test vehicles

Integration of

further partners

Tier 1

OEMs

Ca. 140 HAD/ FAD

test vehicles ww

HAD drives in US/ EU

FAD drives MUC downtown

HAD/ FAD

starting with iNextHAD drives in US/ EU/ Asia

FAD drives US/ EU/ Asia

2017 20212018 20202019

Page 18

HAD FAD

25

2016 2017 2018 2019 2020 2021

13

7 15

30

50 50 50

135135

90

50

In sprints towards Autonomous Driving | December 2017.

Page 19: IN SPRINTS TOWARDS AUTONOMOUS DRIVING....In sprints towards Autonomous Driving | December 2017. Page 5 SENSORS: CAMERA, RADAR, LIDAR. OBJECT FUSION. ROAD MODEL. DRIVING STRATEGY/PLANNING

December 2017

IN SPRINTS TOWARDS AUTONOMOUS DRIVING.BMW GROUP TECHNOLOGY WORKSHOPS.