bluebox: complete autonomous vehicle platform using nxp … · 2016. 11. 1. · nxp bluebox :...

11
EXTERNAL USE BlueBox: Complete Autonomous Vehicle Platform Using NXP Silicon at Each ADAS Node

Upload: others

Post on 03-Oct-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE

BlueBox:

Complete Autonomous Vehicle Platform

Using NXP Silicon at Each ADAS Node

Page 2: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 1

Enjoying Life

One hour per

day in the vehicle

Seamlessly Connected

Mobility Experience

US mandates 163 grams / mile

and 54.5 MPG by 2025

Reducing CO2

Energy

Efficiency

Saving Lives

1.3M global road fatalities

every year

ADAS Towards

Self-Driving

Safe & Secure Mobility – 90% Innovation Through Electronics

[1] WHO (2016). Fact Sheets. Road traffic injuries

[2] EPA and NHTSA. (2012). Standards to Reduce Greenhouse Gases and Improve Fuel Economy for Cars and Light Trucks.

Page 3: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 2

EVERY YEAR…

~1.3 MILLION fatalities

>50 MILLION people seriously injured

>$3 TRILLION cost of road accidents

>90% caused by human mistakes

CRITICAL REASONS NUMBER %

Driver 2,046,000 94%

Vehicles 44,000 2%

Environment 52,000 2%

Unknown 47,000 2%

Total 2,189,000 100%

DRIVER-RELATED CRITIAL REASONS NUMBER %

Recognition Error 845,000 41%

Decision Error 684,000 33%

Performance Error 210,000 11%

Non-performance Error (e.g. Sleep) 145,000 7%

Other 162,000 8%

Total 2,046,000 100%

We need to get the

HUMAN FACTOR

out of the equation!

Road Traffic Accidents – the Causes

Page 4: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 3

LEVEL 1

Driver Assistance

LEVEL 2

Partial Automation

LEVEL 3

Conditional Automation

• Adaptive cruise control (ACC)

• Automatic braking

• Lane keeping

• Partial automated parking

• Traffic jam assistance

• Emergency brake with steer

• Semi autonomous:

−Highway chauffeur

−Self parking

ADAS

Responsibility for safe operation Control of complete vehicle Control of steering Control of vehicle speed

Driver

Vehicle or

Driver

Vehicle

Driver

Vehicle

LEVEL 4

High Automation

• Autonomous driving across

many driving modes

Driver

Vehicle

Self-Driving

Steps Towards Highly Automated Driving

Page 5: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 4

FUNCTIONAL SAFETY: Zero accidents by system failures (ISO 26262)

FUNCTIONAL SECURITY: Zero accidents by system hacks

DEVICE RELIABILITY: Zero components failures (robust design)

ROAD SAFETY: Zero accidents by human error

NXP’s Automotive Experience to Master the Robust Tetrahedron

ROAD

SAFETY

FUNCTIONAL

SAFETY

FUNCTIONAL

SECURITY

DEVICE

RELIABILITY

Page 6: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 5

BlueBox

NXP Automotive – Comprehensive Portfolio for Self-Driving

Robots

SENSE THINK ACT

Lidar

Ultrasonic

Radar

Camera

Speed

Motion

Instrument cluster

Vehicle Control

Engine

Transmission

Brake

Steering

Airbag

Suspension

Lin

e o

f S

ight

V2X

No

n-L

ine

of

Sig

ht

Vehic

le S

tate

NXP Portfolio

Page 7: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 6

V2X

RADAR

LIDAR

RADAR

LIDAR

CAM 4

CAM 1

CAM 3 CAM 2

NXP

BLUEBOX

RADAR

LIDAR

RADAR

LIDAR

RADAR

NXP Automotive – Complete Portfolio for Self-Driving Robots

Page 8: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 7

Engineered to Enable the World’s Leading Carmakers to

Design, Manufacture and Sell Self-Driving Cars By 2020

Easily industrializable platform for autonomous vehicles

Built on NXP’s smart and safe solutions shipping in volume production or

sampling now

Already in customers’ hands at four of the top five largest carmakers

Open platform, easily customizable for optimal product differentiation

SAE. (2014). AUTOMATED DRIVING LEVELS OF DRIVING AUTOMATION. SAE INTERNATIONAL STANDARD J3016.

Multiple streams of sensor data are fused and processed by the BlueBox

engine to determine vehicle’s behavior

NXP BlueBox

Page 9: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 8

NXP BlueBox : Central Processing Unit For Autonomous Driving

Highly Optimized Sensor Fusion

Security

Various sensor data streams: Radar, Vision, LiDAR, V2X

S32V automotive vision and sensor fusion processor

LS2085A embedded compute processor

CSE and ARM® Trust Zone®

High Performance per Power

Up to 90,000 DMIPS at < 40 W

Complete situational assessment

Supporting classification

Object detection and localization

Mapping

Ease of Development Open Linux-based

Programmable in linear C

Easily customizable

Development environment for

mainstream vehicles

Global Path Planning

Behavior Planning

Motion Planning

Decision Making

www.nxp.com/BlueBox

Page 10: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

EXTERNAL USE 9

NXP BlueBox - Engine Block Diagram

Autonomous Vehicle ECU

LS2085A

Coherency Fabric SMMU SMMU

Trust

Flash Controller

Power Mgt

SDXC/eMMC

2x DUART, 4xI2C

SPI, GPIO, JTAG

SMMU

64-bit

DDR2/3

Memory Controller

64-bit

DDR4

Memory

Controller

1MB

Platform

Cache

2x USB3.0 + PHY

Queue

Mgr.

Buffer

Mgr.

SEC DCE 8x10 + 8x1 Ethernet

PME

64-bit

DDR2/3

Memory Controller

64-bit

DDR4

Memory

Controller

Advanced

IO

Processor

(AIOP)

L2 Switching

Buffering

PC

I

e

PC

I

e

PC

I

e

PC

I

e

SRIOV RC

SA

TA

3.0

SA

TA

3.0

32-bit DDR4

Memory Controller

48KB

L1-I

32KB

L1-D

48KB

L1-I

2MB Banked L2

ARM A57

32KB

L1-D

48KB

L1-I

ARM A57

32KB

L1-D

48KB

L1-I

1MB Banked L2`

ARM A57

32KB

L1-D

48KB

L1-I

ARM A57

32KB

L1-D

48KB

L1-I

48KB

L1-I

32KB

L1-D

48KB

L1-I

2MB Banked L2

ARM A57

32KB

L1-D

48KB

L1-I

ARM A57

32KB

L1-D

48KB

L1-I

1MB Banked L2

ARM A57

32KB

L1-D

48KB

L1-I

ARM A57

32KB

L1-D

48KB

L1-I

48KB

L1-I

32KB

L1-D

48KB

L1-I

2MB Banked L2

ARM A53

32KB

L1-D

48KB

L1-I

ARM A53

32KB

L1-D

48KB

L1-I

256MB Banked L2

ARM A53

32KB

L1-D

32KB

L1-I

ARM A53

32KB

L1-D

32KB

L1-I

Coherency Fabric CSE2 - flashless

2x CSI2 4ln

2x 16 bit Par I/F

Power

SDHC

LinFLex

I2C

GPIO, JTAG

4MB

System RAM

CSE2

Gb E

TH

Fle

xR

AY

M4

32-bit DDR2/3

Memory Controller

32-bit DDR2/3

Memory Controller

LF

AS

T

PC

Ie

GPU

ISP Safe

DMA

Multi

Master

Sram

Ctrl

ADC

FCCU

APEX

2

APEX

2

H.264 MJPEG

S32V234

Fault Detection Memory Checks, Hardware configuration checks, Program flow checks, Error management

Sti

mu

lus

Co

ntr

ol

High Level Intelligence

Sensor and Actuator management

High Level Intelligence Monitor

Number Cruncher

Safety Controller

Low Level Intelligence

Low Level Intelligence Monitor

Page 11: BlueBox: Complete Autonomous Vehicle Platform Using NXP … · 2016. 11. 1. · NXP BlueBox : Central Processing Unit For Autonomous Driving Highly Optimized Sensor Fusion Security

NXP and the NXP logo are trademarks of NXP B.V. All other product or service names are the property of their respective owners. ARM, TrustZone and Cortex are registered trademark of ARM Limited (or its subsidiaries) in the EU and/or elsewhere. All rights reserved.) © 2016 NXP B.V.