presentation title (on one or two lines)cn.21ic.com/ebook_download/microsite/20160519.pdf ·...

© 2016 Toshiba Corporation 東芝電子（中国）有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.

基于图像识别的ADAS解决方案

China Automotive Marketing Dept.Tan HongMay.19th 2016

© 2016 Toshiba Corporation 2東芝電子（中国）有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.

未来驾驶的方向

2020 20252015

无人驾驶

ADAS

被动安全


车道偏离预警系统 LDW

疲劳驾驶检测系统 FDD

限速标志识别系统 SLSR

交通标志识别系统 TSRS

夜视辅助系统 Night Vision

What’s ADAS 高级驾驶辅助系统

前车避撞预警系统 FCW

行人检测报警系统 PDW

全景鸟瞰泊车辅助系统 EPA

前车启步提醒 Stop-Go

自动车灯检测系统 Auto Light


ADAS市场发展

• 2019 中国市场 ADAS 装机超过25M 台， 80%以上

• 随着ADAS市场参与者增加，方案成本的下降，装机量会明显放大

© 2016 Toshiba Corporation 5

Non NDA

ViscontiTM Family Road Map

2003 --- 2011 2012 2013 2014 2015 2016 2017 2018

Visconti-

Trio

MPE x3

Video In x3

Next

Next

High Range

Mid Range

High

Mid Range

Low

Under planning

Under planning

2004～

Visconti4-Quartetto

MP: 2017/E

ENCAP 2018

Small

PKG(11mm□)Visconti2-Duetto

Visconti2-Quartetto

From 2013

From 2013

ENCAP 2016

Visconti2

-Solo

Now

2014 US KT Law

720p1080p

VGA720p

1080p

xxxCamera resolution

Visconti4-Solo

ENCAP 2018

720p1080p

Under development


ADAS NCAP

Europe

USA

2013 Safety Regulation – for new heavy duty vehicleAdvanced Emergency Brake (AEB), Lane Departure Warning (LDW)

2014 Euro NCAPAutonomous Emergency Braking (AEB) – City, AEB – InterurbanLane Departure Warning (LDW) / Lane Keep Assist (LKA)

2016 Euro NCAP AEB – Pedestrian (Forward Pedestrian Detection)Speed Assist System (SAS) 100% (Traffic Sign Recognition)

2018 Euro NCAP AEB – Pedestrian： Night and low light condition AEB – Cyclists

2013 Regulation -- The Cameron Gulbransen, Kids and Cars Safety ActRear Visibility of Vehicles

(Originally it required a back-over detection standard that will alert drivers to the presence of a child behind the vehicle)

Visconti2 target

Visconti2 target

Visconti4 target


Visconti 芯片的特点

• 多核并发架构

– 并行处理，实时响应

– 低功耗，高效能

• 独有的图像加速+算法加速 =》减轻软件开发负担

– 图形处理加速

– 算法优化加速

• 产品成熟，已量产投放全球市场

– 业界大厂Denso（电装）已选用，并大量投产

– 后续产品，不断升级


Visconti2系统方框图

扬声器I2S

RGB888 / 565

LED(7-seg)8

DDR2DRAM

NORFlash

DDR2-533SDRAM

16-bit x 2

NORFlash

CAN

UART / SPI / I2C

前端相机

后端相机

左侧相机

右侧相机

视频输入I/F

视频输出I/F

媒体处理引擎 (MPE)

#1 #2 #3 #4

加速器

仿射变换过滤器 1 直方图

32位RISC CPU主存储器控制器片上2MB RAMWVGALCD 板

外围设备

CAN

GPIO

Serial I/F

定时器

PCM I/F

MCU I/F CAN MCU

MediaLB/MOST

CAN

GPIO

输入捕捉/输出比较/PWM

Visconti2

RGB888 / 666 / 565YCbCr422BT.656Y8 – Y128-12位 Bayer

其它ECU

PCI Express插槽

16-bit2CS

匹配过滤器 2 HOG

多内核结构实现了多个应用（最多4个）的轻松实施

行人车道 &车辆交通标志

加速器有助于实现非常高性能的图像处理，比如行人检测等

4相机检测车辆周围的障碍物

RGB888 / 565


并行处理，实时响应

Visconti2实现了多种基于视觉的ADAS（高级驾驶辅助系统），比如LDW（车道偏离报警），FCW（前方碰撞报警), PD（行人检测）和使用TSR（交通标志识别）的超速报警以辅助驾驶。

结合4MPE（媒体处理引擎）& 硬件加速器可实现多个应用的同时进行。

车道检测（白线检测）- LDW

车辆检测 - VD

交通标志识别 - TSR

行人检测 - PD

MPE0

MPE1

MPE2

MPE3

100ms

HW加速器1

HW加速器2

HW加速器3

HW加速器4

HW加速器5

HW加速器6


Image Recognition Technology History

Voice synthesis・recognition

Processor

Cell BroadbandEngine

SpursEngine

Visconti

System

1967 20012005

2008 2009

青字は世界No.1技術

Algorithm& Libraly

Audio/Video codec

Hand gesture

Pedestrian detection

Face recognition

Hand writing

recognition

Histgram, …

Rotetion, expanse・shrink …

Matching, …

Optical flow, ...

Filter

(Median, Sobel, Gaussian...)Feature amount

(CoHOG,TFD,…)

Vision Chip

2001 2003 20072005

System knowhow

SIMD、VILW、MeP、Multi core technology

ViscontiFamily

Heterogeneous multi core architecture

TOSHIBA has developed various image recognition applications last half-

century

Image recognitiontechnology

Only Toshiba has both original algorithm(CoHOG) and image recognition

hardware(Visconti) for high accuracy recognition.


Hot Chips 24 (2012/8/27-)

Recognition process time comparison (1frame)

10fps = 100 msec/frame

Visconti2 MPE

@ 266MHz

Embedded CPU

@1GHz

3983 msec

Make gradient images

Affine

Conversion

Filter

HOG

79.3 msec

Matching

Track & MergeMake scaled images

MPE

Recognize using CoHOG

10x70x63x5x

50times faster

Breakdown

Real time operation

Just 1.2W(typ.) for Pedestrian

detection within 100ms


Toshiba’s Image Recognition Processor Powers

DENSO’s Automotive Front-Camera-Based Active

Safety System6 Oct, 2015

TOKYO – Toshiba Corporation (TOKYO: 6502) today announced that DENSO Corporation (DENSO) is

deploying Toshiba’s TMPV7506XBG image recognition processor in its latest front-camera-based active

safety system. Vehicles equipped with DENSO’s camera system will reach the market in fall of 2015.

The TMPV7506XBG image recognition processor IC supports multiple camera-based Advanced Driver

Assistance Systems (ADAS) functions, including lane detection, vehicle detection, pedestrian detection

and traffic sign recognition. It concurrently executes multiple applications with low power consumption.

Toshiba is developing a family of automotive image recognition processor solutions. Products include

TMPV7528XBG, which adds an ARM® Cortex®-A9 MPCore, and the TMPV7608XBG, which offers

Toshiba’s original color-based pattern recognition technology, ideal for pedestrian recognition at night.

Toshiba is committed to innovations in safety and technology in automotive semiconductor solutions that

meet the requirements of European New Car Assessment Programme (NCAP) and other automotive

safety requirements.

电装采用Visconti2用于世界一流车厂前装车型

Visconti2 ADAS

Visconti2-Quartettoinside


FUJI XEROX MFP –Visconti2

Human movement

detection Face recognition

Two cameras have been

installed in the multifunction

device for Smart WelcomEyes

Advance Technology. We

replaced the reflection sensor,

which was previously used to

detect human movement, with

a human detection camera,

making it possible to detect

users within a wider area. We

also installed a face

recognition camera that can

identify users for easy

authentication.

http://www.fujixerox.com/eng/company/technology/production/digital/smart_welcomeyes_advance.html


Downsize image recognition camera module

Visconti2-solo + 1.3M CMOS image sensor inside

24x24x35mm

Feasibility

Study


推动中国市场ADAS的普及










成熟，开发便利，成本适中…

迅速提升ADAS的装车量

提高整车主动安全水平


其他车载应产品

最后。。。


• 品质保证 AEC-Q101 / TS16949

• 温度 175 度（一般为150度）

– 雪崩测试（175度）

• 超低噪声

车载专用MOSFET

上面図

Unit: mm

下面図

20© 2015, Toshiba Corporation.

2015年7月 Rev1.0

MOSFET 产品线１７５℃保証ｱﾊﾞﾗﾝｼｪ保証 AEC-Q101 (650V系を除く)

*計画は予告なしに変更となる可能性があります。

1Q=1月～3月，2Q=4月～6月，3Q=7月～9月，4Q=10月～12月

～13A 13B 14A 14B 15A 15B 16A 16B 17A 17B

Nch40V

Nch60V

Nch100V

Nch650V

Pch40V

次世代

P6

UMOSⅧRon･A=10mΩ･mm2

Crss/Ciss≒0.05

UMOSⅣRon･A=

13.5mΩ･mm2

UMOSⅨRon･A=(6) mΩ･mm2先頭ES=OK、CS=‘15/8

Next

UMOSⅨRon･A=(20)mΩ･mm2先頭ES=‘16/1Q、CS=’16/3Q

UMOSⅥRon･A=25mΩ･mm2

次世代


Crss/Ciss≒0.05

UMOSⅣRon･A=30mΩ･mm2

UMOSⅨRon･A=(12) mΩ･mm2先頭ES=‘15/4Q、CS=‘16/2Q

UMOSⅥRon･A=93mΩ･mm2


UMOSⅧ＋Logic Level DriveRon･A=37mΩ･mm2

Next

DTMOSⅣRon･A=17mΩ･cm2

先頭品開発中先頭開発中ﾗｲﾝｱｯﾌﾟ展開中旧ﾀｲﾌﾟ構想段階

Fin.

Fin.

Fin.

Fin.

Fin.

Fin.

Fin.

Fin.

Fin. ：ﾌﾟﾛｾｽ開発完

Fin.

Next（Soft recovery diodes)


车用光耦（EV/HEV)

2010 – 2013 连续4年全球光耦市场占有率第一by Gartnar

w/w No.1


Line-up Reference

TLP9104TLP9104A

TLP9118

TLP9148J

TLP9121A

MP from 2010 MP from 2014 (High efficiency product line)

Topr=125℃

10M Logic

Topr=125℃

1M Logic

Topr=125℃

Tr coupler

1M LogicIRMO LED

Photorelay

Topr=105℃

TLP9114B

1M Analog

VOFF=600V

MP

MP

MP

MP

TLP9121

Tr coupler

TLX9378

TLX9309

TLX9304

TLX9175J

TLX9300

TLX9000

Tj=125℃

Tj=125℃

New Tr chipwith RBE

TLX9185A

10M Logic

1M LogicHigh CMR

TLX9291A

Improve ESD of detector in

TLP9148J

Topr=125℃

TLX9376

20M LogicTotem-pole output

SO6 package

SO4 package

5M LogicTotem-pole output

Photovoltaic coupler Topr=125℃TLX9905w/o discharge circuitTLX9906w/ discharge circuit

ES:OK

ES:OK

New Tr chipwith RBE

Under development

TLX9310

Extremely low power consumption

Under development

SO6 package

SO4 package

Under development

Under development

Under development

AEC-Q100compliant

(plan)

Under development

Under development

Under development

Under development

Under development

CS:OK

CS:OK

ES:OK

CS:OK

CS:OK

MP

CS:OK

ES:Dec.2015

Topr=125℃

ES:OK

Tj=125℃

Tj=125℃

Topr=105℃

Topr=125℃

Topr=125℃

Topr=105℃


Capricorn 虚拟仪表芯片

累计销售量超过1000万片！

Capricorn


微信号：

Toshiba_Semicon

presentation title (on one or two lines)cn.21ic.com/ebook_download/microsite/20160519.pdf ·...

Documents