state of the art pixel technology superior circuit design flagship … · long exposure (t1) medium...
TRANSCRIPT
• State of the art pixel technology
• Superior circuit design
• Flagship stacked sensing
• Unmatched qualitySource: TSR report 2016
This stunning 4K snap was taken by a Sony a7S II mounted to the side of the International Space Station (Copyright: Sony)
Revenue Share
49.5%
#1 Market Share
3 Copyright 2017 Sony Semiconductor Solutions Corporation
Death Tolls Up
• US Traffic Deaths rose 7.2% in 2015– Approximately 35K people died in traffic crashes
• Distracted ~3.5k
• No Seat Belts ~17.5k
• Drunk or Speeding ~12k
• Mortality Rate– US: 1 for every ~90M miles driven
– ROW: 1 for every ~70M miles driven
• Tesla: 1 fatality ~200 Million Miles driven
Source: • US Traffic deaths rose 7.2 percent in 2015: Transportation Dept. Reuters, August 29, 2016• Tesla Motors, Inc. Autopilot miles are soaring, hitting “roughly” 200 Million. Fox Business, Daniel Sparks Sept. 14 2016
Technology has and will continue to save lives!
4 Copyright 2017 Sony Semiconductor Solutions Corporation
Challenges to Exceed Human
Visionfor Automotive
Sensing
Limits of sensitivity
Limits of dynamic range
Limits of speed
Limits of distance
Limits of viewing field
Limits of temperature
5 Copyright 2017 Sony Semiconductor Solutions Corporation
Human Vision vs Emergency Breaking
ItemHuman
Visibility
Inch Size (35mm)
Pixel Size (Center2.4um)
Pixel Number
/ H-FOV/F#f17mm/F#2(123~150°)
Autobahn / Lane Marker
430mat 10Klx
Highway /Lane Marker
205mat 15lx
Suburbs /Lane Marker
145mat 4lx
City / Pedestrian
37mat 4lx
Car Speed(Dry condition)
-
Senso
rSpec
Day
Nig
ht
NCAP
Human Visibility
Reflectivity / Contrast Sensitivity / ResolutionLane Marker: 90[%] / 40[%] / 75 [mm/pixel]Pedestrian: 6[%] / 90[%] / 30 [mm/pixel]Traffic Sign: 90[%] / 90[%] / 15 [mm/pixel]
EmergencyBrakes
-
-
-
510m at180km/h
250m at130km/h
174m at110km/h
49m at60km/h
21m at60km/h
6 Copyright 2017 Sony Semiconductor Solutions Corporation
Pushing the Envelop of Human Vision
Human Visibility Human Visibility*1.2
Reflectivity / Contrast Sensitivity / ResolutionLane Marker: 90[%] / 40[%] / 75 [mm/pixel]Pedestrian: 6[%] / 90[%] / 30 [mm/pixel]Traffic Sign: 90[%] / 90[%] / 15 [mm/pixel] SONY IS = Human Visibility*1.2
7 Copyright 2017 Sony Semiconductor Solutions Corporation
51
6m
24
6m
17
4m
44
m
Au
tobah
n1
80
km
/h
Nig
ht/
Ped
estria
n
Nig
ht/
Lan
e M
ark
er
Nig
ht/
Lan
e M
ark
er
Day/
Lan
e M
ark
er
Su
bu
rbs
11
0km
/h
Hig
hw
ay
13
0km
/h
City
60
km
/h
ItemEmergency
BrakesHuman
Visibility*1.2
Inch Size - (35mm)
Pixel Size -(Center2.4um
)
Pixel Number/ H-FOV/F#
-f17mm/F#2(123~150°)
Autobahn /Lane Marker
510m at 180km/h
516mat 10klx
Highway /Lane Marker
250m at 130km/h
246mat 15lx
Suburbs /Lane Marker
174m at 110km/h
174mat 4lx
City /Pedestrian
49m at 60km/h
44mat 4lx
Car Speed(Dry condition)
21m at 60km/h
-
Senso
rSpec
Day
Nig
ht
NCAP
(NC
AP
)
Car Visibility(AEB) vs Human Visibility*1.2
Car Visibility(AEB) = Human Visibility*1.2
Dis
tan
ce
[m]
Em
erg
en
cy B
rake
[km
/h
]
8 Copyright 2017 Sony Semiconductor Solutions Corporation
Beyond Human Vision
High res automotive sensor
26m/3lux
65m
High res automotive sensor
9 Copyright 2017 Sony Semiconductor Solutions Corporation
High temperature stability
Ultra-low dark current needed for stable image quality across wide temperature range
Sensor temp. : 34.6℃ Sensor temp. : 106℃
Room temperature High temperature
Sensor Temp
Sensor Temp
Lower is better
0
1
2
3
4
5
6
20 30 40 50 60 70 80
Illu
min
ance
(lu
x)
Junction Temperature (⁰C)
SNR5Sony Pixel "G" Sony Pixel "C"
Conventional Pixel "G" Conventional Pixel "C"
10 Copyright 2017 Sony Semiconductor Solutions Corporation
Not all pixels created equal
Highest sensitivity delivered at lowest floor noise enables image capture even under starlight condition
11 Copyright 2017 Sony Semiconductor Solutions Corporation
Extreme Low Light Sensitivity
Automotive Business DivisionJune 28, 2018
Video
12 Copyright 2017 Sony Semiconductor Solutions Corporation
Achieving High Dynamic Range in ERS IS
Automotive Business DivisionJune 28, 2018
• Multi Exposure
• Recombination and linearization
Long Exposure (T1) Medium Exposure (T2) Short Exposure (T3)
Disadvantage: Motion Artifact• Requires compensation in the areas of motion• Results in lower dynamic range
𝑫𝒚𝒏𝒂𝒎𝒊𝒄 𝑹𝒂𝒏𝒈𝒆 = 𝟐𝟎 ∗ 𝒍𝒐𝒈𝟏𝟎(𝑻𝟏
𝑻𝟑∗𝑷𝒊𝒙𝒆𝒍 𝑺𝒂𝒕𝒖𝒓𝒂𝒕𝒊𝒐𝒏
𝑺𝑵𝑹𝟏)
SNR1: Illuminance at which S/N ratio = 1X
13 Copyright 2017 Sony Semiconductor Solutions Corporation
Capturing Pulsed LED light: LED Flicker
Automotive Business DivisionJune 28, 2018
Source:http://internetvideomag.com/en/open-news:390422
14 Copyright 2017 Sony Semiconductor Solutions Corporation
ERS HDR revisited: LFM Mode
Automotive Business DivisionJune 28, 2018
Long Exposure (T1) Medium Exposure (T2) Short Exposure (T3)
𝑫𝒚𝒏𝒂𝒎𝒊𝒄 𝑹𝒂𝒏𝒈𝒆 = 𝟐𝟎 ∗ 𝒍𝒐𝒈𝟏𝟎(𝑻𝟏
𝑻𝟑∗𝑷𝒊𝒙𝒆𝒍 𝑺𝒂𝒕𝒖𝒓𝒂𝒕𝒊𝒐𝒏
𝑺𝑵𝑹𝟏)
Disadvantage: HDR suffers in LFM modeLED against a bright background saturated scene
Saturated or missedMissed
Pulsed LED
≥90Hz, PWM
Super Long Exposure
15 Copyright 2017 Sony Semiconductor Solutions Corporation
LED Flicker video
Automotive Business DivisionJune 28, 2018
https://www.youtube.com/watch?v=Y6pIjUvRAjY
16 Copyright 2017 Sony Semiconductor Solutions Corporation
IMX390 Addresses LED Flicker and HDR
Automotive Business DivisionJune 28, 2018
Simultaneous LED flicker mitigation and HDR video
17 Copyright 2017 Sony Semiconductor Solutions Corporation
Addressing LED Flicker and HDR
New Conventional
IMX390 can capture LED and HDR simultaneously while delivering highest low light sensitivity at lowest noise across all temperatures
18 Copyright 2017 Sony Semiconductor Solutions Corporation
Summary• Human vision is not enough to address AEB requirements
• Sensors needs to be 20% more sensitive than human eye
• Dual 4K camera 32⁰/123⁰ needed to address front sensing requirements
• Low light SNR and thermal stability are the key for addressing the corner cases
Key Takeaways