integrated sensing cognition systemon-demand.gputechconf.com/gtc/2017/presentation/s... ·...
TRANSCRIPT
![Page 1: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/1.jpg)
Proprietary & Confidential | 1Proprietary & Confidential | 1
&Integrated Sensing
Cognition System
![Page 2: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/2.jpg)
Proprietary & Confidential | 2Proprietary & Confidential | 2
The lastgeneration of drivers
![Page 3: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/3.jpg)
Proprietary & Confidential | 3Proprietary & Confidential | 3
Company Overview
⁺ Addressing the heart of the autonomous vehicle challenge;
Understanding the changing environment with the most advanced 3D sensing and cognition algorithms
⁺ Our offering:⁺ AI sensor fusion platform
⁺ “Point and Shoot” LiDAR
⁺ Founded in Feb 2016
⁺ Raised seed in July 2017AI
Deep learning
Computervision
3D modeling
System architecture
![Page 4: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/4.jpg)
Proprietary & Confidential | 4Proprietary & Confidential | 4
Autonomous Vehicles
Driving Control
Driving Decisions
Cognition/Fusion
Sensors
![Page 5: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/5.jpg)
Proprietary & Confidential | 5Proprietary & Confidential | 5
Driving Control
Driving Decisions
Cognition/Fusion
Sensors
Autonomous VehiclesIntegrated Sensing & Cognition System
![Page 6: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/6.jpg)
Proprietary & Confidential | 6Proprietary & Confidential | 6
⁺ Sensors: Camera, Lidar Radar
⁺ Basic fusion
⁺ High accuracy
⁺ Low latency
⁺ High reliability
⁺ Affordable
Main challenge for L3 and higher autonomous cars
Solutions need to be:
But current solutions are lacking:
![Page 7: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/7.jpg)
Proprietary & Confidential | 7Proprietary & Confidential | 7
Legacy Fusion Solutions
Driving Decisions & Control
Basic Fusion/Cognition
Camera cognition SW
LiDAR cognition SW
RADARcognition SW
Camera LiDAR RADAR
Environment Model
![Page 8: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/8.jpg)
Proprietary & Confidential | 8
![Page 9: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/9.jpg)
Proprietary & Confidential | 9Proprietary & Confidential | 9
Raw Data Fusion
Combined Algorithms for a rich environment model
Point & Shoot LiDAR and RADAR
Driving Decisions & Control
Raw Data Fusion/Cognition
CameraLiDAR
Point & ShootRADAR
Point & Shoot
Rich Environment Model
![Page 10: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/10.jpg)
Proprietary & Confidential | 10
Data Fusion
Raw
![Page 11: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/11.jpg)
Proprietary & Confidential | 11
Raw Data Fusion
⁺ Integrating sensor data on a pixel level
⁺ Overcome sensor faults
⁺ Optimize detection
⁺ Simplify decision making
Legacy Fusion Solutions
VAYAVISION Raw Data Fusion
![Page 12: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/12.jpg)
Proprietary & Confidential | 12
& Shoot LiDAR
Point
![Page 13: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/13.jpg)
Proprietary & Confidential | 13
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
& Shoot LiDAR
Point+
+
+
++ +
++ + +
+ ++
+
+
++ + + + + + + + + +
++
+
+
+++
+++++
++
+
+
+++
+++
+ +
++++++++++++
+++++
++++++
+
+
++
++
+
+
+++++++++
+
+
+
++
+
+ + + + + + + + + ++ + + + + + + + + + + ++ + + + + + + + + + + +
+ + + + + + + + + + + + + ++ + + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + +
+ + + + + + + + + + + + + ++ + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + +
+ + + + + + + + + + +
+ + + + + + + + + + ++ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + +
+ + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + ++ + + + + + + + + + + ++ + + + + + + + + + + +
+ + + + + + + + + + + + + ++ + + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + +
++++++++++++
+++++
++++++
+++++++++
+ + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + +
![Page 14: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/14.jpg)
Proprietary & Confidential | 14
Point and Shoot LiDAR Requirements
⁺ 150m Range @ 10% reflectivity
⁺ 120° x 25° Field of View
⁺ <0.1° Horizontal resolution
⁺ 0.1° Vertical resolution
⁺ <6cm accuracy
⁺ 60 Frames per second
⁺ 5000 points per frame
![Page 15: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/15.jpg)
Proprietary & Confidential | 15
for a Rich
Environment Model
Combined Algorithms
![Page 16: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/16.jpg)
Proprietary & Confidential | 16
Rich Environment Model
U1
Free space LaneCar PedestrianUnidentified Obstacle
Traffic lightSignBicycle SLAM
![Page 17: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/17.jpg)
Proprietary & Confidential | 17Proprietary & Confidential | 17
Combined algorithmic approach
⁺ SLAM
⁺ High Resolution 3DModel
⁺ Free space detection
![Page 18: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/18.jpg)
Proprietary & Confidential | 18Proprietary & Confidential | 18
![Page 19: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/19.jpg)
Proprietary & Confidential | 19Proprietary & Confidential | 19
![Page 20: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/20.jpg)
Proprietary & Confidential | 20Proprietary & Confidential | 20
![Page 21: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/21.jpg)
Proprietary & Confidential | 21Proprietary & Confidential | 21
Overwhelming amount of data
![Page 22: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/22.jpg)
Proprietary & Confidential | 22Proprietary & Confidential | 22
Stronger processor
![Page 23: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/23.jpg)
Proprietary & Confidential | 23Proprietary & Confidential | 23
What we need
⁺Strong CPUs and GPUs
⁺Development Environment
⁺Scalability
⁺Market acceptance
![Page 24: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/24.jpg)
Proprietary & Confidential | 24Proprietary & Confidential | 24
What we need
⁺Real Time System⁺ CPUs⁺ Interfaces⁺ Peripherals
⁺Algorithms⁺ Strong GPU
acceleration⁺ Development cycle
![Page 25: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/25.jpg)
Proprietary & Confidential | 25
Best platform
![Page 26: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/26.jpg)
Proprietary & Confidential | 26
Summary
Change pics
![Page 27: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/27.jpg)
Proprietary & Confidential | 27
VAYAVISION’s AI Sensor Fusion Platform
⁺ Raw data fusion:⁺ Better cognition algorithms⁺ Can operate with VAYAVISION
LiDAR and 3rd party sensors (Cameras, LiDARs and RADARs)
⁺ Point and Shoot LiDAR⁺ Better resolution and higher frame
rate⁺ Affordable
⁺ Richer environment model
Fusion/Cognition
ADAS/AD
LiDAR Point & Shoot
Camera
RADARPoint & Shoot
GPS
V2X
Map
Cellular
Vehicle Control
HMI
DRIVE PX 2
![Page 28: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep](https://reader033.vdocuments.net/reader033/viewer/2022042109/5e89d91aa41e0e19ea60ae57/html5/thumbnails/28.jpg)
Proprietary & Confidential | 28Proprietary & Confidential | 28