argon360 – real time video stitching implemented in hardware
TRANSCRIPT
1
Argon360 – real-time video stitching
Clifford Dive – VP Business DevelopmentGraham Rushton – Principal Engineer
7 June 2016
2
3
Introduction
What is Argon Design?• Electronics and software development consultancy
• Primary activity is outsourced product development services
• We also develop products and intellectual property (IP) that complement the consultancy business
4
Introduction
What is Argon Design?• Electronics and software development consultancy
• Primary activity is outsourced product development services
• We also develop products and intellectual property (IP) that complement the consultancy business
So what are we doing here?
5
Argon R&D – video processing projects
SLAM (Simultaneous Location and Mapping)
6
Argon R&D – video processing projects
Build a 3D model of a scene – track
position and orientation fusing sensor
data and image
SLAM (Simultaneous Location and Mapping)
7
Argon R&D – SLAM
8
Argon R&D – video processing
Stereo depth perception
SLAM (Simultaneous Location and Mapping)
9
Argon R&D – video processing
Build a 3D model of a scene
with input from two
cameras
Stereo depth perception
SLAM (Simultaneous Location and Mapping)
10
Argon R&D – stereo depth perception
11
SLAM (Simultaneous Location and Mapping)
Argon R&D – video processing
Stereo depth perception
12
SLAM (Simultaneous Location and Mapping)
Argon R&D – video processing
Stereo depth perception
Real-time video stitching –
parallax correction (soon!)
13
14
Argon360 – real-time video stitching
15
Argon360 – real-time video stitching
Launched at
NAB 2016
16
Technical challenges in acquisition• Workflow
– Offline stitching– Multiple files– Camera synch– Operational complexity (multiple
cameras…)• Stitching
– Parallax – Blending
• Packaging– Size– Power consumption
• Real-time– Streaming– Preview
17
Technical challenges in acquisition• Workflow
– Offline stitching– Multiple files– Camera synch– Operational complexity (multiple
cameras…)• Stitching
– Parallax – Blending
• Packaging– Size– Power consumption
• Real-time– Streaming– Preview
18
Argon360 – what is it?
• High quality video stitching
• Real-time
• Compact
• Low power consumption
• Scalable
• IP core for chip or FPGA
…and coming soon
• Depth dependent parallax correction
Patent pending technology bringing the speed and efficiency of hardware to real-time video stitching
19
…and what it isn’t
It’s not a ready-baked product:
• “Can I try/buy/borrow/steal your stitching box?” – Sorry – no! We have a single working engineering
prototype– Some real-life trials– Prototype platform – not for production
environment
20
21
What kind of product?
Consumer products – Ricoh Theta
Professional products – Nokia OZO
22
Argon360 block diagram
23
Argon360 pipeline
Transform •Correct lens distortions•Project camera geometry
Blend •Fix global illumination•Multiband blend
Reprojection •Project internal representation
24
Transform
25
Transform
26
Blend
27
Blend
28
Blend
29
Reproject
30
Reproject
31
Sample footage
https://youtu.be/pW6W-gdeFic ….view on Chrome browser or YouTube app
32
What’s next?• Evaluate reaction to the Argon360 launch
• Develop road-map features– Parallax correction
• Start working with development partners– Licensing to silicon companies for ASICs– Licensing for FPGA-based products– Design services engagements for bespoke development
Get in touch:[email protected]@argondesign.com
More info:www.argondesign.com/products/argon360Download product flyer