© 2006 autodesk1 image-processing technologies for digital content creation [email protected]
TRANSCRIPT
© 2006 Autodesk 2
CORPORATE INFORMATION
REALVIZ: Founded March 98
Exclusive technology from INRIA Sophia-Antipolis Technology from the Robotvis group
Headquarters and R&D in Sophia Antipolis, Southern France
90% of revenue outside France, 50% in the USA
Just acquired by Autodesk (PSEB division)
© 2006 Autodesk 3
MISSION
Image-based technologies empower designers and graphic
artists to efficiently create the most effective visual content
based on digital photographs and videos.
Post-production
Architecture
Digital Imaging
Multimedia
CAD
Video GamesDinotopia - Courtesy of Framestore CFC
Monkey – Courtesy of Quiet Man
© 2006 Autodesk 4
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
© 2006 Autodesk 5
PANORAMIC PHOTOGRAPHY
Panoramic Photography
© 2006 Autodesk 6
Creation of panoramic images up to full spheres (360° horizontal by 180° vertical) – fully automatic
Thousands users : professional photographers, digital imaging hobbyists, multimedia & web designers, architects, post-production artists
IMAGE STITCHING
© 2006 Autodesk 7
Click inside to see the full screen, full spherical QuickTime VR PanoramaCourtesy of VR Way
FULL SPHERICAL PANORAMAS
© 2006 Autodesk 8
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
© 2006 Autodesk 9
IMAGE BASED MODELINGBridging the gap between 2D and 3D
Image Based Modeling
© 2006 Autodesk 10
IMAGE BASED MODELING
Creation of 3D photo-textured objects from photographs
(1 to many)
Applications Virtual reality: 3D Simulation/Storytelling Urban planning & perspective matching for 3D CAD models Photogrammetry Video games 3D animation & special effects
© 2006 Autodesk 11
IMAGE BASED MODELING
From stills…… calibrated in 3D from the manual placement
of matching points …
… for photo-realistic 3D models !
© 2006 Autodesk 12
IMAGE BASED MODELING
From a panorarma or a still picture…
… to a photo-realistic
3D environment !
… more demos
© 2006 Autodesk 13
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
USE CASES
© 2006 Autodesk 14
SPECIAL EFFECTS
SFX Solutions
© 2006 Autodesk 15
CAMERA TRACKING
Click inside to see the movie. Courtesy of Platige Image 2005
Click inside to see the movie. Courtesy of Platige Image 2005
Camera path
& 3D points extracted
with MatchMover
3D contentRendered in
3D animation software
Click inside to see the movie. Click inside to see the movie.
Before… … After
© 2006 Autodesk 16
CAPTURING 3D RIGID MOTION- Feature points are extracted and tracked across sequences
- Based on parallax and rigidity (epipolar geometry), the algorithm extracts:
- Camera path and parameters (zoom, distortion) over time
- 3D point coordinates
- Ready for 2D/3D video-montage… all in one click!
© 2006 Autodesk 17
SOME MOVIES
© 2006 Autodesk 18
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
© 2006 Autodesk 19
MOTION CAPTURE
Motion Capture
© 2006 Autodesk 20
VIDEO-BASED MOCAP
Capture non-rigid 3D motion from several videos
© 2006 Autodesk 21
VIDEO-BASED MOCAP
Video-based motion capture solution
Applications: animation, bio-medical, ergonomy…etc
Covering facial, full body, and on-set mocap
Total flexibility From 2 cameras to as many as needed Cameras can fixed or moving. Cameras can be of different frame rate and different definitions. No need for a motion capture studio
Computed data Tracked 3D points Camera data
© 2006 Autodesk 22
VIDEO-BASED MOCAP
© 2006 Autodesk 23
MATCHMOVINGOne moving camera observing a rigid scene : Parallax (i.e relative 2D image motion) allows recovering 3D camera motion and scene structure
1N
..t..
FROM RIGID MOTION…
© 2006 Autodesk 24
… TO NON-RIGID MOTION- Several synchronous cameras are used
- Same geometric problem as matchmoving at each time
Cam1Cam2
Cam3
Time 1
Cam1Cam2
Cam3
Time N
- Bonus: We can handle camera motion as well!
© 2006 Autodesk 25
VIDEO-BASED MOCAP
…Result
© 2006 Autodesk 26
ON-SET MOCAP-All sequences shot with
-- 2 fixed cameras: HD digital (1920x1080)
- 1 mobile camera (the main shooting cam): film, scanned at 2048x1536
…Result
© 2006 Autodesk 27
Q&A