© 2006 autodesk1 image-processing technologies for digital content creation luc.robert@autodesk.com

© 2006 Autodesk 1

Image-processingTechnologies for Digital Content Creation

Luc.robert@autodesk.com

© 2006 Autodesk 2

CORPORATE INFORMATION

REALVIZ: Founded March 98

Exclusive technology from INRIA Sophia-Antipolis Technology from the Robotvis group

Headquarters and R&D in Sophia Antipolis, Southern France

90% of revenue outside France, 50% in the USA

Just acquired by Autodesk (PSEB division)

© 2006 Autodesk 3

MISSION

Image-based technologies empower designers and graphic

artists to efficiently create the most effective visual content

based on digital photographs and videos.

Post-production

Architecture

Digital Imaging

Multimedia

CAD

Video GamesDinotopia - Courtesy of Framestore CFC

Monkey – Courtesy of Quiet Man

© 2006 Autodesk 4

USE CASES

Panoramic Photography

Image Based Modeling

SFX Solutions

Motion Capture

© 2006 Autodesk 5

PANORAMIC PHOTOGRAPHY

Panoramic Photography

© 2006 Autodesk 6

Creation of panoramic images up to full spheres (360° horizontal by 180° vertical) – fully automatic

Thousands users : professional photographers, digital imaging hobbyists, multimedia & web designers, architects, post-production artists

IMAGE STITCHING

© 2006 Autodesk 7

Click inside to see the full screen, full spherical QuickTime VR PanoramaCourtesy of VR Way

FULL SPHERICAL PANORAMAS

© 2006 Autodesk 8

USE CASES

Panoramic Photography

Image Based Modeling

SFX Solutions

Motion Capture

© 2006 Autodesk 9

IMAGE BASED MODELINGBridging the gap between 2D and 3D

Image Based Modeling

© 2006 Autodesk 10

IMAGE BASED MODELING

Creation of 3D photo-textured objects from photographs

(1 to many)

Applications Virtual reality: 3D Simulation/Storytelling Urban planning & perspective matching for 3D CAD models Photogrammetry Video games 3D animation & special effects

© 2006 Autodesk 11

IMAGE BASED MODELING

From stills…… calibrated in 3D from the manual placement

of matching points …

… for photo-realistic 3D models !

© 2006 Autodesk 12

IMAGE BASED MODELING

From a panorarma or a still picture…

… to a photo-realistic

3D environment !

… more demos

© 2006 Autodesk 13

Panoramic Photography

Image Based Modeling

SFX Solutions

Motion Capture

USE CASES

© 2006 Autodesk 14

SPECIAL EFFECTS

SFX Solutions

© 2006 Autodesk 15

CAMERA TRACKING

Click inside to see the movie. Courtesy of Platige Image 2005

Click inside to see the movie. Courtesy of Platige Image 2005

Camera path

& 3D points extracted

with MatchMover

3D contentRendered in

3D animation software

Click inside to see the movie. Click inside to see the movie.

Before… … After

© 2006 Autodesk 16

CAPTURING 3D RIGID MOTION- Feature points are extracted and tracked across sequences

- Based on parallax and rigidity (epipolar geometry), the algorithm extracts:

- Camera path and parameters (zoom, distortion) over time

- 3D point coordinates

- Ready for 2D/3D video-montage… all in one click!

© 2006 Autodesk 17

SOME MOVIES

© 2006 Autodesk 18

USE CASES

Panoramic Photography

Image Based Modeling

SFX Solutions

Motion Capture

© 2006 Autodesk 19

MOTION CAPTURE

Motion Capture

© 2006 Autodesk 20

VIDEO-BASED MOCAP

Capture non-rigid 3D motion from several videos

© 2006 Autodesk 21

VIDEO-BASED MOCAP

Video-based motion capture solution

Applications: animation, bio-medical, ergonomy…etc

Covering facial, full body, and on-set mocap

Total flexibility From 2 cameras to as many as needed Cameras can fixed or moving. Cameras can be of different frame rate and different definitions. No need for a motion capture studio

Computed data Tracked 3D points Camera data

© 2006 Autodesk 22

VIDEO-BASED MOCAP

© 2006 Autodesk 23

MATCHMOVINGOne moving camera observing a rigid scene : Parallax (i.e relative 2D image motion) allows recovering 3D camera motion and scene structure

1N

..t..

FROM RIGID MOTION…

© 2006 Autodesk 24

… TO NON-RIGID MOTION- Several synchronous cameras are used

- Same geometric problem as matchmoving at each time

Cam1Cam2

Cam3

Time 1

Cam1Cam2

Cam3

Time N

- Bonus: We can handle camera motion as well!

© 2006 Autodesk 25

VIDEO-BASED MOCAP

…Result

© 2006 Autodesk 26

ON-SET MOCAP-All sequences shot with

-- 2 fixed cameras: HD digital (1920x1080)

- 1 mobile camera (the main shooting cam): film, scanned at 2048x1536

…Result

© 2006 Autodesk 27

Q&A