3dtv
.at
Stereoscopic Player andStereoscopic Multiplexer
S3D-Today
27. - 28. November 2006
Munich, Germany
Peter Wimmer - 3dtv.at 2
Overview
Part 1 – Stereoscopic Player
3D playback on PCs Encoding 3D movies Stereoscopic Player features
Part 2 – Stereoscopic Multiplexer
Stereoscopic Multiplexer concepts Fields of application
Peter Wimmer - 3dtv.at 3
About 3dtv.at
Focus
Stereoscopic video playback Stereoscopic video recording
Products
Stereoscopic Player
Stereoscopic Multiplexer
Location
Linz, Austria www.3dtv.at
Timeline
Development started 2001
Completed diploma thesis in June 2004
Company founded in 2005
Peter Wimmer - 3dtv.at 4
3D Video Playback
The questions
Why do we need 3D playback software? Why not use any 2D video player?
The challenges
There are many 3D viewing methods Different resolutions are required to
accommodate to hardware performance
The solution
Real-time format conversion 3D playback software
?!
Peter Wimmer - 3dtv.at 5
Real-time Format Conversion
Real-time format conversion …
… avoids vast number of files … requires full color left and right views … gives best quality
Suitable source formats
Over/UnderSide-by-Side
Interlaced(Field Sequential)
L RLRLR
Dual Files
Peter Wimmer - 3dtv.at 6
Dual Files, Dual Streams
Dual files
Efficient use of multi processor systems Circumvent codec limitations Playback synchronization is prone to errors Performance problems when located on same media
Dual streams
Avoid performance problem of separate files 2D video players show the left video stream only Only available for Windows Media format
Peter Wimmer - 3dtv.at 7
Format Selection
Stereoscopic Player asks for the format when opening a new video
Stereoscopic Player remembers settings for each file in the built-in video library
Peter Wimmer - 3dtv.at 8
Stereoscopic Metadata
Fundamental idea
It is hard for users to find out the proper layout The content creator knows the proper layout Ship video files + format description (= metadata)
Stereoscopic Player …
… reads embedded metadata in Windows Media files … reads metadata file in same folder as the video file … contacts metadata server
The official metadata server is maintained by 3dtv.at and provides settings for most commercial 3D-DVDs and some popular video files.
Peter Wimmer - 3dtv.at 9
Creating Stereoscopic Metadata
Use the Windows Media Stereo Attribute Editor to embed metadata in Windows Media files (available for download on the 3dtv.at website)
Click File > Export in Stereoscopic Player to create a separate metadata file (for all other formats than Windows Media)
Improve user experience – deliver your movies with metadata!
Peter Wimmer - 3dtv.at 10
Creating a 3D-DVD
Side-by-side or over/under file
2x PAL/NTSC resolution or better Embedded metadata or stereoscopic metafile
Field-sequential version for legacy 3D system
50/60 Hz TVs + shutter glasses Hardware demultiplexer + two projectors
Anaglyph version
No stereo hardware required Limited color reproduction 4:2:0 color subsampling reduces quality
VideoSection
ROMSection
Peter Wimmer - 3dtv.at 11
Stereoscopic Player Viewing Methods
Anaglyphs
Shutter glasses
Polarized projection
Native supportAny graphics card, any display
Software pageflipping (ATI and Intel)NVIDIA stereo driver / OpenGL
Native dual screen output supportNVIDIA stereo driver / OpenGL
And many more…
Peter Wimmer - 3dtv.at 12
Stereoscopic Player Viewing Methods
Autostereoscopic displays (dual view)
Native support for horizontally interlaced output Native support for Sharp 3D displays
Autostereoscopic displays (multi view)
More than two views are required Image acquisition difficult Interpolation of images is CPU-intensive and not perfect Not supported in Stereoscopic Player yet
Peter Wimmer - 3dtv.at 13
NVIDIA Stereo Driver Configuration
Stereo driver
Install NVIDIA consumerstereo driver
Version number ofgraphics and stereodriver must match
Configure and activatethe stereo driver
Stereoscopic Player
Select ‘NVIDIA Stereo Driver’ viewing method
Peter Wimmer - 3dtv.at 16
Dual Screen Output via Stereo Driver
Graphics driver set to clone mode Normal 2D operation possible
Peter Wimmer - 3dtv.at 17
Stereoscopic Player Features
General features
File playback 3D-DVD playback Capture device support Intuitive user interface IR remote control support
Integration features
Command line control OLE Automation Customization tool available
Windows Media features
Web stream playback Digital Rights Management Multi-channel audio Multiple audio languages
Peter Wimmer - 3dtv.at 18
Stereoscopic Multiplexer Concept
Right stream Left stream
R L
Combined video stream
R L
Peter Wimmer - 3dtv.at 19
Fields of Applications
Live preview during recording
Stereoscopic Multiplexer loaded in Stereoscopic Player
Live broadcasts
Stereoscopic Multiplexer selected as capture device in Windows Media Encoder, running on the server
Stereoscopic Player running on the client
Watching 3D recording
Transferring left and right tape to hard disk not required Stereoscopic Multiplexer synchronizes tape drives
Peter Wimmer - 3dtv.at 20
Supported Hardware
Camcorders
DV camcorders HDV camcorders (next version)
Digital cameras
Industrial Firewire cameras Industrial USB cameras Webcams
Others
Analog cameras via frame grabbers Many other WDM-compatible capture devices