web3d consortium overview and ar initiatives ar standards ... · military. we maintain a...
TRANSCRIPT
Web3D Consortium Overview and AR Initiatives
AR Standards Community Meeting
March 1, 2013
Anita Havele
Executive Director, Web3D Consortium
About Web3D Consortium
Founded in 1997. We are an International, non-profit, member-funded, industry group. Our members span from business, academia, government and the
military. We maintain a royalty-free, ISO standard for web based 3D.
Our standard - X3D (Extensible 3D)
Originated from VRML and now in XML
Certified Standard
Extensible, Interoperable & Multi Platform
Open and Royally Free 3D solution for the Web
3D Authoring File Format
Run-Time Engine
• 3D file format specification: Designed for reuse of content and is archivable
• Run-time player specification: Compatible with
many 3D technologies
• Extensible: Components can be added to extend
functionality to applications and services
• Profiled: Standardized sets of extensions to meet
specific application needs.
(Interchange, Interactive, Immersive)
• Interoperable: Between applications and platforms
• Evolutionary: Easy to update and preserve
• Real-Time Animation: Graphics are high quality, interactive, and include audio and video
• Well-Specified: Makes it easier to build conformant, interoperable, consistent implementations
• Royalty Free and ISO Certified: ISO SC-24/WG 6
www.web3d.org
: the Standard for Scene Graph
• Multiple encodings
• Compressed Binary
• XML
• Classic VRML
• Multiple API’s
• ISO ECMAScript
• Java
Scene graph for real-time interactive 3D
Delivery of virtual environments over the web
Event ROUTE
Slide 7
16 January 2013
X3D Specifications
X3D an event and runtime model build for the Web
X3D Specification
.x3dv
ClassicVRML
Encoding
ISO 19776-2
.x3db
Binary
Encoding
ISO 19776-3
.x3d
XML Encoding
DTD, Schema
ISO 19776-1
Scene Access
Interface (SAI)
ECMAScript
ISO 19777-1
Scene Access
Interface (SAI)
Java
ISO 19777-2
X3D
Abstract, API
Specifications
ISO 19775-1,2
DICOM
H-Anim
.wrl, .wrz
VRML 97
Specification
ISO 14772-2
DOM
Document
Object Model
Recommendations
W3C
XML
Encryption,
Authentication
Recommendations
W3C
X3D File
Encodings
Programming
Language
Bindings © 2007, Daly Realism & Don Brutzman
And supported by these standards development organization
X3D Development
X3D Earth
H-Anim
AR
X3D WG
& Web3D
Board
ISO SC24/WG6
Medical
Special Interest Groups
E-learning
Working Groups
Dec3D CAD
Web3D Liaison Relationships
ISO
SC24
Khronos
W3C OGC
SC29 Web3D Consortium
WG 6 X3D & others
WG 9 ARC
open door to individuals
IPR RF
IPR RF RAND
patents
IPR RF RAND
Member protection
only
IPR
IPR RAND patents
IPR RF
Players 9 Active player codebases
23 known implementations
11 Open Source, 12 Commercial
Editors 5 authoring tools
conversion tools
Collada -> X3D Pipeline
Playback Devices Web Browsers
Standalone / Applications
CAVES, Walls, Domes
Cell Phones
Augmented Reality
X3D: Extensible 3D Graphics for Web Authors
x3dgraphics.com website Includes course slide sets, examples, videos
http://x3dgraphics.com/slidesets
http://x3dgraphics.com/examples/X3dForWebAuthors
Resources on X3D Players, Editors, Applications and more available at: http://www.web3d.org/x3d/content/examples/X3dResources.html
Gaming
Augmented Reality
Mirror Worlds
Data Visualization
Enterprise Medical
Cultural Heritage
E-commerce
Virtual Worlds
Education
Slide 15
16 January 2013
Industry and Government Adoption
It is open source, free, and royalty-fee (you own your content!)
Interoperable between applications and platforms
Longevity - Content stands the test of time
Web3D Member Benefits • Early access to the standard • Contribute to the Working Groups towards the development of X3D
specifications • Participate in the development of Conformance Suites • Partner in Web3D Proposals • Collaborate with other Standards Organizations • A marketing platform for your Product and Research Projects • Joint Press Releases • Co-Market with the Web3D consortium at conferences and workshops • Network with leading experts in Web3D technology
Membership Levels: Organization, Professional and Student To Join please visit: www.web3d.org/join
Web3D 2013 Activities • X3D Version 3.3
• X3DOM
• X3D AR/MR
• X3D Medical
• 3D Compression
• 3DPIE Project(OGC)
• Web3D 2013 Conference
• SIGGRAPH 2013
X3D Version 3.3
• Specifications (All ISO/IEC)
– Abstract
– Encodings (XML, Compressed Binary, ClassicVRML)
– Language Bindings
• New Features
– Volume Visualization (Medical support)
– Clarification/upgrade of GeoSpatial
– Improvement to the DIS component
– User-defined units for better control of precision
– Medical Interchange profile
X3DOM • HTML5 specification allows 3D models to be
displayed in the browser
• This allows for 3D without plugins
• X3DOM (“X-freedom”) – open source JavaScript X3D player
• Developed by Web3D member Fraunhofer
• X3DOM available with Firefox, Chrome, and Safari
• X3DOM is open source is available at www.x3dom.org
• CAD Working group providing NURBS in X3DOM
• X3DOM to be included in the X3D specification V3.4
• X3DOM submitted to W3C for Declarative 3D
Extending X3D for AR
AR Continum (ARC)
Real Environment
Augmented Reality
Virtual Reality
Virtual Environment
Mixed Reality
Existing
X3D Nodes
New X3D
Nodes for AR
Address the larger “2D + 3D” space for AR
Go beyond basic geo-location based AR
X3D AR Applications Today
Real Environment
Augmented Reality
Virtual Reality
Virtual Environment
Mixed Reality
http://www.bitmanagement.de/en/products/mobile/ios
X3D Mixed-Reality Continuum: WG Plans
Continue adoption and support of X3D models in AR applications
Continuing work with ISO SC-24 WG9 implementing the AR Reference Model
Extensible to existing frameworks Extend X3D Scenegraph to implement AR Use KML, OpenGIS, ARML, X3DOM, …
General/Flexible Device/platform independence (mobile, desktop and HMD) Sensors and devices for vision, marker, and location
X3D-AR Requirements and Proposal
• Supporting image (camera) sensors • Live video • Background and textures • Tracking camera motion • Camera calibration
Fraunhofer and Korea Chapter proposals currently in the final state of merger
Modification of one node and three new nodes are proposed • ViewPoint node • CalibratedCameraSensor • TrackingSensor • Backdrop
http://web3d.org/wiki/index.php/X3D_and_Augmented_Reality
Open for public comments until March 31, 2013
X3D AR Proposal Details CalibratedCameraSensor and TrackingSensor nodes
• Device independent on end-user side
• Delegating specific device setup to browser/user
Reusing PixelTexture node
Backdrop node for background
• Independent from viewpoint orientation
• Naming following Fraunhofer’s proposal
Minimal extension to Viewpoint node
• Subset of Fraunhofer proposal
• Camera calibration information to come from sensor nodes
http://web3d.org/wiki/index.php/X3D_and_Augmented_Reality
Open for public comments until March 31, 2013
AR Medical Application
Why 3D?
Avoiding invasive procedures
Cardiac CT Angiography
CT colonography
Surgical pre-planning
Orthognathic surgery
Hepatic surgery
Improved diagnosis
Better imaging of anatomy
Imaging Modalities
CT MRI fMRI Ultrasound PET scan DTI
Web3D Medical WG
Reproducible rendering for throughout the healthcare enterprise
• An n-D Presentation must include:
–Structured and interactive virtual environment display
(2D & 3D objects and time series)
– Platform-independent, royalty-free technology to enable vendor innovation
– Can be rendered with or without stereoscopy
– Openly-published
X3D Volume Rendering
- Necessary and Sufficient node set for industry’s Greatest Common
Denominator:
- Volume Component: render styles
- X3D version 3.3
•Two independent implementations:
–www.h3d.org
–www.instantreality.org
Clipping Planes are already specified in X3D 3.2 Rendering Component
X3D and Medical
X3D Volume Rendering
Composable Render Styles covering the state of the art
Formalizes parameters and transfer functions for 3D rendering & blending
Opacity Map Silhouette Cartoon
Assign different RenderStyles to different segments, blend two volumes
X3D and Medical Future Work • Validation, conformance and spec language • MPR implementation • Curved MPR implementation
Goal is to compress and stream 3D assets using a effective and widely
adopted coder – decoder (codec).
A Standard 3D Compression Format? Similar to MP3, H.264, JPEG
Audio Video Images 3D
MP3 H.264 PNG/JPEG X3D, MPEG4, COLLADA
Napster YouTube Facebook ?
3D standard formats available today
• X3D (Web3D Consortium)
• MPEG4 (ISO SC29)
• Collada (Khronos)
What’s available today?
Multi-SDO Collaboration
• Cooperative design and approval
• Leveraging existing technologies
• Mapping Nodes from X3D, MPEG4 and COLLADA
• Liaison Working Group relation with an MOU
• Royalty Free Solution
3D Compression Initiatives
• X3D Binary Compression
• MPEG 3D Mesh Progressive
• Streaming (3DMC),
• Bones Based Animation (BBA)
• Google Body compression –
• Delta and ZigZag encoding
• FHR image compression
Each SDO ratifies specification to be
royalty free and publicly distributes
LWG
LWG open to all
SDO Members
Liaison WG drafts
specification
LWG sends draft spec to
each SDO for ratification
Multi –SDO relationship Liaison working Group (LWG)
Web services approach?
RESTful APIs–Query and negotiate what compression and streaming
capabilities are available
For a standard 3D codec for compressing and streaming.
What 3D assets to include?
• Scenegraph,0
• geometry,
• textures,
• materials,
• animations… and ???
0
Present-day Discussions
Challenges of defining efficient codecs for compressing and streaming 3D assets
• 3D is more complex
• 3D has many facets
• 3D has diverse asset types
• 3D has varied use cases
X3D – 3D Compression Format
OGC 3DPIE and X3D
• X3D aligns with OGC 3D visualization goals
• 3D Portrayal Interoperability Experiment
3D Portrayal SWG participation
• Web3D Member Contributions • Virginia Tech – 3D Blacksburg Project
• Bitmanagement – BS Contact Browser
• Fraunhofer – Instant Reality Browser
• MBARI – Sensor data underwater visualization
• NPS – X3D Earth Project
Web3D Consortium Goals Overall Goals
• Advance X3D while retaining max backward compatibility
• Retain ability to develop standalone browsers ( e.g. XJ3D)
• Filling in missing infrastructure
New features
• Annotation component
• Enhancements to Geospatial components General Spatial processing
• Generalized spatial sensor component
• Features to better support AR/Mobile Profile
• Enhance Metadata
• Interactive medical application requirements
• Haptics
Next-generation X3D: parallel tracks
X3D version 3.4 – extend existing capabilities
• Stable addition of further component capabilities
• Projective texture mapping, metadata annotations, humanoid animation, CAD interoperability, others
Compressed binary encoding improvements • Call for Contributions release expected March 2013
• Geometric compression, pipelining, EXI binary, etc.
X3D version 4.0 – evolution • HTML5, Declarative 3D, X3DOM techniques, mobile • AR changes, event model extensions, if needed
Upcoming Events
Web3D 2013 Conference www.web3d2013.org
20-22 June 2013 in San Sebastian, Spain
SIGGRAPH 2013 http://s2013.siggraph.org/
21-25 July 2013, Anaheim Convention Center, California
Come visit us in booth 233 on the show floor
Several Birds of the Feather sessions from 22-25 July, 2013
Web3D 2013 Conference
• Co-sponsored by Web3D Consortium, ACM SIGGRAPH and Eurographics
Highlights current Capabilities and trends in interactive 3D graphics.
Call for Papers - 11 March, 2013 Workshops and Tutorials - 15 April, 2013
• Several Workshops and Tutorials Augmented Reality 3D Compression
www.web3d2013.org 20-22 June 2013 in San Sebastian, Spain
Looking forward to participation from the AR Community
Contact the Web3D Consortium
Visit us at: www.web3d.org
To Join: www.web3d.org/join
Executive Director: Anita Havele
Email: [email protected]
Web3D Consortium
Castro Street, Suite #120-490
Mountain View, CA 94041, USA
Phone: +1 248 342 7662
Fax: +1 248 457 8018