web3d symposium 2005 x3d user interfaces: toward amd 2 nicholas f. polys alan hudson marcelo...
TRANSCRIPT
![Page 1: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/1.jpg)
Web3D Symposium 2005
X3D User Interfaces:Toward AMD 2
Nicholas F. Polys
Alan Hudson
Marcelo Knőrich Zuffo
Doug A. Bowman
![Page 2: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/2.jpg)
Web3D Symposium 2005
Session Outline
• Polys
• Hudson
• Zuffo– break
• Activities: expressing interaction
• Activity Review
• Summarize and Next Steps
![Page 3: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/3.jpg)
Web3D Symposium 2005
Goals
Provide support for rich user interface functionality express-able without platform dependencies
Support 3D User Interface techniques for Navigation, Selection, Manipulation
![Page 4: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/4.jpg)
Web3D Symposium 2005
Describing Interaction
Different languages:
• Users
• Interface Designers
• Software Developers
• Machines
![Page 5: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/5.jpg)
Web3D Symposium 2005
Standardization Quandry
• What is appropriate and in the language philosophy? – 3DUI requires both application-oriented
and content-oriented perspectives
• COMPONENTs provides a mechanism for extension
GFX devices
3DI
![Page 6: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/6.jpg)
Web3D Symposium 2005
X3D UI Goals
• Writability
• Expressiveness
• Readability
• Orthogonality (concise, complete)
• Portability (cross-platform reuse)
![Page 7: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/7.jpg)
Web3D Symposium 2005
X3D 3D User Interfaces
•Displays: – Handling ImagePlane
(size, coordinates, layers)– Stereoscopy
•Inputs: – Device binding– Coordinates & Access– Custom techniques– Picking
![Page 8: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/8.jpg)
Web3D Symposium 2005
Challenge: Displays
• X3D Scenegraph may be rendered on a wide range of sizes, resolutions, and configurations:– PDA– HMD– Desktop– Wall– C/R AVE
• How can the standard be improved to support robust UIs across these displays?
![Page 9: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/9.jpg)
Web3D Symposium 2005
UI elements: Imageplane
Canvas(es) size, units, locations :
• Absolute– Pixels
• Relative– Backsolve by FOV (specify near clip)– Normalized space
• Both?
![Page 10: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/10.jpg)
Web3D Symposium 2005
Compositing
• Layers– AMD 2 proposal– Bitmanagement: from MPEG-4 version1
(2D / 3D versions)
![Page 11: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/11.jpg)
Web3D Symposium 2005
Challenge: Input
• X3D scenegraphs may generate and consume events from a variety of devices and/or networks.– Joystick– Gamepad– Trackers– Wands …
• How can the standard be improved to support robust UIs across these devices?
![Page 12: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/12.jpg)
Web3D Symposium 2005
Input devices
Local and networked:
• MIDI
• DOFs: mouse, joystick, wand, buttons…
• Trackers:– Head , Body– Objects
![Page 13: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/13.jpg)
Web3D Symposium 2005
Navigation
• Enumerated Metaphors: Walk, Fly, Examine, LookAt
• Desktop devices typically drive the Viewpoint according to the DOFs of the active mode
• With Head Tracking and more DOFs, what happens?
• How can we enable ‘roll-your-own’ techniques?
![Page 14: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/14.jpg)
Web3D Symposium 2005
Selection / Picking
• Raycast semantic in VRML/X3D
• Picking volumes … pre-ordaining objects as ‘pickable’ ?
• Various buttons
![Page 15: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/15.jpg)
Web3D Symposium 2005
Scenegraphs and Input Devices
• Approaches – Tightly Coupled: data is read, mapped, and bound
directly to specific locations in the application / scenegraph; eg SVE, … VRML …
– Loosely Coupled: normalized tracker data lives somewhere on the network and you impose its scenegraph meaning eg DTK, … VRPN?
![Page 16: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/16.jpg)
Web3D Symposium 2005
Input Problem Space- event handling
Input streams:
• Mouse (2 dof)
• Keyboard (many)
• Joystick (2 dof)
• Button1(1 dof)
• Button2 (1 dof)
• Head (6 dof)
• Wand (6 dof)
Coordinate:
• Units
• Local
• World
Scenegraph:
• Traveling
• Maneuvering
• Selection
• Manipulation
![Page 17: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/17.jpg)
Web3D Symposium 2005
Providing scenegraph hooks…structure
• Navigation / travel effects user’s parent (locally tracked workspace) ?
• Local tracked movement: head, r_hand
• Using button events
• Generalize for desktop UI too?
![Page 18: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/18.jpg)
Web3D Symposium 2005
Where does the interface logic live?
Currently, inside X3D / VRML Browser:
• NavigationInfo type and speed determines the mapping of 2D mouse drag events to Viewpoint’s 6 DOF
• Ray cast picking computed from 2D mouse cursor and Imageplane
![Page 19: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/19.jpg)
Web3D Symposium 2005
Our approaches
• Consider the desktop implicit• Push capabilities of current standard
nodeset and SAI • Use lessons for AMD component design• We want flexibility to define new
interaction techniques – not just enumerating more modes
![Page 20: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/20.jpg)
Web3D Symposium 2005
Diverse ToolKit (DTK)
• Open-source
• Loosely coupled; DTK provides a layer
• Physical environments are set up (tracker range) and normalized to a unit coordinate cube;
• Navigations are system-level services packaged as DSOs
![Page 21: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/21.jpg)
Web3D Symposium 2005
System Level Service DSOs(e.g. IS900)
User DSOs:
VE Navigations
Shared Memory
DTK [C, C++]
Application: C++,
Java, Perl, Python via SWIG
X3D Scenegraph
System DSOs are like device drivers giving data streams their names in shared memory…
eg head, wand, tracker2, wand_joystick, button1 ,…
![Page 22: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/22.jpg)
Web3D Symposium 2005
Diverse GL (DGL)
• Encapsulating scenegraphs – Coin– VTK– OpenSceneGraph– OpenVRML
• Also Diverse for Performer (DPF) is a major platform at VT, NIST
![Page 23: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/23.jpg)
Web3D Symposium 2005
DGL architecture
• Point to the scenegraph & tell it to render itself
• Grabs OpenGL code from scenegraph
• DGL creates windows
• DGL applies transformations from DTK navs
• Call draw callback
![Page 24: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/24.jpg)
Web3D Symposium 2005
DGL Coin example
• Loading VRML of PathSim, CML
• Need to connect to scenegraph to drive picking
![Page 25: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/25.jpg)
Web3D Symposium 2005
Approach 2: DTK / Xj3D
• Input streams live somewhere out there, interpret them for X3D environment
• Use SAI to drive them into the scenegraph
• Understand the requirements for scenegraph nodes
![Page 26: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/26.jpg)
Web3D Symposium 2005
DTK
DTK / Xj3D ArchitectureInternet
SharedMemory_A
SharedMemory_B
SharedMemory_C
SharedMemory_D
Diverse Toolkit
SAI Application
e g Xj3D
A B C D
X3D Scenegraph
SAI application adapts DTK data to X3D data
Arbitrary named streams:
head, wand, joystick
• x y z normalized (-1 <-> 1)
• Head, pitch, roll
Interaction technique(s)
A B C D
![Page 27: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/27.jpg)
Web3D Symposium 2005
DTK / Xj3D scene:
• For loading scenes in CAVE / HMD• Turn off NavigationInfo {}• ImmersiveViewpont {}
• UserLocalSpace– headTracker
• DEF headP SFVec3fSensor {} …– via Behr et al, 2004
• DEF Script FlybyPointing {}• Picking utilities needed (no ‘cursor’)
![Page 28: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/28.jpg)
Web3D Symposium 2005
In-scene scripts as filters
inputOutput fields on Script {} node benefit authoring ease
Interaction Techniques:•DEF FlyingByGaze Script {}•DEF FlyingByPointing Script {}•DEF SelectionByRaycasting Script {}
•ImmersiveViewpoint {} – special transformation hierarchy including a Viewpoint and NavigationInfo
•X3DPickingNode {}
Driven from SAI / DTK data:
•SFVec3fSensor {}
•SFRotationSensor {}
•SFVec2fSensor {}
•SFBoolSensor {}
![Page 29: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/29.jpg)
Web3D Symposium 2005
Simple Virtual Environment (SVE)
• Tightly coupled (Kessler, D. http://www.eecs.lehigh.edu/~dkessler/SVE/)
![Page 30: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/30.jpg)
Web3D Symposium 2005
SVE: note offset for tracker and eyes
![Page 31: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/31.jpg)
Web3D Symposium 2005
SVE Interaction Techniques
• loadWorld ()• registerCallback: input and animation
– registered to predefined object and events (hand, cursor, mouse, keyboard)
• Often, getWorldCoordinates () and getMatrixDistance () are used to compute 3DI behaviors
• Must setup selectable objects
![Page 32: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/32.jpg)
Web3D Symposium 2005
Hudson
![Page 33: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/33.jpg)
Web3D Symposium 2005
Zuffo
![Page 34: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/34.jpg)
Web3D Symposium 2005
Break
![Page 35: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/35.jpg)
Web3D Symposium 2005
Session Outline
• Polys
• Hudson
• Zuffo– break
• Activities: expressing interaction
• Activity Review
• Summarize and Next Steps
![Page 36: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/36.jpg)
Web3D Symposium 2005
Goals
Provide support for rich user interface functionality express-able without platform dependencies
Support 3D User Interface techniques for Navigation, Selection, Manipulation
![Page 37: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/37.jpg)
Web3D Symposium 2005
Describing Interaction
Different languages:
• Users
• Interface Designers
• Software Developers
• Machines
![Page 38: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/38.jpg)
Web3D Symposium 2005
X3D UI Goals
• Writability
• Expressiveness
• Readability
• Orthogonality (concise, complete)
• Portability (cross-platform reuse)
![Page 39: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/39.jpg)
Web3D Symposium 2005
Activity
Pick one of the following scenarios below that is not in your domain area.
In English, describe the interactions between the
user and the system that might take place in the application in order for the user to accomplish their goal. You can choose any platform or devices to address the scenario, but start your description with high-level actions/ activities.
![Page 40: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/40.jpg)
Web3D Symposium 2005
ScenariosConstruction- "Crazy architects have drawn pipe, duct and electrical layouts for
buildings that criss-cross and intersect. You have to design a system that allows you to route pipes around each other by moving them and placing in joints of various types to redirect them up and around. The attributes of the pipe (size, contents) may be important to determine the optimal layout."
Geology – “Structural engineers and geologists are planning a new tunnel into
an underground research facility. They have collected data on the formations of rock in the area and want to test the implications of various tunnel plans. You have to design an application that allows the engineer to bore and test possible tunnel routes into the rock formation. The nature of various rock types is important to the feasibility of a proposed path and experts need to understand these types in order to submit realistic routes to the simulator.”
![Page 41: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/41.jpg)
Web3D Symposium 2005
Activity
• Video– Selection by Raycasting– Selection & Manipulation by GoGo
![Page 42: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/42.jpg)
Web3D Symposium 2005
Activity
• Pseudo code - GoGo– Set picker pos ()– Get reference pos () [eg head]– Compute anchor point pos() [eg torso point)– Get picker pos ()– Scale distance ()– Set picker pos ()
• Selection / Highlighting considered separately
![Page 43: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/43.jpg)
Web3D Symposium 2005
Activity Review
Reflect on language
• Context / frame
• Kinds of subjects, direct/indirect objects
• Verbs
• Adjectives
What system info is required for each?
![Page 44: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/44.jpg)
Web3D Symposium 2005
X3D User Interfaces
•Displays: – Handling ImagePlane
(size, coordinates, layers)– Stereoscopy
•Inputs: – Device binding– Coordinates & Access– Picking
![Page 45: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/45.jpg)
Web3D Symposium 2005
Runtime
Scenegraph
- InputSensors
- Pickers
-NavigationInfo
-Hanim
Application
- User Interface specific to app
-typically compiled
Bind device streams to viewer app
- config file
- GUI
Map coordinates to X3D World
Declarative
Scenegraph
- Custom User Interface ?
![Page 46: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/46.jpg)
Web3D Symposium 2005
3DUI: Needed Hooks
• Imageplane layouts• Navigation / Travel
– User workspace, multiple trackers– Body representation, collision
• getWorldCoordinates, relative matrix operations?
• Picking– Variety of primitive & composed volumes
![Page 47: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/47.jpg)
Web3D Symposium 2005
Richness of body representation
• Leverage natural metaphors
• A common interface description?
• Ergonomic Immersion
• Need to reconcile Travel and Navigation interactions
• Need to reconcile with selection / picking interactions
![Page 48: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/48.jpg)
Web3D Symposium 2005
Humanoid Animation
• ISO / IEC 19774
http://www.hanim.org/
• Levels of Articulation 1-3
![Page 49: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/49.jpg)
Web3D Symposium 2005
Imageplane pros/cons
Absolute+
+
-
-
Relative
+
+
-
-
![Page 50: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/50.jpg)
Web3D Symposium 2005
X3D Amendment 2
• ImagePlane: 2D and Layered UIs, HUDs …
• Scenegraph support for a range of input streams
• NavigationInfo - incorporate H-Anim for 3DI hooks?
• Viewpoint binding semantics
![Page 51: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/51.jpg)
Web3D Symposium 2005
Relevant Work
• InTml – Figuroa, P.
• Contigra/Behavior3D – Daschelt, R.
• Bitmanagement techniques
• Xj3D component specs
![Page 52: Web3D Symposium 2005 X3D User Interfaces: Toward AMD 2 Nicholas F. Polys Alan Hudson Marcelo Knőrich Zuffo Doug A. Bowman](https://reader035.vdocuments.net/reader035/viewer/2022062222/56649f165503460f94c2cf80/html5/thumbnails/52.jpg)
Web3D Symposium 2005
Thanks
• Virginia Tech University Visualization and Animation Group
• VT 3DI Research Group http://research.cs.vt.edu/3di/
• Chad Wingrave• Andrew Ray• Dr. Ron Kriz• Pat Shinpaugh