wearable computers and augmented reality
DESCRIPTION
Wearable Computers and Augmented Reality. David Mizell Intel Research Seattle Feb. 24, 2003. Outline. Wearable computers Overview Research issues Augmented reality Components Applications Research issues. Wearable Computers. Battery-powered PC on belt Head-mounted display - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/1.jpg)
Wearable Computers and Augmented Reality
David MizellIntel Research Seattle
Feb. 24, 2003
![Page 2: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/2.jpg)
Outline
• Wearable computers– Overview– Research issues
• Augmented reality– Components– Applications– Research issues
![Page 3: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/3.jpg)
Wearable Computers
• Battery-powered PC on belt
• Head-mounted display
• Speech input• Wireless
communication
![Page 4: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/4.jpg)
Application Premises
Tool Model• Application specific• Worn only while
doing a certain job• Hands-free
requirement
Clothing Model• Worn all day; used all
day• Wide variety of
applications• User sometimes
unaware of application
![Page 5: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/5.jpg)
Research Emphases
Tool Model• User interface design
– Speech input– Eye tracking
• Development issue: creating/transforming application data
Clothing Model• Packaging; incorporating
into clothing• Battery life• AI, agent technology• Activity inferencing• Image processing• Design of keyboard or
keyboard substitute
![Page 6: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/6.jpg)
Augmented Reality• Wearable computer• See-through head-
mounted display• 6DOF head
position/orientation tracker
Superimposes and stabilizes computer-generated information upon specific coordinates of the real surroundings.
6DOF tracker
image source
beam splitter
![Page 7: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/7.jpg)
An example: aircraft wire bundle assembly at Boeing
![Page 8: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/8.jpg)
Formboard storage
![Page 9: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/9.jpg)
Formboard rework
![Page 10: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/10.jpg)
The AR “generic” formboard
![Page 11: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/11.jpg)
experiment in the Boeing Everett factory, summer 1997
•six-week experiment
•wire shop & mockup shop workers
•AR vs. traditional bundle forming
•TriSen optical tracker & see-through HMD
•Via II wearable computer (in vest)
![Page 12: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/12.jpg)
Summary of ResultsIt worked. We could assemble bundles on the AR formboard,
move them over to the traditional formboard, and they would pass QA inspection.
![Page 13: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/13.jpg)
Results…
• Productivity was no higher. Clearly fault of the user interface.
• Wide disparity of user acceptance levels. Women hated the HMD.
• Intriguing anecdotal evidence of training benefits
![Page 14: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/14.jpg)
AR-for-Maintenance Lab Demo
![Page 15: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/15.jpg)
![Page 16: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/16.jpg)
Applying Augmented Reality to Maintenance
• Potential to guide minimally-trained mechanic through a complex maintenance procedure
• The ultimate in “just-in-time” training -- occurs during the maintenance procedure, on the real item being maintained
• Good fit for the military -- complex equipment, maintainers expensive to train, hard to keep – also for Space Station: on-orbit training for astronauts
• Requires portable, easily-deployed & registered tracker system, comfortable see-through head-mounted display
![Page 17: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/17.jpg)
Also notice:
• The “minimalist” nature of the annotations.
![Page 18: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/18.jpg)
AR research issues
• Tracker design– At 50 Hz., track head xyz position to 1 mm.,
roll-pitch-yaw orientation to .1 degree– 2+ m. range (near term)– Robust– Portable– Easy to set up/calibrate– cheap
![Page 19: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/19.jpg)
Trackers – what’s available now
• Magnetometers – AC and DC• Acoustic-inertial hybrid• Optical-inertial hybrid• Videometric• “ultimate” tracker: track against real
environment; no fiducial marking
![Page 20: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/20.jpg)
AR research issues (2)
• Authoring system– Use real object and AR– Use CAD model of object and VR
• User interface– What to show the user– How user should give input to system
• AR display design
![Page 21: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/21.jpg)
AR display design: optical see-through vs. video see-through
Courtesy of DigiLens, Inc.
video camera
computer
![Page 22: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/22.jpg)
AR display design: advantages of optical see-through and
video see-through
Optical• Higher-resolution
(now)• Lightweight• Higher frame rate
(now)
Video• Work in image domain
– Pixel resolution– Partial occlusion
• Eliminate “image rivalry”
![Page 23: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/23.jpg)
AR research issues (3)
• Registration: establish fixed relationship between tracker coordinate system and real-world coordinate system, and between tracker coordinate system, display, and user’s eye
• Calibration: use objects in known world coordinates to adjust for systematic tracking or display errors
• (these terms often blurred together in AR research, and referred to as “calibration”)
![Page 24: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/24.jpg)
Registration: the basic idea
VV = ( TVD TDS TSW ) VW
Also needed: ev : coordinates of eye in virtual screen coordinates
which pixel on display to illuminate detector to virtual
screen of display dynamic – this iswhat tracker gives you
world coordinates to tracker source coordinates – fixed at setup time
point in real world coordinates
![Page 25: Wearable Computers and Augmented Reality](https://reader036.vdocuments.net/reader036/viewer/2022081513/56813a8e550346895da288df/html5/thumbnails/25.jpg)
Summary
• Inherently multi-disciplinary research– CS – interface design– Physics – tracker design– Physiology; optics – HMD design
• And you get to wear funny hats!