sketchbased interface on a handheld augmented reality system
DESCRIPTION
Sketchbased interface on a handheld augmented reality system. Rhys Moyne Honours Minor Thesis Supervisor: Dr. Christian Sandor. TINT. Augmented Reality (AR). Adding virtual information to the real world Aids user in understanding the world - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/1.jpg)
Sketchbasedinterfaceonahandheldaugmentedrealitysystem
RhysMoyneHonoursMinorThesis
Supervisor:Dr.ChristianSandor
![Page 2: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/2.jpg)
TINT
![Page 3: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/3.jpg)
AugmentedReality(AR)
Addingvirtualinformationtotherealworld Aidsuserinunderstandingtheworld Mergesrealworld(cameraimage)andvirtual
objects Trackingisneededtocalculatelocationof
objectsanduserintheenvironment
![Page 4: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/4.jpg)
ARDisplayTechnologies
Head-mounted Handheld
![Page 5: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/5.jpg)
Motivation
HandheldARsystemsrequiredifferentwaysofinteractionduetosizeconstraint
Exisitingmethodssuchaspinchglovesorwristpadsarenotsuitable
FutureARdevicessuchasmobilephonesarelikelytohavetouchscreens
Sketch-basedinputinhandheldaugmentedrealityislargelyunexplored
![Page 6: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/6.jpg)
DirectManipulationandSketch-basedInterface
![Page 7: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/7.jpg)
DirectManipulation
![Page 8: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/8.jpg)
DirectManipulation
Useractionsaffectobjectimmediately Example:drivingacar
Userturnssteeringwheelleftandwheelmovesleft Nocommand“TURNLEFT”
“Matchinguser'sgestureswiththeobservedvirtualmotion”(Dragicevicetal.,p.2)
![Page 9: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/9.jpg)
Sketch-basedinterface
![Page 10: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/10.jpg)
Sketch-basedinterface
Allowsusertodirectlyinteractsimilartopenandpaper Morenatural Hasbeenexploredinareassuchasmodelling,
animation,userinterfaceprototyping Gestures
![Page 11: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/11.jpg)
ResearchQuestion
Isasketchbasedinterfaceasuitableinteractionmethodinahandheldaugmentedrealitysystem?
![Page 12: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/12.jpg)
ResearchApproach
LiteratureReview Iterativeprototypes
Informalqualitativefeedbackontechniques (Userstudy)
![Page 13: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/13.jpg)
DevelopmentApproach
Createademoillustratinginteractiveexplorationinasimpletestscene MakeuseofTINTframework
Addtracking Addanimation
Directmanipulationinterface(completeby18September) Morecomplicatedphysics(18September) GestureRecognition(18September)
PorttoMobileAugmentedReality(30September) Projectionofcameraimageontovirtualobjects
![Page 14: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/14.jpg)
Demo
ThiscanbeusedasabasetocontrolvisualisationsinTINT
Illustrateshowtocontrolobjectstoexplore
![Page 15: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/15.jpg)
TINT(ThisisnotTINMITH)
TINMITH–HMDprototypingplatform TINT–Handheldaugmentedrealityprototyping
platform UsedtoprototypeARapplicationsthatmaybe
possibleonfuturemobilephones WritteninPythonallowingfastdevelopment
![Page 16: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/16.jpg)
Implementation
![Page 17: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/17.jpg)
ARToolkitTracking
Calculateswherethemarkerisrelativetothecameraposition
Usescomputervisiontechniquestoidentifymarker
Allowsthevirtualobjectstobeplacedincorrectlocation
![Page 18: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/18.jpg)
CompizPhysics
![Page 19: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/19.jpg)
$1GestureRecognizer
![Page 20: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/20.jpg)
Summary
Howtointeractivelycontrolvisualisationsinhandheldaugmentedreality?
![Page 21: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/21.jpg)
Thanks,Questions?
![Page 22: Sketchbased interface on a handheld augmented reality system](https://reader036.vdocuments.net/reader036/viewer/2022062408/56813fd8550346895daabdd9/html5/thumbnails/22.jpg)
ReferencesCompiz.org,2009,'Compiz',<http://www.compiz.org/>,accessed3September2009.
Dragicevic,P,Ramos,G,Bibliowitcz,J,Nowrouzezahrai,D,Balakrishnan,R&Singh,K2008,'Video
browsingbydirectmanipulation',inTwentysixthannualSIGCHIconferenceonHumanfactorsin
computingsystems,ACM,Florence,Italy,pp.237246.
Igarashi,T,Matsuoka,S&Tanaka,H1999,'Teddy:asketchinginterfacefor3Dfreeformdesign'in
Proceedingsofthe26thannualconferenceoncomputergraphicsandinteractivetechniques,ACM,
pp.409416.
Kato,H&Billinghurst,M1999,'MarkertrackingandHMDcalibrationforavideobasedaugmentedreality
conferencingsystem',inProceedingsofAugmentedReality1999(IWAR'99),IEEE,SanFrancisco,
CA,pp.8594.
Piekarski,W&Thomas,BH2001,'TinmithMetro:newoutdoortechniquesforcreatingcitymodelswithan
augmentedrealitywearablecomputer',inProceedingsofFifthInternationalSymposiumon
WearableComputers,IEEE,Zurich,pp.3138.
Sandor,C,Cunningham,A,Eck,U,Urquhart,D,Jarvis,D,Dey,A,Barbier,S,Marner,M&Rhee,S2009,
'Egocentricspacedistortingvisualizationsforrapidenvironmentexplorationinmobilemixedreality',
in8thIEEEandACMInternationalSymposiumonMixedandAugmentedReality(ISMAR'09),ACM,
Orlando,Florida.
Shneiderman,B1983,'DirectManipulation:astepbeyondprogramminglanguages',Computer, vol.16,no.8,pp.57-69.
sleepygeek.org,n.d.,'$1gesturerecognizerinpython',<http://sleepygeek.org/projects.dollar>,accessed3September2009.
Wobbrock,JO,Wilson,AD&Li,Y2007,'Gestureswithoutlibraries,toolkitsortraining:a$1recognizerfor
userinterfaceprototypes'inProceedingsofthe20thannualACMsymposiumonuserinterface
softwareandtechnology,ACM,Newport,RhodeIsland,pp.159168.