HumanComputerInteractionProf.Dr.PatrickBaudischMasterprojektSommersemester2016
HCI: A Gaming Console for the Blind
Figure1: (a)Thisblinduser isplayinga first-personshooterdesigned for sightedusers. (b)TheDualPantobimanual force feedbackdevice enables this. Itsme handle allowsusers tomove their avatar around thevirtual space. Force feedback prevents users from crossing virtualwalls. The it handlemoves by itself. Itallowsuserstofeelwherethecurrentopponentislocatedandwhatdirectionitfaces.Usersaimusingthehapticknobonthemehandle;afootpedalfiresthegun.
Aspart of this project, the teamyouwill create (1) amobile versionof the shownhapticdevicehardwareandmostofall(2)asoftwareframework,API,andIDEaroundit.
Thedevicethatenablesblinduserstointeractwithspatialvirtualenvironmentsthatcontainobjectsmoving in real-time,as is thecase in sportsor shootergames.Users interactwithDualPantobyoperatingitsmehandlewithonehandandbyholdingontoitsithandlewiththeotherhand.Eachhandleisconnectedtoapantographhaptic input/outputdevice.Thekeyfeatureisthatthetwohandlesarespatiallyregisteredwithrespecttoeachother.Whenguidingtheiravatarthroughavirtualworldusingthemehandle,spatialregistrationenablesuserstotrackmovingobjectsbyhavingthedeviceguidetheoutputhand.Thisallowsblindplayersofashootergametoaimatanopponentordodgetheopponent’sshots; itallowsblindplayersofa1-on-1soccergametoracefortheballorevadeanopponent.Inouruserstudy,blindparticipantsreportedveryhighenjoymentwhenusingthedevicetoplay(6.5/7).
Software you will write & required skills Oneteammemberwillprobablyspecializeonworkingonthehardware,whiletheotherswillfocusoncreatingasoftwaresystemaroundit.Ideally,youhaveexperiencein3Dcomputergraphics,andinthedesignandimplementationofsoftwaresystem.IfyouhadtakenHCI2andenjoyedit,thatwouldbenice,butisnotmissioncritical.
HumanComputerInteractionProf.Dr.PatrickBaudischMasterprojektSommersemester2016
Questions [email protected]
