2018ss ankündigung masterprojekt a mobile gaming console ... · each handle is connected to a...

HumanComputerInteractionProf.Dr.PatrickBaudischMasterprojektSommersemester2016

HCI: A Gaming Console for the Blind

Figure1: (a)Thisblinduser isplayinga first-personshooterdesigned for sightedusers. (b)TheDualPantobimanual force feedbackdevice enables this. Itsme handle allowsusers tomove their avatar around thevirtual space. Force feedback prevents users from crossing virtualwalls. The it handlemoves by itself. Itallowsuserstofeelwherethecurrentopponentislocatedandwhatdirectionitfaces.Usersaimusingthehapticknobonthemehandle;afootpedalfiresthegun.

Aspart of this project, the teamyouwill create (1) amobile versionof the shownhapticdevicehardwareandmostofall(2)asoftwareframework,API,andIDEaroundit.

Thedevicethatenablesblinduserstointeractwithspatialvirtualenvironmentsthatcontainobjectsmoving in real-time,as is thecase in sportsor shootergames.Users interactwithDualPantobyoperatingitsmehandlewithonehandandbyholdingontoitsithandlewiththeotherhand.Eachhandleisconnectedtoapantographhaptic input/outputdevice.Thekeyfeatureisthatthetwohandlesarespatiallyregisteredwithrespecttoeachother.Whenguidingtheiravatarthroughavirtualworldusingthemehandle,spatialregistrationenablesuserstotrackmovingobjectsbyhavingthedeviceguidetheoutputhand.Thisallowsblindplayersofashootergametoaimatanopponentordodgetheopponent’sshots; itallowsblindplayersofa1-on-1soccergametoracefortheballorevadeanopponent.Inouruserstudy,blindparticipantsreportedveryhighenjoymentwhenusingthedevicetoplay(6.5/7).

Software you will write & required skills Oneteammemberwillprobablyspecializeonworkingonthehardware,whiletheotherswillfocusoncreatingasoftwaresystemaroundit.Ideally,youhaveexperiencein3Dcomputergraphics,andinthedesignandimplementationofsoftwaresystem.IfyouhadtakenHCI2andenjoyedit,thatwouldbenice,butisnotmissioncritical.

HumanComputerInteractionProf.Dr.PatrickBaudischMasterprojektSommersemester2016

Questions baudisch@hpi.de