technologies to reduce the access barrier in human...

IP Roma 2013

Project 02Technologies to Reduce

the Access Barrierin Human Computer

InteractionErasmus Intensive

Programme

Rome, Italy, 5.5. – 17.5.2013http://www.trabhci.eu/

ChatUp

• Linh-LahtiUniversityofAppliedSciences(Finland)• Alexey-LahtiUniversityofAppliedSciences(Finland)• Lidia-UniversitatPolitecnicadeValencia(Spain)• Mirko-UniversityofAppliedSciencesDresden(Germany)• Jaime-UniversityofZaragoza(Spain)

ChatUp > IP Rome 2013

Initial task description shortly

Createanapplicationtohelppeopletosendemergencyandregularemailstotheirfriendsandrelativesbyusinggesturesandspeechrecognition.

Applicationmustbeeasytouseincomplicatedcondictions.

ChatUp > IP Rome 2013

Initial idea of the group shortly

Applicationallowstowritetextbytalkingusingspeechrecognition.

Thesenderisabletosendemergencymessagesjustbymakingasimplegesturewiththehand.

Byusingthistechnologypeoplecanextendtheirconnectionsandobtainadditionalcommunicationpossibilities.

ChatUp > IP Rome 2013

Focus group

PeoplewhoarenotabletowalkPeoplewhohaveproblemsofmovement:tremorandotherdisabilitiesfortyping

ChatUp > IP Rome 2013

Purpose and motivation

• Toimprovethequalityoflife• Tomakeiteasierforpeopletocommunicate• Tohelppeopletoaskforhelpincaseofemergency

ChatUp > IP Rome 2013

Functionalities, Technologies and architechture applied

• SendingemailsviaGMailbyusinggesturesandvoice

• Kinect,C#,WPF,internet

ChatUp > IP Rome 2013

Subtask Identified

ChatUp > IP Rome 2013

GraphicalInterface GraphicDesignSpeechRecognition

Difficulties

• ImplementingtheGoogleAPIspeechrecognition• Howtopressthebuttons,workingwiththeZaxe• Topositionthemousepointonthecenterofthehandaccurately

ChatUp > IP Rome 2013

What was learned?

• ImprovetheknowledgesaboutusingKinect• Usingspeechtotexttechnology• C#• Workinginaninternationalgroup• Shareandexplainideas• Understandingpossibledifficultiesdependingonvarioustypesofdisabilitiesorhandicaps

ChatUp > IP Rome 2013

What was left not done and can be done in the future?

• Translatewordsintopictogram• Sendingthemessagesbyotherways,asWhatsapp,SMS,Facebook...

• Addmorepeopletothelistofcontacts

ChatUp > IP Rome 2013

Where we succeed and why?

• Sendemail• Therecognitionspeechtotext• Selectbetweendifferentpeople• Holdsuccessfulcommunicationwithinateam• Toaccomplishthetaskinefficientway• Adjustthespeedofthepointer

ChatUp > IP Rome 2013

Where we failed and why

• Implementotherwaysofsendingmessages• Implementallfeatureswewouldliketohaveinourapplication

ChatUp > IP Rome 2013

Thank you!IP Roma 2013