Transcript
Page 1: Usab11 krajnc knollfeinertraar

Take out your mobile phone,

dial a number,

but imagine you are blind.

Take out your mobile phone,

but imagine you are blind.

Krajnc E., Knoll M., Feiner J., Traar M.

Page 2: Usab11 krajnc knollfeinertraar

And you don’t have

physical keys

Krajnc E., Knoll M., Feiner J., Traar M.

Page 3: Usab11 krajnc knollfeinertraar

A Touch Sensitive User Interface Approach onSmartphones for Visually Impaired and BlindPersons

Elmar Krajnc, Mathias Knoll, Johannes Feiner, Mario TraarUSAB 2011, 25.-26. November 2011, Graz

A Touch Sensitive User Interface Approach onSmartphones for Visually Impaired and Blind

Elmar Krajnc, Mathias Knoll, Johannes Feiner, Mario Traar

Krajnc E., Knoll M., Feiner J., Traar M.

26. November 2011, Graz

Page 4: Usab11 krajnc knollfeinertraar

Project Ways4all Completewww.ways4all.at

� Routing and way finding

� Indoor navigation

� Communication with public transport vehicles

� Integration in one device, a mobile phone� Integration in one device, a mobile phone

� This paper: a barrier free UI for Touch Screen Phones

Project Ways4all Complete

Communication with public transport vehicles

Integration in one device, a mobile phone

Krajnc E., Knoll M., Feiner J., Traar M.

Integration in one device, a mobile phone

This paper: a barrier free UI for Touch Screen Phones

Page 5: Usab11 krajnc knollfeinertraar

Mobile Phone Market

� Smart Phones overtakes Mobile � Smart Phones overtakes Mobile Phones

� Android: 52.5% of theglobal smartphoneglobal smartphonemarket

http://articles.businessinsider.com/2011

Mobile Phone Market

Smart Phones overtakes Mobile Smart Phones overtakes Mobile

52.5% of theglobal smartphone

Krajnc E., Knoll M., Feiner J., Traar M.

global smartphone

http://articles.businessinsider.com/2011-11-15/tech/30400572_1_smartphone-android-ios

Page 6: Usab11 krajnc knollfeinertraar

Accessibilty on Smart Phones

� Mostly Touchscreens � Mostly Touchscreens

� No Standards

� Examples

� Symbian - Talks

� Apple - Voice Over � Apple - Voice Over

� Android

� Talkback/Eyes Free Project/Self Voicing Apps

Accessibilty on Smart Phones

Mostly Touchscreens Mostly Touchscreens

Krajnc E., Knoll M., Feiner J., Traar M.

Talkback/Eyes Free Project/Self Voicing Apps

Page 7: Usab11 krajnc knollfeinertraar

Previous Result

� Previous Version of the application� Previous Version of the application

� Java ME platform

� Screen reader Talks

� Transfer to Touchscreen

Previous Version of the applicationPrevious Version of the application

Screen reader Talks

Krajnc E., Knoll M., Feiner J., Traar M.

Transfer to Touchscreen

Page 8: Usab11 krajnc knollfeinertraar

� General Concept

Ways4all App on Android

� General Concept

� Android

� Open Source

� Developer Friendly

� Built in TTS Engine� Built in TTS Engine

Ways4all App on Android

Krajnc E., Knoll M., Feiner J., Traar M.

Page 9: Usab11 krajnc knollfeinertraar

� New View Componet

UI Talking View

� New View Componet

� Handling Touch Input

� Self Voicing

if ((touchEvent() … ){

tts.speak(itemTexts[0],… );tts.speak(itemTexts[0],… );

}

New View ComponetNew View Componet

Handling Touch Input

Krajnc E., Knoll M., Feiner J., Traar M.

Page 10: Usab11 krajnc knollfeinertraar

� Gestures API

Gesture Input

� Gestures API

� Writing or Gestures as User Input

… GestureLibraries.fromRawResource(this, … GestureLibraries.fromRawResource(this,

R.raw.myGestures);

predictions = … recognize(gesture);

if (prediction.name.equals(“3")) {

doSomeThing();

}

Writing or Gestures as

… GestureLibraries.fromRawResource(this,

Krajnc E., Knoll M., Feiner J., Traar M.

… GestureLibraries.fromRawResource(this,

Page 11: Usab11 krajnc knollfeinertraar

� Video or Demo

Talking User Interface

� Video or Demo

Talking User Interface

Krajnc E., Knoll M., Feiner J., Traar M.

Page 12: Usab11 krajnc knollfeinertraar

� Thinking Aloud Test

Usability Testing

� Thinking Aloud Test

� 7 Testuser

� 2 Blind, 2 Visual Disorder

� Feedback� Feedback

� Intuitive UI

� Users could fullfil most Tasks

Thinking Aloud TestThinking Aloud Test

Disorder, 3 Normal

Krajnc E., Knoll M., Feiner J., Traar M.

Users could fullfil most Tasks

Page 13: Usab11 krajnc knollfeinertraar

� Accessible Apps vs. Accessible

General Problems on Smartphones

� Accessible Apps vs. Accessible Smartphones

� 2D Touchscreen vs. 1D Lists

� No Standards

� Different Usage on Different Platforms� Different Usage on Different Platforms

Accessible Apps vs. Accessible

General Problems on Smartphones

Accessible Apps vs. Accessible

2D Touchscreen vs. 1D Lists

Different Usage on Different Platforms

Krajnc E., Knoll M., Feiner J., Traar M.

Different Usage on Different Platforms

Page 14: Usab11 krajnc knollfeinertraar

Outlook

� SW Development is in progress� SW Development is in progress

� Text input

� More reviews and tests

� Converting to other platforms like iPhone

SW Development is in progressSW Development is in progress

More reviews and tests

Converting to other platforms like iPhone

Krajnc E., Knoll M., Feiner J., Traar M.

Page 15: Usab11 krajnc knollfeinertraar

Conclusion

� Developing for special user groups is � Developing for special user groups is challenging

� New technologies needs new SolutionsSolutions

Developing for special user groups is Developing for special user groups is

New technologies needs new

Krajnc E., Knoll M., Feiner J., Traar M.

Page 16: Usab11 krajnc knollfeinertraar

Thanks for your Attention

Elmar Krajncelmar.krajnc@fh

Mathias KnollMathias.knoll@fh

Johannes Feinerjohannes.feiner@fh

Mario TraarMario Traarmario.traar@fh

FH JOANNEUMUniversity of Applied

www.fh-joanneum.at/itm

Thanks for your Attention

Elmar [email protected]

Mathias [email protected]

Johannes [email protected]

Mario Traar

Krajnc E., Knoll M., Feiner J., Traar M.

Mario [email protected]

FH JOANNEUMApplied Sciences

joanneum.at/itm


Top Related