Slide 1

Prototyping and Designing New Assistive Technologies for People with Disabilities Shaun Kane Human-Centered Computing @ UMBC http://umbc.edu/people/skane @shaunkane

Slide 2

Today An overview of accessible prototyping and design at UMBC Two projects Accessible touch screens for blind people Smarter communication tools for people with aphasia 2

Slide 3

Prototyping and Design at UMBC 3

Slide 4

What weve made 4 Touch screens for blind people Braille entry for smartphones Communication technologies Tactile graphics

Slide 5

Our research partners 5 National Federation of the Blind Snyder Center for Aphasia Life Enhancement Maryland State Library for the Blind and Physically Handicapped Charlestown Senior Living

Slide 6

Design approach Participatory design: work for extended periods with population who will benefit from technology Ability-based design: Measure users abilities to interact with technology; develop new ways of interacting with technology that leverages these abilities 6

Slide 7

Two projects Access Overlays: Accessible touch screens for blind people TalkAbout: Communication tools for people with aphasia 7

Slide 8

Two projects Access Overlays: Accessible touch screens for blind people TalkAbout: Communication tools for people with aphasia 8

Slide 9

Challenge: How to make a touch screen accessible to a blind person? 9

Slide 10

Yeah. I was at the social security office enquiring about getting a new Social Security card. You have to get a number at the office, and the security guard was on a smoke break, and it was a touch screen, and I couldn't use it and it was a big hassle. Some sighted guy came in and helped me but it drew way too much attention to me. I think it's kind of weird that an agency that's supposed to assist the disabled doesn't have accessibility things, that's kind of stupid. 10 Inaccessible touch screens

Slide 11

Flat screens without a grida real tangible grid are difficult for blind people I think that flat screens are not really accessible. (Kane et al., 2008) 11

Slide 12

12 But touch is often how blind people interact with books, maps, and their physical environment.

Slide 13

Exploring touch screens Important applications: maps, diagrams, documents, games Location and spatial layout important How to find objects on screen? How to understand spatial relations? 13

Slide 14

Formative research Interviewed 8 blind office workers (4m,4f) Discussed organization and search strategies Where they put things; how they found them 14

Slide 15

How to do it Appropriate output Speech and audio Appropriate input How do users touch the device? Screen layout Usable, reliable gestures 15

Slide 16

Examples Mobile phone: http://www.youtube.com/watch?v=496IAx6 _xys http://www.youtube.com/watch?v=496IAx6 _xys Large touch screen: http://www.youtube.com/watch?v=acTwW RcUlSk http://www.youtube.com/watch?v=acTwW RcUlSk 16

Slide 17

Two projects Access Overlays: Accessible touch screens for blind people TalkAbout: Communication tools for people with aphasia 17

Slide 18

Aphasia center Serves ~40 adults with reading, comprehension, and speech difficulties caused by stroke Many use tablet communication software (but dont like it) 18

Slide 19

We created a location-aware communication tool for people with aphasia Make it smarter: use context to determine what the user might want to say (e.g., talk about medicine when the user I at the doctors office) 19 TalkAbout (Kane et al., 2012)

Slide 20

Designing TalkAbout How to design with people who have difficulty communicating? Multiple approaches Created a design team of diverse users Worked closely with staff and instructors Used multiple forms of prototyping (diagrams, acting, interactive prototypes), and collecting feedback (paper forms, conversation) 20 Our design team preferred our new prototype to their existing tools.

Slide 21

Takeaways We can redesign existing devices to make them more accessible Software easier to fix than hardware by involving future users in design Adaptations become device features Sometimes even our design methods must be flexible 21

Slide 22

Thanks! Shaun Kane skane@umbc.edu http://umbc.edu/people/skane http://twitter.com/shaunkane http://umbcpad.com UMBC Prototyping and Design Lab

Slide 23

Who benefits? About 25 million people in the US have some visual impairment (National Health Interview Survey 2008) As many as 25% of computer users may benefit from visual accessibility tools (Microsoft 2004) 23

Slide 24

Barriers to everyday activities 24 Can I ski 60 miles an hour downhill? Yes. Use a flat panel microwave? No. Mike May, Sendero Group (2009)

Slide 25

Principles of Ability-Based Design (Wobbrock, Kane et al., 2010) AbilityFocus on ability, not dis-ability. Take advantage of all that users can do. AccountabilityRespond to poor user performance by changing the system, not the user. :When possible, utilize low-cost everyday input devices. PerformanceMeasure, model, monitor, and/or predict user performance. ContextProactively sense context and anticipate its effects on a users abilities. AdaptationProvide adaptable or adaptive user interfaces tailored to a users abilities. TransparencyGive users the awareness of adaptations and the means to inspect, override, store, retrieve, preview, and test- drive them. 25

Slide 26

26