interaction techniques for ambiguity resolution in recognition-based interfaces
DESCRIPTION
Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces. Jennifer Mankoff CoC & GVU Center Georgia Tech. Acknowledgements. Gregory Abowd & Scott Hudson FCE Group & GVU NSF. Outline. Motivation Definitions & Illustration Broad Solution: OOPS Specific Solutions - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/1.jpg)
Interaction Techniques for
Ambiguity Resolution in Recognition-based
Interfaces
Jennifer MankoffCoC & GVU Center
Georgia Tech
![Page 2: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/2.jpg)
Acknowledgements
Gregory Abowd & Scott Hudson FCE Group & GVU NSF
![Page 3: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/3.jpg)
Outline
Motivation Definitions & Illustration Broad Solution: OOPS Specific Solutions Conclusion & Future Work
![Page 4: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/4.jpg)
Ambiguity
am·big·u·ous1 a : doubtful or uncertain especially from obscurity or indistinctness <eyes of an ambiguous color> b : INEXPLICABLE2 : capable of being understood in two or more possible senses or ways
An anathema to computers Normal for humans
![Page 5: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/5.jpg)
Where does ambiguity arise? Web search
user doesn’t know correct answer multiple correct answers
Implicit input user not involved with application
Multiple users System states may not agree
Recognition
![Page 6: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/6.jpg)
Focus: Recognition
Recognition is becoming ubiquitous
Recognition is difficult to use
A range of interface problems result
OOPS toolkit helps solve them
![Page 7: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/7.jpg)
Research Methodology
Motivated by real world, non-CS problems
Evaluators Study individual problems/solutions Design space of possible solutions
Builders Facilitate solutions to sets of problems
(Architectural / toolkit solutions) Design space exploration
![Page 8: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/8.jpg)
Outline
Motivation Definitions & Illustration Broad Solution: OOPS Specific Solutions Conclusions & Future Work
![Page 9: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/9.jpg)
Definitions Mediation
dialogue between user and computer used for resolving ambiguity
Recognizer interprets user input creates ambiguity
Error mistake from user’s perspective represented with ambiguity
![Page 10: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/10.jpg)
SILK (Landay, 1996)
![Page 11: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/11.jpg)
Burlap
![Page 12: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/12.jpg)
Outline
Motivation Definitions & Illustration Broad Solution: OOPS Specific Solutions Conclusions & Future Work
![Page 13: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/13.jpg)
OOPS Toolkit (CHI’00)
Toolkit-level support for handling ambiguity in recognition Library of mediators Architectural support
Based on subArctic
![Page 14: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/14.jpg)
Library of mediators
Design space based on survey Generic and re-usable Three major classes
Repetition Choice Automatic
![Page 15: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/15.jpg)
Library of mediators
Design space based on survey Generic and re-usable Three major classes
Repetition Choice Automatic
![Page 16: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/16.jpg)
Library of mediators
Design space based on survey Generic and re-usable Three major classes
Repetition Choice Automatic
if (result is “W.”)reject it
elsedo nothing
![Page 17: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/17.jpg)
Architectural Support
INDEPENDENT of any specific toolkit
Separation of mediators, recognizers, and application
Communication by a common internal model (ambiguous hierarchical events)
Maintains ambiguity indefinitely
![Page 18: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/18.jpg)
Three key pieces
Ambiguous hierarchical events Changes to event dispatch Mediation subsystem
![Page 19: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/19.jpg)
down drag up• • • • • •
s
Ambiguous Hierarchical Events
strokestroke
down drag up• • • • • •
s c
![Page 20: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/20.jpg)
med1med2med3med4medn
rec1rec2rec3rec4recn
Event Dispatch
1. A sensed event arrives
eventInput
handler
2. It is dispatched to all recognizers3. It is mediated
![Page 21: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/21.jpg)
Mediation Subsystem
Ambiguity is identified automatically Presence of multiple interactor leaf nodes
Hierarchy is passed to mediators Recognizers, recipients informed of
accept/reject decisions Accept/reject modifies hierarchy
Application selects mediators from library
![Page 22: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/22.jpg)
Outline
Motivation Definitions & Illustration Broad Solution: OOPS Specific Solutions Conclusions & Future Work
![Page 23: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/23.jpg)
Problem Areas
Errors & Ambiguity rejection errors target ambiguity
Mediation adding alternatives occlusion
![Page 24: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/24.jpg)
Rejection Errors
Problem: The user’s input is completely missed
![Page 25: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/25.jpg)
Rejection Errors
Problem: The user’s input is completely missed
Solution: Allow the user to tell the system
![Page 26: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/26.jpg)
Rejection Errors
Problem: The user’s input is completely missed
Solution: Allow the user to tell the system
Other applications: Substitution errors
![Page 27: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/27.jpg)
Rejection Errors
Problem: The user’s input is completely missed
Solution: Allow the user to tell the system
Other applications: Substitution errors Any spatial
recognition Requires extended
recognizer API
![Page 28: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/28.jpg)
Target Ambiguity
Problem: There may be multiple targets of a user action
Example: clicking
![Page 29: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/29.jpg)
Target Ambiguity
Problem: There may be multiple targets of a user action
Example: Clicking Solution: Give the
user a choice of all of the targets
![Page 30: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/30.jpg)
Target Ambiguity
Problem: There may be multiple targets of a user action
Example: Clicking Solution: Give the
user a choice of all of the targets
Other applications: Any interface
involving mouse press/release
Requires separation of concerns
Works with all interactors
![Page 31: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/31.jpg)
Occlusion
Problem: A mediator may obscure important information
![Page 32: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/32.jpg)
Occlusion
Problem: A mediator may obscure important information
Solution: Move that information into a more visible location
![Page 33: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/33.jpg)
Occlusion
Problem: A mediator may obscure important information
Solution: Move that information into a more visible location
Other applications: Any crowded
interface that uses an n-best list
Requires extensible mediators
Requires separation of concerns
![Page 34: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/34.jpg)
Adding alternatives
Problem: The correct choice isn’t always present
![Page 35: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/35.jpg)
Adding alternatives
Problem: The correct choice isn’t always present
Example: word-prediction
![Page 36: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/36.jpg)
Adding alternatives
Problem: The correct choice isn’t always present
Example: word-prediction
Solution: Allow the user to add choices
![Page 37: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/37.jpg)
Adding alternatives
Problem: The correct choice isn’t always present
Example: word-prediction
Solution: Allow the user to add choices
Other applications: Closely related
choices (e.g. URL prediction)
Requires extensible mediators
Benefits from recognizer API
![Page 38: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/38.jpg)
Outline
Motivation Definitions & Illustration Broad Solution: OOPS Specific Solutions Conclusions & Future Work
![Page 39: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/39.jpg)
Conclusions
Resolution of ambiguity in recognition through mediation
General toolkit architecture (CHI 00) flexible, re-usable support for mediation
separates recognition, mediation, and
applications allows exploration of design space
![Page 40: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/40.jpg)
Next Steps
Implicit input Sensed information about
environment Ambiguous output
Ambient displays Brain-computer interface
Ambiguous, limited, error-prone input
![Page 41: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/41.jpg)
500,000 people worldwide
Locked-In Syndrome
Disease, stroke, accident survivors Completely paraylzed Unable to speak Cognitively intact
![Page 42: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/42.jpg)
Brain-computer interface
Problem: locked-in syndrome No alternative modalities available Need for efficient error handling
Challenge: interpret brain signal in as rich a form as possible
![Page 43: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/43.jpg)
A new hope
Brain signals can be intercepted Implanted electrodes (Schwartz, Chapin et
al.) External sensors (Junker, Wolpaw,
Middendorf, Birbaumer et al., Spencer et al.)
Signals can be produced and controlled by imagined movements
Signals can be interpreted by a computer
![Page 44: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/44.jpg)
A Neurotrophic Electrode
Cone electrode invented in 1987 Animal studies showed it to be stable FDA permission given for human implantation in 1996
![Page 45: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/45.jpg)
Project Goals
High level: Recreate movement Restore communication Turn disability into ability
Low level: Intelligent Interpretation
![Page 46: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/46.jpg)
Recreating movement
Haptic feedbackMuscle stimulation Eventually re-connect nerves
![Page 47: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/47.jpg)
Restore Communication
A basic need
From virtual keyboards to word-prediction
![Page 48: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/48.jpg)
Turning disability into ability:
Supporting Creativity
Converting a the brain signal to music
Example
Two possible experiences Trying to play a piano with ones feet Having an artistic voice no one else can
reproduce
![Page 49: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/49.jpg)
Intelligent Interpretation
Signals are difficult to control Daily variability in signal Patient Endurance
Adaption necessary
![Page 50: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/50.jpg)
Intelligent Interpretation
Raw signal-> mouse Logical control Neural gestures
![Page 52: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/52.jpg)
Alternative Forms of Input
Cirrin (UIST 98) Locked-In Syndrome
(Brain-UI; Current) Cerebral Palsy
(Cursor Activity Recognition; Current)
![Page 53: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/53.jpg)
How general is “general”?
Two Toolkits Two complex applications Library of existing mediators Explorations of 4 problem areas
(UIST 00)
![Page 54: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/54.jpg)
Further generalization
Testing
![Page 55: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/55.jpg)
Further generalization
Testing Implicit input
(CT-OOPS; Current)
![Page 56: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/56.jpg)
Further generalization
Testing Implicit input Arbitrary input devices
![Page 57: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/57.jpg)
Further generalization
Testing Implicit input Arbitrary input devices Ambiguity
![Page 58: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/58.jpg)
Related Themes
Input Output
Ambient Displays (Ten Inch Pixels; 1999)
![Page 59: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/59.jpg)
Is subArctic doing the work here?
No, our minimal requirements are common in today’s toolkits: An event-based toolkit An input-handling module that delivers
events to the appropriate places A library of interactors/widgets Access to source code (OOPS is not just
a library!)
![Page 60: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/60.jpg)
Recognizer
Definition: something that interprets user input generally has a domain (of input) and a
range (of output)
Examples: DragonDictate (speech to text) GDT (strokes to gestures)
Problem areas: Support for correction of errors
![Page 61: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/61.jpg)
Error Definition:
a mistaken interpretation (from the user’s perspective)
Examples: substitution rejection insertion
Problem areas: rejection
![Page 62: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/62.jpg)
Mediation
Definition: a dialogue
between the user and application used to determine the correct interpretation
Problem areas Occlusion Wrong choices
Examples:
![Page 63: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/63.jpg)
Ambiguity Definition
A case where there is more than one potentially correct interpretation of the user’s input
Problem areas target ambiguity
Examples target ambiguity segmentation
ambiguity recognition
ambiguity
![Page 64: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/64.jpg)
Future Work
Testing Implicit input Arbitrary input devices Ambiguity
![Page 65: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/65.jpg)
Conclusions
The problem areas are not intractable
Toolkit-level support allows us to explore them
OOPS allows us to build general, re-usable solutions
![Page 66: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/66.jpg)
Other thesis results
Survey of mediation techniques found in existing interfaces to recognition systems
Two implementations of our architecture
![Page 67: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/67.jpg)
Comparing SILK and Burlap
SI LK BURLAP
Modes Four One Combined
Only Draw Mode ThroughoutMediationSeparate Window I ntegrated
![Page 68: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/68.jpg)
Comparing SILK and Burlap
SI LK BURLAP
Modes Four One Combined
Only Draw Mode ThroughoutMediationSeparate Window I ntegrated
Editing Yes No
Storyboarding Yes No
![Page 69: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/69.jpg)
Architectural support
architecture
interactors
interface
application
Input handler
![Page 70: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/70.jpg)
inters
OOPS Architecture
architecture
interactors
interface
application
recognizers
Input handler
meds
application
interface
stroke
downdrag up• • • • • •
sc
stroke
downdrag up• • • • • •
s
![Page 71: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/71.jpg)
Big Picture
1/5 People have disabilities Everyone has temporary
disabilities Computers can help to overcome
disabilities… … or make them worse
![Page 72: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/72.jpg)
Modified Event Dispatch
1. A sensed event arrives 2a. It is dispatched to all
unambiguous components2b. It is dispatched to all recognizers3. It is mediated4. Any accepted leaf nodes are
dispatched to all unambiguous components
![Page 73: Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces](https://reader031.vdocuments.net/reader031/viewer/2022013101/568143d0550346895db05db1/html5/thumbnails/73.jpg)
Comparison with GUI
event event
interactors
interface
application
Input handler
recognizers meds
application
interface
Input handler
inter
recognizers mediators