informal puis: no recognition required, at aaai 2002 workshop

24
Informal PUIs: No Recognition Required James Landay Jason Hong Scott Klemmer James Lin Mark Newman

Upload: jason-hong

Post on 16-Jul-2015

45 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Informal PUIs:No Recognition Required

James LandayJason HongScott KlemmerJames LinMark Newman

Page 2: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 2

WIMPy User Interfaces

• Windows, Icons, Menus, Pointer­ Hitting limitations of this kind of interface

• WIMP designed for limited audience­ Full use of eyes­ Literate­ Full use of hands

• WIMP designed for limited situations­ Fixed location (often offices)­ Sitting down­ Single person

Page 3: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 3

Perceptual User Interfaces

• PUIs leverage our innate perceptual, motor, and cognitive abilities­ Speech recognition, computer vision,

sketching, handwriting

• Sketching is one part of this bigger push • PUIs more useful for different audiences

and wider range of situations­ Mobile workers or Home­ Speech => Hands­free­ Location Tracking => Physical motion

Page 4: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 4

PUIs and Recognition

• Key question:­ When should perceptual input be recognized?

• Immediate recognition can interfere with creativity and communications

Page 5: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 5

Communication and Creativity

• Informal visual representation­ communicates “unfinished”­ encourages creativity­ faster to create­ higher level comments

• Formal visual representation­ communicates “finished”­ inhibits creativity (detailed)­ slower to create­ lower­level comments

Page 6: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 6

Informal User Interfaces

• Historic bias towards formal user interfaces­ Computation over creativity and communication­ Structured input to simplify computation

• Position:­ Recognition interferes with creativity and

communication due to errors and perception­ Recognition should be minimized or deferred

for these kinds of apps

Page 7: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 7

Informal User Interfaces

• Sketching• Speech• Handwriting

Page 8: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 8

Informal User Interfaces

• Sketching• Speech• Handwriting

Page 9: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 9

Slide

Landay (1996)

Page 10: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 10

Slide

Gross and Do (UIST96)

Page 11: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 11

Slide

Lin, Newman, Hong, Landay (CHI2000)

Page 12: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 12

DENIM Video

Page 13: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 13

Informal User Interfaces

• Sketching• Speech• Handwriting

Page 14: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 14

Slide

Stifelman, Arons, Schmandt (CHI2001)

Page 15: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 15

SUEDE:Informal Prototyping for Speech-based UIs

• Supports design practice- example scripts- Wizard of Oz- error simulation- iterative design

• Informal user interface- no speech recognition or

synthesis- need not be programming expert- fast & fluid design

Read my important

email

Page 16: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 16

Slide

Klemmer et al (UIST2000)

Page 17: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 17

SUEDE Video

Page 18: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 18

Informal User Interfaces

• Sketching• Speech• Handwriting

Page 19: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 19

NotePals:Informal Handwriting Capture

Davis et al (CHI99)

Page 20: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 20

NotePals:Informal Handwriting Capture

Page 21: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 21

Takeaway Ideas

• Perceptual user interfaces useful for more audiences and more places

• Informal User Interfaces valuable for PUIs­ Minimize or defer recognition­ Creative or communications­oriented tasks

• Informal User Interfaces can be applied to a range of perceptual input­ Sketching­ Speech­ Handwriting

Page 22: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Informal PUIs:No Recognition Required

James LandayJason HongScott KlemmerJames LinMark Newman

Page 23: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 23

Backup Slides

Page 24: Informal PUIs: No Recognition Required, at AAAI 2002 workshop

Mar 25 2001 24

Backup Slides

Igarashi, Edwards, LaMarca, and Mynatt (AVI2000)