input (touch v.s in air gesture)
DESCRIPTION
TRANSCRIPT
InputTouch v.s In-air gesture
MouseState-transition model
Idle Tracking Active
sliding mouse on tablemouse in-air move mouse on table
mouse placed on table
mouse lifted from table
button pressed
button released
TouchState-transition model
Idle Active
finger move in-air finger move on device
finger landed
finger lifted
No Tracking State!
TouchWhat's the problem?
preview to guide user toward right activity
feedback to reduce false-negative error
TouchSolution
1. Recreate logical tracking state
2. New UI not relying on tracking state
In-air GestureState-transition model
Active
body/finger move in air
Live MicAlways On!
In-air Gesture“clutch”Differentiate physical actions that are intended to drive the computing system from those that are not.
Mouse lift hand from mouse or lift mouse in airTouch lift hand from the digitizerIn-air gesture ?
In-air Gesture“clutch”Differentiate physical actions that are intended to drive the computing system from those that are not.
Mouse lift hand from mouse or lift mouse in airTouch lift hand from the digitizerIn-air gesture No Mechanism in the hardware false positive errors ++ false negative errors ++
In-air GestureSolution1. Reserved action
2. Reserved clutch
3. Multi-modal input
In-air GestureWhen suitable?
Interaction at a distance Hands are busy / dirtyPhysical limitation3D output