3 dimensional gestures

3 Dimensional Gestures Documented at Embedded Interaction Lab (EILab)

3D Gesture Documentation is an attempt to provide an overview of possible 3D gestures, which can be implemented in gestural user interfaces for variety of purposes. It highlights possible functionality associated with it. The functionalities given in this document are general purpose, it may vary with the context and its users It is gathered from existing literature and initial research activity (ongoing) on identi!cation of appropriate gestures for social acceptance in collaboration with IBM Research (India). This documentation is the !rst draft, which will further be updated at various stages and intimated

The document is divided into three major sections: •  Upper body gestures Gestures that involve upper body (above waist) •  Lower body gestures Gestures that involve lower body (below waist) •  Full body gestures Gestures that involve full body

These three categories are further sub divided into static gestures and dynmaic gestures. Static Gesture Static gestures are postures that does not take movements into account. For example, stop gesture can be performed to stop ongoing video. Posture of “palm facing” is detected to activate stop action, but the movement of hand is not considered.

These three categories are further sub divided into static gestures and dynmaic gestures. Dynamic Gesture Dynamic gestures are movements. Dynamics in a gesture provide a meaning, which are taken into consideration to activate an action. For example, in drag gesture, initial and last position of hand movement is interpreted to activate appropriate action

Upper body gestures Gestures that involve upper body (above waist)

Upper Body 3 Dimensional Gestures Static Gestures

Stare Narrowed eyes

Wink Wink with tilted neck (left/right)

Delete a choice; unlike a choice or provide alternative choices

Zoom-in a choice; maximize a choice; increase brightness of a system

Favourite a choice; select or con!rm a choice

Favourite choice on extreme side (right/left); select or con!rm a choice on extreme side (right/left)

Huh I Ponh (left)

Ponh (right) Tongue out

Remove favourite tag of a choice; provide alternative choice

Select or con!rm a choice on left side

Select or con!rm a choice on right side

Remove favourite tag of a choice; delete a choice; provide alternative choice


Head up Head down

Head sideways (left) Head sideways (right)

Scroll up; increase properties of a choice (e.g. Increase volume of a selected song)

Scroll down; decrease properties of a choice (e.g. Decrease volume of selected song)

Scroll left side Scroll right side


Head scratching Binocular

Call me Hands covering lips

Help required; provide clues for appropriate actions

Zoom-in a choice; increase resolution of screen

Call or connect to selected choice

Mute; decrease volume


Elbow bend Victory

Fist Thumbs up

Pause an ongoing activity

Select or con!rm a choice; favourite a choice

Grab and select or con!rm a choice

Increase properties of a function; favourite a choice


Thumbs down Salute

Hold Sshhh!!

Decrease properties of a function; remove favourite tag of a choice

Select or con!rm a choice; upgrade a choice to most priority contents

Select multiple choices together

Mute; decrease volume


Surprise Eat

Hands folded Stop

Help required; activate favorite choice

Select or con!rm food related choice

Pause; start a system Stop ongoing activity


Slap (fear) Perfect

Delete a choice; hide a choice


Palm upwards Palm downwards

Increase properties of a function; scroll up

Decrease properties of a function; scroll down


Shoot Think

Select or con!rm a choice; !re bullets in action games

Help required

Hook Hands behind ears

Select or con!rm a choice; tag a choice

Increase sound/volume of a selected choice


Yawn

Deselect a choice; provide alternative choice


Pinch in & Pinch out

Increase/decrease properties of a choice; majorly used in zoom in/out an image

Pak pakkapak

Dislike a choice; provide alternative choice

Upper Body 3 Dimensional Gestures Dynamic Gestures

Snapping

Select or con!rm a choice; !re bullets in action games

Driving

Controlling of car in car games


In-air tap

Select or con!rm a choice;

Both hands open & close (horizontal)

Increase/decrease properties of selected choice (e.g. Increase/decrease of a volume of selected song)


Both hands open & close (vertical)

Increase/decrease properties of selected choice (e.g. Increase/decrease of a volume of selected song)

Forward hand push

Select or con!rm a choice


Grab and drag

Grab a choice and drag it to desired place

Wave

Start the system; go back to main menu of a system


Swipe (left to right)

Horizontal scrolling of contents in left to right direction

Swipe (right to left)

Horizontal scrolling of contents in right to left direction


Punch

Delete a choice; in some cases, select a choice (e.g. punch to blast away your calories)

Yesss!!



Arey..suno

Pause ongoing activity

Swimming

Provide details of selected contents; zoom-in a choice


Cut-throat

Delete a choice; deselect a choice

Fist opening

Select or con!rm a choice to activate it


Swipe right hand (sideways)

Horizontal scrolling from left-right direction

Swipe left hand (sideways)

Horizontal scrolling from right to left direction


Grab and drag

Grab and drag a choice and move to drop


Spit

Delete a choice; dislike a choice; deselect a choice

Upper body movement (both sides)

Horizontal scrolling from left-to-right direction and vice versa


Head butt

Delete a choice

Head movement (only one time) like “Yes”

Select or con!rm a choice


Head movement (only one time) like “No”

Deselect a choice; delete a choice; remove choice from favourite tag


Lower body gestures Gestures that involve lower body (below waist) movements

Lower Body 3 Dimensional Gestures Static Gestures

Right leg upwards Left leg upwards

Left leg forward kick Right leg forward kick

Select or con!rm a choice on right side; horizontal scrolling from right side

Select or con!rm a choice on left side; horizontal scrolling from left side

Delete a choice; kick a choice; Select or con!rm a choice on lower left side; increase properties of a choice

Delete a choice; kick a choice; Select or con!rm a choice on lower right side; increase properties of a choice

Left leg backward Right leg backward

Jump Crossed legs

Select or con!rm a choice on left side; horizontal scrolling from left side; decrease properties of a choice

Select or con!rm a choice on right side; horizontal scrolling from right side; decrease properties of a choice

Select or con!rm your choice; increase properties of a choice



Bent ankle Toes upward

Right toe forward Right toe backward

Increase properties of a choice; select or con!rm a choice on left side; left forward scrolling; pause or stop ongoing activity

Pause ongoing activity; increase properties of a choice

Increase properties of a choice; select or con!rm a choice on right side; right forward scrolling

Decrease properties of a choice; select or con!rm a choice on right side; right backward scrolling


Sitting Crossed legs (right) - I

Crossed legs (left) - I Crossed legs (right) - II

Start a system Pause ongoing activity; activate favourite choices

Pause ongoing activity; activate favorite choices



Full body gestures Gestures that involve full body movement

Full Body 3 Dimensional Gestures Static Gestures

Stand – hands on waist Stand – hands on hips

Tired Huh

Pause ongoing activity; start a system; activate serious applications; return to default

Pause ongoing activity; stop ongoing activity

Dislike a choice; provide alternative choice

Dislike a choice; provide alternative choice; delete a choice; remove choice from favourite

Hands open & bend left/right

Hit

A step towards left/right

Bend forward

Obstruct moving objects

Delete a choice; stop ongoing activity; hit an object with a racket (e.g. Hitting a tennis ball)

View previous/next set of contents

Activate a choice; fast forward; move a choice forward


Bend left Bend right

Fly (left) Fly (right)

Select or con!rm a choice on left side; horizontal scroll on left

Select or con!rm a choice on right side; horizontal scroll on right

Select or con!rm a choice on left side; horizontal scroll on left

Select or con!rm a choice on right side; horizontal scroll on right


Squat Sitting on toes

Activate a choice; activate favourite choices

Start a system; activate favourite choices

Namaste

Start a system; activate a choice


Embedded Interaction Lab (EILab) Team Denny George, Mannu Amrit, Minal Jain and Keyur Sorathia A special thanks to Shreya Raina. Special mention: Moupiya Ukil and Amlan Abhinav

3 dimensional gestures

Documents

volumeupper body

downupper body

d gestures

upper body gesturesgestures

selected choiceupper

right sideupper body

alternative choiceupper

car gamesupper body