Characteristics of Human receptors and effectors

Problems of Current Human machine interactions

Take advantages of human organs

Receptors: 10**9 bit/sec of information (Sight: 10**6 .. 10**8 bit/sec)

Effectors: 10**7 bit/sec of information

Humans World

Human has receptors (5 senses) and effectors with 100 billion neurons in total.

Eyes for seeing

Ears for hearing

Haptic

Tongue for tasting

Nasal for smelling

Audio organs for speaking

Hand/finger/body muscle motor systems

Commanding

(click, tap)

Text Input

(keyboard)

Pointing

(mouse, tap)

Voice become noises to

the others.

Voice doesn’t

keep privacy.

Seeing is 3D Current HMI

is 2D

Commanding

(click, tap)

Text Input

(keyboard)

Pointing

(mouse, tap)

Those are very simple operations. Finger dexterity is far beyond current HMI.

Finger is slower than

seeing.

Finger is slower than

speaking.

Real interaction is multi-modal.

• E.g., you look ahead while driving a car by hand/foot, and you can speak while driving.

Current HMI is uni-modal.

• Seeing for machine output

• Finger manipulation for machine input

Multi-modal, parallel process

Wearable monitor system

Gaze tracking (3D) as a pointing

method

Silent speech

Muscle or gesture

language +Finger-ware

Haptic, BMI, …?