TUI’s: design challenges

Matthias RauterbergDepartment Industrial Design

Technical University Eindhoven

2004

© 2004 M. Rauterberg 2/15

Our Research Approach

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

Validated DesignKnowledge

empiricalvalidation

Interactive systems

requirementsstatistics

assessmentcriteria

© 2004 M. Rauterberg 3/15

Trends in Interactive System Technology

Mobile computing

Ambient rooms and Cooperative buildings

Transport

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 4/15

Interaction ModelsUllmer & Ishii, 2000

model

control view

INPUT OUTPUT

physical

digitalmodel

control Non graspablerepresentation

graspablerepresentation

INPUT / OUTPUT

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 5/15

• Perception Space– The physical space

where the user’s attention is.

• Action Space– The physical space

where the user acts in.

• Design Principle:– perception space and action

space must coincide! [δ=0]– “Interlacing the display and

manipulation space” (Djajadiningrat, 1998, TU Delft)

Perception Space and Action Space

action space

perception space

δ

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 6/15

Architecture of a Natural User Interface (NUI)

Working Area

Communication & Working Area

Paper document

Electronic documents

Tognazzini B: Tog on Software Design. (1996)

Wellner P, Mackay W, Gold R: Computer-Augmented Environments: Back to the Real World. (1993)

Fitzmaurice G, Ishii H, Buxton W: Bricks-Laying the Foundations for Graspable User Interfaces. (1995)

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 7/15

Tangible User Interfaces (TUI)…

The Build-It SystemM. Bichsel, M. Fjeld & M. Rauterberg 1997

2D interaction:

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 8/15

Interaction Props: user study

Props design factors: form, size, material and metaphor:

An experiment was carried out to explore different design strategies.

Tasks were based on initial planning of an interior architecture.

Focus of the experiment was subjective opinion (n=12) about the bricks.

The bricks were ranked by user performance before (first number) and after (second number) task solving activity.

18th Century: tool production

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 9/15

The Build-It System: tangible props

2D

3.D

[design by Fred Voorhorst]

PhD Thesis (2001) from Morten Fjeld

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 10/15

2D Interaction Props

                                                                             

PhD Thesis (2003) from Dima Aliakseyeu

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 11/15

3D Interaction Props

PhD Thesis (2004) from Sriram Subramanian

RISP:Rigid Intersection Selection Prop

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 12/15

Different Prop Designs…

Ref: Napier (1956) classified grips into 2 different categories’precision grip’ and ’power grip’.

RISP Thumb RISP Power RISP Round

RISP := Rigid Inter-Section Prop

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 13/15

The Next Steps

• full-duplex audio connection

• additional interaction techniques, e.g. speech, handwritten input

• more 2 and 3D interaction possibilities

• video conferencing functionality for distributed cooperation

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 14/15

Future Directions…

Further research questions:? gaze/eye contact with remote partner

? variation of interface prop designs

? additional input technologies

? presence supported by full-duplex audio connection

And how to analyze human behavior in 2/3D space & time over a longer period?

Theory: 1 2 3 4 5 2D-Interaction: 1 2 3 4 3D-Interaction: 1 2 Future Directions: 1 2

© 2004 M. Rauterberg 15/15

Thank you for your attention.