the build-it story prof. dr. matthias rauterberg faculty industrial design tu/e eindhoven university...

The Build-It Story

Prof. dr. Matthias RauterbergFaculty Industrial Design

TU/e Eindhoven University of Technology

© M. Rauterberg, TU/e

The Digital Desk from Pierre Wellner in 1991

Pierre Wellner

The DigitalDesk is built around an ordinary physical desk and can be used as such, but it has extra capabilities. A video camera is mounted above the desk, pointing down at the work surface. This camera's output is fed through a system that can detect where the user is pointing (using an LED-tipped pen) and it can recognise the documents that are placed on it. The more advanced version also has a computer-driven projector mounted above the desk enabling electronic objects to be projected onto real paper documents -- removing the burden of having to switch attention between screen and paper and allowing additional user-interaction techniques. [invented and built by Pierre Wellner, Xerox EuroPARC]

Video clip

© M. Rauterberg, TU/e

• Perception Space– The physical space where

the user’s attention is.

• Action Space– The physical space where

the user acts in.

• Design Principle:– perception space and action

space must coincide!

What is design relevant knowledge?

© M. Rauterberg, TU/e

Airline Applications

• This remarkable ultra-lightweight computer, worn as a belt, delivers maximum information to users with a minimum of work.

• Designed for individuals who demand mobility, this computer offers voice control and heads up display for complete, hands-free operation.

• Users can enter or retrieve information while going about their jobs, instead of constantly returning to the shop area to check a stationary computer, or stopping work to punch keys.

© M. Rauterberg, TU/e

Head-up Displays in Cars

• More information and less distractionInformation on the state of the road, on the speed of the vehicle in front (supplied by the intelligent cruise control), on obstacles lying around the next bend in the road identified by the remote detection system, or direction arrows sent by the driver guidance system... drivers will be receiving more and more information from "intelligent" vehicle systems.

© M. Rauterberg, TU/e

Natural User Interfaces (NUI)

No technical equipment inside the body space of the user!

2. design requirement

Perception space and action space must coincide!

1. design requirement

© M. Rauterberg, TU/e

NUI: The First Round

Design principle

Field test

Digital Playing Desk

© M. Rauterberg, TU/e

Command Interface (CI)

Video clip

© M. Rauterberg, TU/e

Mouse Interface (MI)

Video clip

© M. Rauterberg, TU/e

Touch-screen Interface (TI)

Video clip

© M. Rauterberg, TU/e

Digital Playing Desk (DPD)

Video clip

© M. Rauterberg, TU/e

User Studies with the DPD

Video clip

© M. Rauterberg, TU/e

0

50

100

150

200

250

300

350

400

450

500

Cel

l Me

an f

or

time

of

use

r (s

)Cell Line Chart for "playing time"

Grouping Variable(s): Interface type

Error Bars: ± 1 Standard Deviation(s)

CI MI TI DPD

P<.001P<.01P<.001

P<.001

P<.001

P<.001

Empirical Results: Playing time per game

© M. Rauterberg, TU/e

computer win

remis

user win Cell Line Chart for "winning chance"

Grouping Variable(s): Interface type

Error Bars: ± 1 Standard Deviation(s)

CI MI TI DPD

P<.001P<.080P<.020

P<.802

P<.001

P<.007

Empirical Results : winning chance per dialog technique

© M. Rauterberg, TU/e

GUI versus NUI interaction models

model

control view

INPUT OUTPUT

physical

digitalmodel

control Non graspablerepresentation

graspablerepresentation

INPUT / OUTPUT

© M. Rauterberg, TU/e

NUI: The Second Round

Experiments

Build-It systems

Design principle

© M. Rauterberg, TU/e

The Build-It Systemfrom M. Bichsel, M. Fjeld & M. Rauterberg 1997

Video clip

© M. Rauterberg, TU/e

18th Century: tool productionThe Build-It Tools

© M. Rauterberg, TU/e

Past and Future Developments• Patent pending

• Spin-off company TELLWARE founded in October 1997

• First brick-based planning systems on the market since 1998

• Winner of the Swiss Technology Award 1998

CeBIT ‘98