Multi-interface gesture based organic modellingBradley Wesson

Overview

Background

Rationale

Development Issues

Testing

Conclusion and Future Work

Background – The problem

“Designers know more than they can say” (Schön, 1992)

“[creative interfaces] should capture users’ intended ambiguity, vagueness, and imprecision and convey these qualities visually and through interactive behavior” (Gross, 1996)

“computer models […] are typically considerably more difficult to create [than with pen and paper].” (Zeleznik, et al., 2006)

Background – Current solutions

ILoveSketch (Bae, Balakrishnan, & Singh, 2008)

FiberMesh (Nealen, Igarashi, Sorkine, and Alexa, 2007)

Project

Combine Kinect with Mobile for more natural interactions

Natural gestures

Virtual “tool”

Buttons and orientation sensing

Project – Interactions

Kinect Right hand for interactions

Clench fist to grab geometry

Both hands to reorient model

Left hand to change size

Kinect+Mobile Virtual tool

Physical button to grab geometry

Two fingers on screen to reorient

Left hand to change size

Project - Demo

Project – Mobile

Device orientation, buttons, touch screen

TCP connection over Ad Hoc network

Send 20 packets per second Prevent flooding network

1 01

0 1 0

Project – The model

Stored as voxels

Valve 0.5-depth threshold

Voxels “smudged”

Marching Cubes: A high resolution 3D surface construction algorithm (Lorensen & Cline, 1987)

Improved Alpha-tested Magnification for Vector Textures and Special Effects (Green, 2007)

Project – Rendering

Depth perception

Lighting, transparency

Issues

Trouble determining depth of interaction relative to geometry

Inaccuracies of mobile sensors make linear acceleration unreliable

Poor development platform choice

Translation

Acceleration

Velocity

Timeline

Testing

Thesis

Expo

Rslts Seminar

Mid-project

2012 2013

Ethics

Development

Lit Review

Proj Proposal

MayMarchJanuaryNovemberSeptemberJulyMayMach July

Timeline - Revised

Testing

Thesis

Expo

Rslts Seminar

Mid-project

2012 2013

Ethics

Development

Lit Review

Proj Proposal

MayMarchJanuaryNovemberSeptemberJulyMayMach July

C++ Prototype

C# Rebuild

XNA Port

Always finding new papers!

Testing / Measurements

Modelling a teapot

Measurements

Observation

Survey

NASA TLX

Evaluation

Quality of product

Speed of execution

Measured workload

Perceived ease of use

Perceived speed

Enjoyment

I’m not using that!

Conclusion

Development process

Accuracy

Built around creative expression

Multi-interface testing

Future work Implement Kalman filter for

linear acceleration

Painting and texture

Animation

Questions

?