design for spatial user...

69
Design for Spatial User Interaction Milica Pavlovic Interaction&Experience Design Research Lab, Politecnico di MIlano Robotic Building, TU Delft, 27/10/2017

Upload: others

Post on 22-Sep-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Design for Spatial User Interaction

Milica PavlovicInteraction&Experience Design Research Lab, Politecnico di MIlano

Robotic Building, TU Delft, 27/10/2017

Page 2: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Interaction design is

“…the design of subjective and qualitativeaspects of everything that is both digital andinteractive, creating designs that are useful,desirable and acceptable.”

Moggridge, Bill. 2007. Designing interactions. Cambridge, Mass: MIT Press.

Page 3: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Saffer, Dan. 2009. Designing for Interaction: Creating Innovative Applications and Devices. New Riders.

Page 4: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

spatial design interaction design

Spatial User Interfaces (SUIs)

Natural User Interfaces (NUIs)

Tangible User Interfaces (TUIs)

Multimodal UIs

Mixed & Immersive Reality Interfaces

http://www.sui2017.org/http://tangible.media.mit.edu/Wigdor, Daniel & Wixon, Dennis. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. San Francisco: Morgan Kaufmann Publishers Inc.Sarter, Nadine, B. 2006. Multimodal information presentation: Design guidance and research challenges. International Journal of Industrial Ergonomics 36 , no. 5 (2006): 439--445.

Page 6: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Physical design

Digital design

Human and subjective Technical and objective

INDUSTRIAL DESIGN

GRAPHIC DESIGN

PHYSICAL ERGONOMICS

WEB DESIGN

INTERACTION DESIGN

H.C.I. HARDWARE ENGINEERING

SOFTWARE ENGINEERING

COMPUTER SCIENCES

MECHANICAL ENGINEERING

PRODUCTION ENGINEERING

PHYSICALSCIENCES

Moggridge, Bill. 2007. Designing interactions. Cambridge, Mass: MIT Press.

Page 7: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

SYSTEMSOF SPATIAL USER INTERACTION

Physical design

Digital design

Human and subjective Technical and objective

HARDWARE ENGINEERING

SOFTWARE ENGINEERING

COMPUTER SCIENCES

MECHANICAL ENGINEERING

PRODUCTION ENGINEERING

PHYSICALSCIENCES

Page 8: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

“Dualism is the anti-naturalist claim that the mind and the body are two separate and very different things. The two sorts are the non-physical and the physical.”

Westphal, Jonathan. 2016. The Mind-Body Problem. Cambridge, Mass: MIT Press Essential Knowledge.

apparent dualism

Page 9: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Merging the dualist parts through perception and experience

“There are as many spaces as there are distinct spatial experiences.”

Merleau-Ponty, Maurice. 1962. The Phenomenology of Perception. London and New York: Routledge.

Page 10: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

update based on Dan Saffer's diagram, KickerStudio

Page 11: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Don Norman: The term "UX"

UX within systems

Page 12: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Digital technologies are employed to create new user experiences that enhance and extend the way people work, communicate and interact.

Page 13: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Giving visibility to experience in architecture

Page 14: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

User experience can be observed within:

1-Diverse levels of reasoning about user requirements

2-Diverse action scaling perspectives

3-Diverse elements of the project

Page 15: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

User experience can be observed within:

1-Diverse levels of reasoning about user requirements

2-Diverse action scaling perspectives

3-Diverse elements of the project

Page 16: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

1-Diverse levels of reasoning about user requirements:

-Usability

-Values and meaningfulness

-Ethics

Page 17: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Usability

Floater by Manuel Kretzer and Mathias Bernhard

Page 18: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Values and meaningfulness

Agnelli Foundation headquarters by Carlo Ratti Associati

Page 19: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Ethics

picture taken from vanguardseattle.com

Page 20: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Ethics

Black Mirror science fiction series created by Charlie Brooker

Page 21: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

User experience can be observed within:

1-Diverse levels of reasoning about user requirements

2-Diverse action scaling perspectives

3-Diverse elements of the project

Page 22: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Erwin, Kim. 2013. Communicating The New: Methods to Shape and Accelerate Innovation. John Wiley & Sons Inc.

Page 23: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 24: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 25: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 26: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 27: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 28: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 29: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 30: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 31: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 32: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 33: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

User experience can be observed within:

1-Diverse levels of reasoning about user requirements

2-Diverse action scaling perspectives

3-Diverse elements of the project

Page 34: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Objectives

Scope

Structure

Skeleton

Surface

Elements of UX in Design for Systems of Spatial User Interaction

Based on Garrett, J. J. 2010. The Elements of User Experience: User-Centered Design for the Web and Beyond. New Riders.

Abstract

Concrete

Page 35: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Abstract

Concrete

Objectives

Scope

Structure

Skeleton

Surface

Elements of UX in Design for Systems of Spatial User Interaction

Analysis

Design

Page 36: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

picture taken from vimeo.com/120581837

How do we start?

Page 37: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Schematic thinking through mapping of activities

Parameters for mapping:activities through time, space, social relations, information flows

Page 38: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Real Time Rome - MIT Senseable City Lab

Live Singapore – MIT Senseable City Lab

Page 39: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Whose experience are we mapping?

for this task- your own

Objectives

Page 40: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Task: Video of activitiesObjectives

Page 42: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

“Storymapping is mapping out an intended experience ofuse just as you would a story- plot point by plot point.”

Task: Storymapping

Lichaw, D. 2016. The User’s Journey: Storymapping Products That People Love. Rosenfeld Media.

Scope

Page 43: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

The Five Obstructions - directed by Lars von Trier and Jorgen Leth –variation 1

The Five Obstructions - directed by Lars von Trier and Jorgen Leth –variation 4

Task: Storymapping- edit the video material for 2 min while summarizing your impressionsScope

Page 44: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

What is a journey?

A schematic way to represent in detail the elements of activities you want to design for.

Task: User JourneyStructure

Page 45: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed
Page 46: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Timeline

Sub-activities and considerations

Touchpoints

Phases

Enriched experience

Pain points

ImpressionsBaseline

Page 47: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Task: User JourneyStructure

v

v

Page 48: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Skeleton Task: Correspondent scheme of Zoning with Mapping of interactive elements

According to the points of interest defined within the timeline, you can define the elements you are going to influence in your design solution and set them within a spatial system scheme.

Page 49: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Identifying spatial parameters for mapping

Identifying phases of action and the correspondent zoning and spatial dimensions

Mapping active points and information flows

Skeleton Task: Correspondent scheme of Zoning with Mapping of interactive elements

Hyperbody MSc2 D2RP&O_DIA Group 2picture taken from ip.hyperbody.nl/index.php/Msc2G8:Group

Page 50: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Spatial ModelSurface

Layering and defining the form

Hyperbody MSc2 D2RP&O_DIA Group 2picture taken from ip.hyperbody.nl/index.php/Msc2G8:Group

Page 51: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Spatial ModelSurface

Definition of a physical shape

Definition of smart systems of sensors and actuators

Hyperbody MSc2 D2RP&O_DIA Group 2picture taken from ip.hyperbody.nl/index.php/Msc2G8:Group

Page 52: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Spatial ModelSurface

Hyperbody MSc2 D2RP&O_DIA Group 2picture taken from ip.hyperbody.nl/index.php/Msc2G8:Group

Page 53: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Systems of sensors and actuators

COMPUTER PROCESSING

ACTUATORS

SENSORS

Input/microcontroller board

Output/microcontroller board

Feedback loops

Page 54: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Sensors rely on chemical, mechanical and/or electrical properties to detect and measure changes in the physical environment. They convert information into digital or analog signals.

Page 55: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

What might you want to sense in your project

Temperature

Position/LocationWind

Smoke

Water flow

Humidity

Pressure

Color

Smell

Vibration

Air quality

ENVIRONMENT

Sound/Noise

Motion

Light

Proximity/Presence

Biological data/heart rate, sleep quality, bacteria, sweat…

Deformation

Eye tracking

BODY

Page 56: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

ENVIRONMENTBODY

Page 57: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Comfort, Safety, Assistance, Sustainability, Tracking, Social involvement, Provoking action… ?

What is the main objective

Page 58: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Choose your actuators according to which actions and senses you want to influence

Page 59: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

An actuator is a type of a motor that is responsible for moving or controlling a mechanism or system. Actuators can be hydraulic, pneumatic, electrical, thermal or magnetic, and mechanical.

Page 60: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Structure components, devices and/or material properties

Actuating through

In the following some examples

Page 61: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Structure components

Hylozoic Ground by Philip Beesley Architect at Venice Architecture Biennale

Page 62: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Hylozoic Ground by Philip Beesley Architect at Venice Architecture Biennale

Page 63: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

inFORM, Tangible Media Lab, MIT

Page 64: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Energy Floors - Piezoelectric-based energy harvesting

Nightclub is fitted with a ‘bouncing’ floor made of springs and a series of power generating blocks.

The blocks made from crystals produce small electrical current when squashed, a process known as piezoelectricity.

As dancers move up and down, the blocks are squeezed, current is fed into nearby batteries.

The batteries are constantly recharged by the movement of the floor, and used to power parts of the nightclub.

Page 65: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Devices

Peltier device- Thermoelectric coolers/heaters

Page 66: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Material properties

Hanabi, Nendo- Shape-memory alloy

Page 67: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Dye-sensitized solar cell

Page 68: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

Summary of the tasks for an action-driven design approach

Objectives Video of activities

Scope

Structure

Skeleton

Surface

Storymapping

User Journey

Scheme of Zoning with Mapping of interactive elements

Spatial Model

Page 69: Design for Spatial User Interactionuf.roboticbuilding.eu/images/4/4c/Pavlovic_27-10_Hyperbody.pdf · Giving visibility to experience in architecture. User experience can be observed

what kind of experience we want to provoke, what kind of a problem we want to solve

is this something that the user has an interest in interacting with

what might be happening in the longer period