INTERACTION AND INTERFACES

From Physical Objects to Data

Javier Pereda // Web Science DTC@TrinkerMedia

Masterclass Multimodal Engagements with Cultural Heritage

INTERACTIVITY AND INTERFACES

• What is an interface• The evolution of interfaces• Natural and new interfaces• Interfaces and the Web• Exploration and the use of data• Internet of Things (IoT)

WHAT IS AN INTERFACE?ø Wikimedia Commons

CLOAKED COMPLEXITY

CLOAKED COMPLEXITYø Rube Goldberg

THE INTERFACE

• A way of interacting with a system

• How do we get things into the system and how do we manipulate them

• How do we get other people to do what is needed?

• Technologic issues?

ANALOGUE INTERFACEø Wikimedia Commons

DIGITAL INTERFACESCOMPUTING

ø Wikimedia Commons

COMMAND-LINE INTERFACEø CodeProject

commandLineVideo

TEXT-MENU INTERFACEø CodeProject

TextMenuVideo

GRAPHIC USER INTERFACEø CodeProject

(GUI)

THE USE OF METAPHORSø CSSauthor

NATURAL USER INTERFACEø Microsoft

NUIvideo

NATURAL USER INTERFACEø WikimediaCommons

Multi-sensory InterfaceHuman Like Interaction

Biometric Interaction Invisible Computing

MULTI-SENSORYø Apple

GesturesVideo

BIOMETRICø GoCollective.com

HUMAN-LIKEø inc.ucds.edu

INVISIBLE COMPUTINGø Turbosquid

INTERACTION METHODS

ø Turbosquid

GRAPHIC USER INTERFACES

(GUI)

TANGIBLE USER INTERFACES

(TUI)

TANGIBLE USER INTERFACESFRAMEWORK

TANGIBLEMANIPULATION

SPATIALINTERACTION

EMBODIEDFACILITATION

EXPRESSIVEREPRESENTATION

TOUCHHAPTIC

DIRECT MANIPULATION

SPATIALBODY

BEHAVIOURSOCIAL

PLACE SPECIFICSPATIAL CONFIGURATION

EXPRESSIVEMEANING

REPRESENTATIONSSIGNIFICANCECAUSE-EFFECT

ø Xiangyu ø Syllaø WebMediaMIT.eduø Oriboo // MIT

TANGIBLE USER INTERFACES

ø Reactivision//Reactable

(TUI)

COMPUTER VISION

INTERACTING WITH DATA

ø DIKW Model Wikimedia//Wikipedia

Ackoff, DIKW Model

INTERACTING WITH DATA

INTERACTING WITH DATA

CULTURAL HERITAGE EXAMPLE

INTERACTING WITH DATA

DATA & METADATA

INTERACTING WITH DATA

ø WordHoard Project

INTERACTING WITH DATA

ø MandalaBrowser

INTERACTING WITH DATA

ø DeityCollector @Trinkermedia

The Deity Collector

INTERACTING WITH DATA

ø DeityCollector @Trinkermedia

The Deity CollectorInteraction methods

THE INTERNET OF THINGS(IOT)

ø SilliconLabs

EVERYTHING INTERACTS!

ø pngImg.com

@TrinkerMedia

Thank you.