extend material design with mobile sensors

Extend Material Design with mobile sensors

Claudio Capobiancoc.capobianco@snapback.io

GDG Milano - December 17, 2014@TAG Milano

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Devices keep evolving...

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Interfaces don’t

still merely based on touch and sight

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Why?user behavior is difficult to predict or model real world is non-deterministicphones were not created to interact with the environment

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

TouchIMUALSKeys…………

ScreenVibraz.LEDsSpeaker

DedicatedChip

SensorHub

OS

Apps

OutputStackInputs

Full-stack - fragmentation everywhere

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Focus: HW Sensors

how many sensors?

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Focus: HW Sensors2 microphones2 cameras3 physical keysaccelerometergyroscopecompassproximity+ambient lightpressure(battery temperature)(Hall sensor)… tot 13+2

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Focus: AOSP Stack

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Design could be the limit

Procrustes: developers must fit the design

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Promote “exaptation”

“Exaptation: A character previously shaped by natural selection for a particular function, is coopted for a new use”Gould & Vrba 1982

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Focus: Virtual SensorsSIGNIFICANT_MOTIONORIENTATIONPROXIMITYACCELEROMETERROTATION VECTORGEOMAGNETIC_ROT_VECPEDESTRIAN_ACTVITY_MONMAGNETIC_FIELD_UNCALIBLINEAR ACCELERATIONTILTBASIC_GESTURES… tot 26

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Focus: Virtual Sensors25 SENSOR_TYPES_*documented in sensor.h

actually lot more

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Travel first-class

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Smartphone as a Stargate

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Focus: ActuatorsscreenvibrationLED indicatorflash (torch)ear speakerloud speaker

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Focus: Actuators

screenvibrationLED indicatorflash (torch)ear speaker

loud speaker

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Material Design

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Material Design - principles

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Material Design - contradiction

user tapsbut the card is lifted

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Touchscreen draw us to him

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

ROM & CO - Lollipop“And a whole lot more[...]Where supported by the hardware, your device will wake up as soon as you pick it up or tap the screen twice”

from http://www.android.com/versions/lollipop-5-0/

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

ROM & CO - Slimkat

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

ROM & CO - moreCyanogenmodwrite on screen off, flip to turn off the ringerParanoid Androidmove to show notificationHazyproximity to turn on the phone

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

ROM & CO - manufacturers

LG - Knock On Samsung - a lot of gesturesLumia - in-call gesturesAmazon - should be a killing feature……...

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Promote “exaptation” - example

Open Signal &Mobile Sensor Database

www.opensignal.org/sensors

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Exaptive apps

Weather Signal

Emotion Sense

Occupational Safety

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Let’s coding!

1 - autumn breeze2 - siberian interaction

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Recap - reach new markets

reach new users, in context where competitors can not arrive

create new user experiences, especially for games

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Recap - the value of the fragmentation

experiment on many devices

Sony Z1 - underwater Nexus 5 - developersSamsung - more sensorsetc...

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Snapback

“Revolutionary Interfaces for Mobile Computing Devices”

based in Rome (LUISS EnLabs, Ericsson)soon in Trento (TeckPeaks)from January in US!

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Snapback SDK

a framework to experiment on new ways of interacting

simplify the creation of new virtual sensors

for now available as user library

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Bibliografia

Snapback - www.mksens.comGarret Smith - Software as Biology Gould & Vrba - ExaptationOpen Signal - www.opensignal.org/sensors

Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - info@snapback.io - 2014 © Copyright reserved

Bibliografia - Google

Google Material Design - IntroductionAndroid Source - SensorsAndroid Developer - Sensors OverviewGoogle I/O 2012 - The Sensitive Side of Android

Thank you!Claudio Capobianco

c.capobianco@snapback.io+39 328 8995513www.snapback.io