extend material design with mobile sensors

Extend Material Design with mobile sensors

Claudio [email protected]

GDG Milano - December 17, 2014@TAG Milano

mailto:[email protected]


Snapback S.r.l. - Via G.Giolitti, 34, 00185 Rome, Italy - [email protected] - 2014 © Copyright reserved

Devices keep evolving...


Interfaces don’t

still merely based on touch and sight


Why?user behavior is difficult to predict or model real world is non-deterministicphones were not created to interact with the environment


TouchIMUALSKeys…………

ScreenVibraz.LEDsSpeaker

DedicatedChip

SensorHub

OS

Apps

OutputStackInputs

Full-stack - fragmentation everywhere


Focus: HW Sensors

how many sensors?


Focus: HW Sensors2 microphones2 cameras3 physical keysaccelerometergyroscopecompassproximity+ambient lightpressure(battery temperature)(Hall sensor)… tot 13+2


Focus: AOSP Stack

https://source.android.com/devices/sensors/sensor-stack.html


Design could be the limit

Procrustes: developers must fit the design


Promote “exaptation”

“Exaptation: A character previously shaped by natural selection for a particular function, is coopted for a new use”Gould & Vrba 1982


Focus: Virtual SensorsSIGNIFICANT_MOTIONORIENTATIONPROXIMITYACCELEROMETERROTATION VECTORGEOMAGNETIC_ROT_VECPEDESTRIAN_ACTVITY_MONMAGNETIC_FIELD_UNCALIBLINEAR ACCELERATIONTILTBASIC_GESTURES… tot 26


Focus: Virtual Sensors25 SENSOR_TYPES_*documented in sensor.h

actually lot more


Travel first-class

http://www.google.com/design/spec/material-design/introduction.html#


Smartphone as a Stargate


Focus: ActuatorsscreenvibrationLED indicatorflash (torch)ear speakerloud speaker


Focus: Actuators

screenvibrationLED indicatorflash (torch)ear speaker

loud speaker


Material Design

http://www.google.com/design/spec/material-design/introduction.html#


Material Design - principles


Material Design - contradiction

user tapsbut the card is lifted

http://www.google.com/design/spec/animation/responsive-interaction.html#responsive-interaction-user-input


Touchscreen draw us to him


ROM & CO - Lollipop“And a whole lot more[...]Where supported by the hardware, your device will wake up as soon as you pick it up or tap the screen twice”

from http://www.android.com/versions/lollipop-5-0/

http://www.android.com/versions/lollipop-5-0/


ROM & CO - Slimkat


ROM & CO - moreCyanogenmodwrite on screen off, flip to turn off the ringerParanoid Androidmove to show notificationHazyproximity to turn on the phone


ROM & CO - manufacturers

LG - Knock On Samsung - a lot of gesturesLumia - in-call gesturesAmazon - should be a killing feature……...


Promote “exaptation” - example

Open Signal &Mobile Sensor Database

www.opensignal.org/sensors

http://www.opensignal.org/sensors



Exaptive apps

Weather Signal

Emotion Sense

Occupational Safety


Let’s coding!

1 - autumn breeze2 - siberian interaction


Recap - reach new markets

reach new users, in context where competitors can not arrive

create new user experiences, especially for games


Recap - the value of the fragmentation

experiment on many devices

Sony Z1 - underwater Nexus 5 - developersSamsung - more sensorsetc...


Snapback

“Revolutionary Interfaces for Mobile Computing Devices”

based in Rome (LUISS EnLabs, Ericsson)soon in Trento (TeckPeaks)from January in US!


Snapback SDK

a framework to experiment on new ways of interacting

simplify the creation of new virtual sensors

for now available as user library


Bibliografia

Snapback - www.mksens.comGarret Smith - Software as Biology Gould & Vrba - ExaptationOpen Signal - www.opensignal.org/sensors

http://www.mksens.com

http://www.gar1t.com/blog/software-as-biology-rome.html

http://www2.hawaii.edu/~khayes/Journal_Club/fall2006/Gould_&_Vrb_1982_Paleobio.pdf



Bibliografia - Google

Google Material Design - IntroductionAndroid Source - SensorsAndroid Developer - Sensors OverviewGoogle I/O 2012 - The Sensitive Side of Android

http://www.google.com/design/spec/material-design/introduction.html

https://source.android.com/devices/sensors/index.html

https://developer.android.com/guide/topics/sensors/sensors_overview.html

https://developers.google.com/events/io/2012/sessions/gooio2012/108/

Thank you!Claudio Capobianco

[email protected]+39 328 8995513www.snapback.io



http://www.snapback.io

http://www.snapback.io

extend material design with mobile sensors

Mobile

copyright reserved focus

copyright reserved design

copyright reserved travel

copyright reserved smartphone

copyright reserved devices

environment snapback

tag milano snapback

aosp stack snapback