mobile technologies - lmu medieninformatik · mobile technologies 1 context and task ... –brain...
TRANSCRIPT
![Page 1: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/1.jpg)
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Mobile Technologies
1
context and task
theory
interaction techniques
in/output technologies
Thursday 27 November 14
![Page 2: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/2.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Sensors• gyroscope• accelerometer• magnetometer
• always available mobile input– SixthSense project– EMG (Skinput)
2Thursday 27 November 14
![Page 3: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/3.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
SixthSense Project• vision-based approach for always available
input
3
https://www.youtube.com/watch?v=JnxGUPzP_U0
Literature: Mistry, P. : Wear Ur World - A Wearable Gestural Interface, CHI 2009
Thursday 27 November 14
![Page 4: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/4.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Biosensors• signals traditionally used for diagnostic
medicine– emotional state: heart rate, skin resistance– brain sensing technology cognitive and emotional
state (BCI - brain computer interaction): • electrocephalography (EEG)• functional near-infrared spectroscopy (fNIR)
– signals generated by muscle activation• electromyography (EMG)• bone conduction
– sound frequencies propagate well through bone
4Thursday 27 November 14
![Page 5: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/5.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Brain-Computer Interfaces
5
contact [email protected]
Thursday 27 November 14
![Page 6: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/6.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
The *annoyingly* talking window
6
https://www.youtube.com/watch?v=azwL5eoE5aI
Thursday 27 November 14
![Page 7: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/7.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Skinput• Bio-sensing approach
– leverages natural acoustic conduction properties of the human body
7
https://www.youtube.com/watch?v=g3XPUdW9Ryg
Thursday 27 November 14
![Page 8: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/8.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Head-Mounted Display• Principles
– closed HMD– VR with HMD– AR with see-through
• video• optical
– google glasses
• Head-up Displays with head tracking
• oculus rift
8Thursday 27 November 14
![Page 9: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/9.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Google Glasses• c
Ivan Sutherland, 1968
http://louislau91.files.wordpress.com/2013/06/sword_of_damocles.jpeg
Google glasses and augmented reality
http://www.tomsguide.com/us/google-glass,news-17711.html
9Thursday 27 November 14
![Page 10: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/10.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Principle: closed (video only) HMD• Monitor is mounted very close to the eye• Additional lens makes it appear distant• è all images appear at the same distance
– Usually at infinity or slightly less
10Thursday 27 November 14
![Page 11: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/11.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Creating VR with a HMD
Rendering Headtracker
3D scene
11Thursday 27 November 14
![Page 12: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/12.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Challenges with HMDs in VR• Lag and jitter between head motion and
motion of the 3D scene– Due to tracking à predictive tracking– Due to rendering à nowadays mostly irrelevant
• Leads to different motion cues from– Eye (delayed) and– Vestibular system (not delayed)
• Result: cyber sickness
12Thursday 27 November 14
![Page 13: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/13.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Oculus Rift• costom-built motion and orientation sensor
unit– gyroscope– accelerometer– magnetometer
• head tracking with 3 degrees of freedom
13
http://static3.businessinsider.com/image/51d1949aecad04ad3e000000/heres-what-happened-when-we-strapped-a-bunch-of-people-into-the-oculus-rift-virtual-reality-headset.jpg
Thursday 27 November 14
![Page 14: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/14.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Creating AR with video see-through HMDs
Rendering Headtracker
3D scene
VideoMixing
Parallax error
14Thursday 27 November 14
![Page 15: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/15.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Advantages of video-based see-through• Lag between physical and virtual image
can be compensated• Camera can be used for tracking as well
–Physical image = raw tracking data–Perfect registration possible
• Video mixer can add or subtract light–Virtual objects can be drawn in black–Physical objects can be substituted–Virtual objects can be behind physical
objects• Just one image with a given focus
distance
15Thursday 27 November 14
![Page 16: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/16.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Challenges of video-based see-through• Lag between physical and virtual image
can be compensated–…by delaying the physical image– Leads back to the cyber sickness problem
• Parallax error can not be corrected electronically– Wrong stereo cues when used for stereo
• Richness of the world is lost– Video image just 0.5 megapixels– Resolution of human vision is much higher (>10x)
16Thursday 27 November 14
![Page 17: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/17.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Creating AR with optical see-through HMDs
Rendering Headtracker
3D scene
17Thursday 27 November 14
![Page 18: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/18.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Advantages of optical see-through HMDs• Preserve the richness of the world
– Very high resolution of physical image– No lag between motion and phys. image– Physical objects can be focused at their correct
distance
• Limitations:– can only add light, i.e. not cover things– lag of digital image very noticeable
18Thursday 27 November 14
![Page 19: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/19.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Example: Google glass
19
http://www.youtube.com/watch?v=Ee5JzKbOAaw
Thursday 27 November 14
![Page 20: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/20.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Creating AR with Head-up Displays (HUDs)
Rendering Headtracker
3D scene
20Thursday 27 November 14
![Page 21: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/21.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Head-Up Display with 3D registration• Currently mostly military use• Fixed Display• Very exact head or eye tracking needed
– Easy for jet pilots
• High brightness and dynamics needed
21Thursday 27 November 14
![Page 22: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/22.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
HUD without 3D registration• Optional Equipment in premium cars
(image source: www.bmw.ch)• easy: no tracking needed! -> not AR!
22Thursday 27 November 14
![Page 23: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/23.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
HUD app for iPhone• can be bought from app
store• put iPhone under wind
shield• uses GPS and accell
sensors to sense car motion
• can display speed, heading, ...
23Thursday 27 November 14
![Page 24: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/24.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Fabrication, know your tools...• know your tools...• further development of
– Laser-cutting– 3D printing
24Thursday 27 November 14
![Page 25: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/25.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Laser Origami
• laser cut objects without assembling...
https://www.youtube.com/watch?v=arjRtCjI9AQLiterature: Müller, S. : Laserorigami: Laser-cutting 3D Objects, CHI 2013
25Thursday 27 November 14
![Page 26: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/26.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
WirePrint
https://www.youtube.com/watch?v=Ea4V7kb2VsY
Literature: Müller, S. : WirePrint:3D Printed Previews for Fast Prototyping, UIST 2014
26Thursday 27 November 14
![Page 27: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/27.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
3Doodler
• next step to 3D printing... 3D sketching
https://www.youtube.com/watch?v=DQWyhezIze4
27Thursday 27 November 14
![Page 28: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/28.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Teach and Learn...• Goal: support creative activities of children
using educational toys.– tangibles– programming by demonstration concept
28Thursday 27 November 14
![Page 29: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/29.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Sifteo Cubes
https://www.youtube.com/watch?v=fEqq8JykQoQ
Literature: Merrill, D. : Sifteo Cubes, CHI 201229
Thursday 27 November 14
![Page 30: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/30.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Programming by
Topobo Systemhttps://www.youtube.com/watch?v=50JdK_K2NWk
Literatur: Raffle, H. : Topobo: a constructive assembly system with kinetic memory, CHI 2004
30Thursday 27 November 14
![Page 31: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/31.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Squishy Circuits
Literatur: Johnson, S. : Squishy circuits: A tangible medium for electronics education, CHI 201031
Thursday 27 November 14
![Page 32: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/32.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Shape changing displays• MorePhone: flexible displays
– using shape deformation as its primary means of both haptic and visual notifications
– use OLED and shape changing alloy wires
32Thursday 27 November 14
![Page 33: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/33.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
MorePhone
33
Literatur: Gomes, A. : MorePhone: An Actuated Shape Changing Flexible Smartphone, CHI 2013
Thursday 27 November 14
![Page 34: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/34.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide 34
OLED - organic light-emitting diode• applied: PDAs, photo-camera, phones• elements: two electrodes (one of them
transparent), layer of OLED-material• idea:• ‘+’: thin construction allows fabrication of
flexible displays on e.g. plastic foil, no backlight, higher contrast ratio
• ‘-’: not all colors shine with same efficiency, on-going research on optimum OLED-materials
http://www.igm.uni-stuttgart.de/forschung/arbeitsgebiete/oled/index.en.htmlhttp://www.blogcdn.com/www.engadget.com/media/2009/01/sony-oled-top002.jpg
Thursday 27 November 14
![Page 35: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/35.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Shape Memory alloy wires• shape memory effect
– jumps back into ‘programmed shape’ when heat energy is applied
• two-way shape memory effect– springs into other shape when cooled down.
35https://www.youtube.com/watch?v=JKBM9my5eOA
Thursday 27 November 14
![Page 36: Mobile Technologies - LMU Medieninformatik · Mobile Technologies 1 context and task ... –brain sensing technology cognitive and emotional ... Skinput • Bio-sensing approach](https://reader030.vdocuments.net/reader030/viewer/2022021706/5b8293467f8b9ae97b8eb7ad/html5/thumbnails/36.jpg)
Mobile
context and task
theory
interaction techniques
in/output technologies
sensors
HMD
fabrication
teaching
shape-changing
mobile projection
LMU München — Medieninformatik — Andreas Butz, Julie Wagner — !Mensch-Maschine-Interaktion II — WS2014/15 Slide
Shape Memory alloy wires• Flexinol muscle wire
– simple to hook up to a circuit– get inspired by the field of robotics (e.g. artificial
muscles)
36
https://www.youtube.com/watch?v=VfOsPAkvOd0
Thursday 27 November 14