ubiquitous computing: beyond platforms, beyond screens...
TRANSCRIPT
![Page 1: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/1.jpg)
Ubiquitous Computing: Beyond platforms,
beyond screens; the invisible computer
Shwetak N. Patel
http://ubicomplab.cs.washington.edu/
![Page 2: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/2.jpg)
Shwetak N. Patel - University of Washington 2
![Page 3: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/3.jpg)
Shwetak N. Patel - University of Washington 3
Topics for Today
Review the history of ubiquitous computing (ubicomp)
Fundamental concepts
Important research themes
Ubicomp as an industry
![Page 4: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/4.jpg)
Ubiquitous Computing Fundamentals
Shwetak N. Patel - University of Washington 4
![Page 5: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/5.jpg)
Shwetak N. Patel - University of Washington 5
The Plateau
Time
Use
r Pro
duct
ivity
Batch
Command Line
WIMP (Windows)
1940s – 1950s 1980s - Present 1960s – 1970s
?
?
![Page 6: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/6.jpg)
Shwetak N. Patel - University of Washington 6
Paradigm: Ubiquitous Computing Person is no longer user of single device but
occupant of computationally-rich environment
Computers everywhere Desktops, laptops, tablets, mobile phones
Can no longer neglect macro-social aspects
![Page 7: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/7.jpg)
Shwetak N. Patel - University of Washington 7
Innovator: Mark Weiser
CTO of Xerox PARC
Introduced notion of “calm technology” It’s everywhere, but recedes quietly into
background
“The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.”
![Page 8: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/8.jpg)
Shwetak N. Patel - University of Washington 8
Ubiquitous Computing
Move beyond the desktop
Computing is embedded everywhere in the environment
Technology supports a task The task should be the focus…not the
technology
![Page 9: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/9.jpg)
9
Crucial Elements
Location “If a computer knows merely what room it is in, it
can adapt it behavior in significant ways without requiring even a hint artificial intelligence.”
Scale
“Ubiquitous computers will also come in different sizes, each suited to a particular task.”
Shwetak N. Patel - University of Washington
![Page 10: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/10.jpg)
10
Scales of devices
Tabs Inch scale
Pads Foot scale
Boards Yard scale
Shwetak N. Patel - University of Washington
![Page 11: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/11.jpg)
11
Already a Reality
Shwetak N. Patel - University of Washington
![Page 12: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/12.jpg)
12
Head Mounted Displays
Micro optical displays
Shwetak N. Patel - University of Washington
![Page 13: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/13.jpg)
13
Three Research Themes in Ubicomp
1. Automated capture and access
2. Context-awareness
3. Natural/Implicit interaction
Shwetak N. Patel - University of Washington
![Page 14: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/14.jpg)
14
1. Automated Capture
Motivation Record-taking is hard
Multiple streams of information need to be captured
Machines are better at some of these things than we are
Shwetak N. Patel - University of Washington
![Page 15: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/15.jpg)
15
Examples
Meeting capture (e.g. Weiser,Xerox PARC)
Classroom 2000
Shwetak N. Patel - University of Washington
![Page 16: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/16.jpg)
16
LiveBoard
Shwetak N. Patel - University of Washington
![Page 17: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/17.jpg)
17
Classroom 2000
Shwetak N. Patel - University of Washington
![Page 18: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/18.jpg)
18
2. Context-Aware Computing
Computing services sense the environment (location, user emotion,…) and tailor provided services
Walk into a meeting, phone is silenced
Requires sensor innovation Shwetak N. Patel - University of Washington
![Page 19: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/19.jpg)
19
Examples
Active Badge & PARCTab
Temperature adjusted automatically
Shwetak N. Patel - University of Washington
![Page 20: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/20.jpg)
Shwetak N. Patel - CSE 599U - Advanced Topics in Ubicomp 20
Sensing Techniques for Mobile Interaction
![Page 21: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/21.jpg)
Energy Monitoring
![Page 22: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/22.jpg)
22
Augmented Reality
Shwetak N. Patel - University of Washington
![Page 23: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/23.jpg)
23
The Georgia Tech Aware Home
Shwetak N. Patel - University of Washington
![Page 24: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/24.jpg)
24
3. Natural/Implicit Interfaces
Making computing interfaces more natural interaction tools Pen input
Speech
Gesture
Tangible interfaces
Shwetak N. Patel - University of Washington
![Page 25: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/25.jpg)
25
Examples
Pen applications
H. Ishii’s tangible UI work
Shwetak N. Patel - University of Washington
![Page 26: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/26.jpg)
26
Hollywood Visions
Shwetak N. Patel - University of Washington
![Page 27: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/27.jpg)
27
Ubicomp is…
Computing everywhere
Mobile computing
Wearable computing
Augmented reality
It is NOT virtual reality.
Shwetak N. Patel - University of Washington
![Page 28: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/28.jpg)
28
Dangling String
Shwetak N. Patel - University of Washington
![Page 29: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/29.jpg)
Shwetak N. Patel - University of Washington 29
Where are we now?
Machine learning
Cloud computing
Mobile computing is a given
New opportunities for designers
Lots of sensors
![Page 30: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/30.jpg)
Shwetak N. Patel - University of Washington 30
Environmental vs. Local Processing
Environmental Lower cost, lower power
Local Supports mobility
Privacy preserving
![Page 31: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/31.jpg)
31
Remaining Challenges
Ease of deployment/install
Security/privacy
Power
Engineering challenges At odds with traditional engineering practices
Shwetak N. Patel - University of Washington
![Page 32: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/32.jpg)
32
![Page 33: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/33.jpg)
33
Battery Trends
Shwetak N. Patel - University of Washington
![Page 34: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/34.jpg)
Low-power Wireless Sensing
![Page 35: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/35.jpg)
35
Power Harvesting
Mechanical Inertial/Motion-based Magnetic Inductive coupling RF power harvesting Thermoelectrics Piezoelectrics Resonator
Shwetak N. Patel - University of Washington
![Page 36: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/36.jpg)
Leverage Existing Sensors and Infrastructure
![Page 37: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/37.jpg)
Shwetak N. Patel - University of Washington 37
Home Health Mobile Health
![Page 38: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/38.jpg)
38
Smartphones
Shwetak N. Patel - University of Washington
![Page 39: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/39.jpg)
39
Internet of Things (IOT)
Shwetak N. Patel - University of Washington
![Page 40: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible](https://reader034.vdocuments.net/reader034/viewer/2022042800/5a731d727f8b9aa7538e4450/html5/thumbnails/40.jpg)
Shwetak N. Patel - University of Washington 40
Questions?
Thanks!