understanding technology use in the home · – applying machine learning techniques. 2 ......
TRANSCRIPT
![Page 1: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/1.jpg)
1
The Berkeley Institute of Design
Understanding Technology use in the Home
Ryan AipperspachCS 160 Guest Lecture
November 22, [email protected]
The Berkeley Institute of Design
Outline
• Why study the home?• Ethnography in HCI• Case study
– Wireless laptop use and mobility
– Applying machine learning techniques
![Page 2: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/2.jpg)
2
The Berkeley Institute of Design
Why study the home?The home is a big market …
The Berkeley Institute of Design
Why study the home?
http://www.flickr.com/photos/oldtasty/285985/ http://www.flickr.com/photos/ratlhead/54983800/
… but it’s not the same as the office.
![Page 3: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/3.jpg)
3
The Berkeley Institute of Design
Why study the home?
• Domestic violence• Privacy• Work/Home Boundaries• Safety and Fear
And, the home environment is more sensitive.
I hardly sleep at night, as I know that they may come at any moment. Even that bit of sleep I get is a complete nightmare, full of frightening scenes with the police.
Miradije Aliu, in her bedroom, 1994. Melanie Friend
No Place Like Home: Echoes from Kosovo
The Berkeley Institute of Design
Why study the home?
• Previous research in domestic technology– Smart Homes (e.g. The
Adaptive House)– Children and Education
(e.g. Story Mat)– Elder Care (e.g. Digital
Family Portrait and Health Feedback Displays)
– Entertainment, TiVo, video games, etc.
![Page 4: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/4.jpg)
4
The Berkeley Institute of Design
Outline
• Why study the home?• Ethnography in HCI• Case study
– Wireless laptop use and mobility
– Applying machine learning techniques
The Berkeley Institute of Design
Ethnography in HCI
• Designing for the home (and mobile technologies, and education, and ...) is often about more than just optimizingtasks.– Which issues are most important to people?– What are the structures of relationships (e.g.
within a family)?– What unwritten rules and norms exist?
![Page 5: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/5.jpg)
5
The Berkeley Institute of Design
Ethnography and HCI• Traditional Ethnography
emerged in Anthropology studying “native”cultures– E.g. Geertz, C. Deep Play:
Notes on the Balinese Cockfight
• “Rapid” or “Design”Ethnography has been adopted in HCI– E.g. Salvador et al. Design
Ethnography
http://www.flickr.com/photos/casers/123802130/
The Berkeley Institute of Design
Outline
• Why study the home?• Ethnography in HCI• Case study
– Wireless laptop use and mobility
– Applying machine learning techniques
![Page 6: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/6.jpg)
6
Maps of Our Lives:Sensing People and Objects together in the Home
Ryan Aipperspach, Allison Woodruff, Ken Anderson,Ben Hooker
Intel Research,
UC Berkeley
Method Method and and InfrastructureInfrastructureLocation Data
Computer Usage LogsApplication UseKeyboard/Mouse ActivityBattery/AC Status
Television Status
Participant Interviews
![Page 7: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/7.jpg)
7
Method Method and and InfrastructureInfrastructureLocation Data
Computer Usage LogsApplication UseKeyboard/Mouse ActivityBattery/AC Status
Television Status
Participant Interviews
Method Method and and InfrastructureInfrastructureLocation Data
Computer Usage LogsApplication UseKeyboard/Mouse ActivityBattery/AC Status
Television Status
Participant Interviews
![Page 8: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/8.jpg)
8
Method Method and and InfrastructureInfrastructureLocation Data
Computer Usage LogsApplication UseKeyboard/Mouse ActivityBattery/AC Status
Television Status
Participant Interviews
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
![Page 9: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/9.jpg)
9
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
HH01Brad and JacquelineGraduate students from Australia
HH02Margaret and JackRecently married couple from England, Jack is a graduate student
HH03Mareesa, Carlo and JessicaMarried couple and 1-year-old daughter
HH04Sierra, Gaby and CarlotaFemale couple and housemate
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
Favorite PlacesMultiple visits per day11--3 places3 places per person (even in larger homes)Multifunctional
ComfortableComfortable and ErgonomicErgonomic places
Many positions within each favorite place
Activity PlacesMore per personMore specializedspecialized use
e.g. mirror for getting ready, kitchen counter, bathroom
![Page 10: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/10.jpg)
10
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
Thermal Maps
![Page 11: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/11.jpg)
11
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
![Page 12: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/12.jpg)
12
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
Laptops are portableportable, not mobilemobile, used primarily in comfortable and ergonomic favorite placesfavorite places
““RelaxingRelaxing””““TiredTired””
““WorkWork””books, books,
suppliessupplies
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
Leaving homePacking upClosing blindsChecking mailPrinting maps
Coming homeDroppingUnwinding
![Page 13: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/13.jpg)
13
Sunday Monday Tuesday Wednesday Thursday Friday Saturday
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/11/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/12/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/13/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/14/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/15/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/16/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/17/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/18/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/19/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/20/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/21/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/22/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/23/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/24/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/25/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/26/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/27/2005
0 12
3
4
5
6
7
8
910
11121314
15
16
17
18
19
20
2122
23
7/28/2005
Radial Plots
Radial Plots
Mouse
Keyboard
On / Off
![Page 14: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/14.jpg)
14
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
Leaving homePacking upClosing blindsChecking mailPrinting maps
Coming homeDroppingUnwinding
Study and Study and FindingsFindings
Study Participants
Favored Places
Laptop Locations
Departure from the Home
Social Laptop Use
SharingCollaborative UseTeachingTurning on the radio
Competition
FollowingTaking to the bedroomFollowing the baby
“Old Laptop” “New laptop”vs.
![Page 15: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/15.jpg)
15
“Moments in Time”
The Berkeley Institute of Design
Outline
• Why study the home?• Ethnography in HCI• Case study
– Wireless laptop use and mobility
– Applying machine learning techniques
![Page 16: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/16.jpg)
16
The Berkeley Institute of Design / Intel Research Berkeley+
A Quantitative Method for Revealing and Comparing Places in the Home
Ryan Aipperspach, TyeRattenbury, Allison Woodruff,
and John Canny
The Berkeley Institute of Design / Intel Research Berkeley+
Home 3, Cathy Home 3, Gaby
![Page 17: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/17.jpg)
17
The Berkeley Institute of Design / Intel Research Berkeley+
Big enough to be a place?Big enough to be a place?
Home 3, Cathy Home 3, Gaby
The Berkeley Institute of Design / Intel Research Berkeley+
Big enough to be a place?Big enough to be a place?
Home 3, Cathy Home 3, Gaby
![Page 18: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/18.jpg)
18
The Berkeley Institute of Design / Intel Research Berkeley+
One or two places?One or two places?
Home 3, Cathy Home 3, Gaby
The Berkeley Institute of Design / Intel Research Berkeley+
If these are different places, what are they called?
If these are different places, what are they called?
“Left half of the couch”?“Left half of the couch”?
“Right half of the couch”?“Right half of the couch”?
Home 3, Cathy Home 3, Gaby
![Page 19: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/19.jpg)
19
The Berkeley Institute of Design / Intel Research Berkeley+
Couch
Table???
Defining place
• Are there “correct” places in the home?– “Ground truth” is difficult for
finding places in the home– Different participants have
different interpretations of place
• Can people keep track of every time they change place?
• Motivate a place finding algorithm with a theoretical definition of place
Couch
Home 1
The Berkeley Institute of Design / Intel Research Berkeley+
Defining place (Our definition)
• Attributes relating to physical configuration (e.g. location)– Positions of people– Walls and furniture
• Attributes relating to historical use (e.g. place)– Distribution of time spent in
a location– Activity patterns– Co-presence patterns
[Harrison and Dourish 96] define place and highlight the difference between location and place
We operationalize this definition along two axes
![Page 20: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/20.jpg)
20
The Berkeley Institute of Design / Intel Research Berkeley+
AlgorithmSee Ryan Aipperspach, Tye Rattenbury, Allison Woodruff, and John Canny. “A Quantitative Method for Revealing and Comparing Places in the Home.” in Proc. Ubicomp 2006, Orange County, CA.
The Berkeley Institute of Design / Intel Research Berkeley+
Results – “Normative places”
• Many significant locations fit with stereotypes about homes
(Locations found by our algorithm were manually labeled based on interview data)
Home 3, CathyHome 3, Sierra
![Page 21: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/21.jpg)
21
The Berkeley Institute of Design / Intel Research Berkeley+
Is everything normative?
• Which normative places are used?– Consider sub-room
places– Which roles are
shown to the right?
• And, there are some surprises…
Home 3, CathyHome 3, Sierra
The Berkeley Institute of Design / Intel Research Berkeley+
Is everything normative?
• Which normative places are used?– Consider sub-room
places– Which roles are
shown to the right?
• And, there are some surprises…
Home 3, CathyHome 3, Sierra
![Page 22: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/22.jpg)
22
The Berkeley Institute of Design / Intel Research Berkeley+
Is everything normative?
• Which normative places are used?– Consider sub-room
places– Which roles are
shown to the right?
• And, there are some surprises…
Home 3, CathyHome 3, Sierra
The Berkeley Institute of Design / Intel Research Berkeley+
Is everything normative?RenterRenterOwnerOwner
• Which normative places are used?– Consider sub-room
places– The owner goes
more places than the renter
• And, there are some surprises…
![Page 23: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/23.jpg)
23
The Berkeley Institute of Design / Intel Research Berkeley+
Results – “Unexpected Places”
• Overlapping places: “Moving around place”– Extended periods using
a larger region as a single place
– E.g. at a party
• “Deep Couch” place• Ant farm and Exercise
places in an “empty room”
Home 1
The Berkeley Institute of Design / Intel Research Berkeley+
Results – “Unexpected Places”
• Overlapping places: “Moving around place”– Extended periods using
a larger region as a single place
– E.g. at a party
• “Deep Couch” place• Ant farm and Exercise
places in an “empty room”
Home 1
MovingAround
CouchKitchenTable
![Page 24: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/24.jpg)
24
The Berkeley Institute of Design / Intel Research Berkeley+
Summary• The home is a difficult
domain to study, but it’s a very promising space for technology.
• Techniques like ethnography can help.
• Examples of using ethnography, sensors, and data-mining to explore laptop and space use in the home.
• Questions?
The Berkeley Institute of Design
References and Links• The Adaptive House:
– http://www.cs.colorado.edu/~mozer/house/• Echoes from Kosovo:
– http://www.theconnection.org/shows/2002/04/20020409_b_main.asp• Story Mat
– Cassell, J. and Ryokai, K. (2001). Making Space for Voice: Technologies to Support Children's Fantasy and Storytelling. Personal Technologies 5(3): 203-224. (http://web.media.mit.edu/%7Ekimiko/publications/PersonalTech.pdf)
• Elder Care (e.g. Digital Family Portrait and Health Feedback Displays)– Mynatt, E.D. et al. Digital Family Portraits: Supporting Peace of Mind for Extended Family
Members. Proceedings of CHI 2001. (http://doi.acm.org/10.1145/365024.365126)– Morris, M. (2005). Social Networks as Health Feedback Displays. Internet Computing 9(5):
29-37. (http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1510602)• Deep Play: Notes on the Balinese Cockfight
– http://webhome.idirect.com/~boweevil/BaliCockGeertz.html• Design Ethnography
– Salvador, T. (1999). Design Ethnography. Design Management Journal 10(4). (Ask me if you’d like a copy.)
![Page 25: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/25.jpg)
25
Interaction Techniques with Mobile Devices
Jingtao Wang
Nov 22, 2006 Guest Lecture for CS160
North American Launch Date: November 19, 2006
![Page 26: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/26.jpg)
26
A mini survey before we start.
Why Mobile Devices Matters
6.5 billion people in the world1.5 billion cell phones worldwide500 million PCs (?)46 million PDAs1 million TabletPCs
Challenge: How can handheld devices improve the user interfaces of everything else, and not just be another gadget to be learned
6,500
1,500
50046 1
0
1,000
2,000
3,000
4,000
5,000
6,000
7,000
Peopl
e
Cell P
hones PCs
PDAs
Table
tPCs
Mill
ions
![Page 27: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/27.jpg)
27
Agenda
Why Mobile Devices Matters
Key Challenges in Designing Mobile Applications
Input Techniques for Mobile DevicesOutput Techniques for Mobile Devices
Interact With Other Devices
Key Challenges in Making Mobile Applications
Limited Physical Resources CPU, Memory, Screen Size, Input Devices, Battery Life etc
Diversified Context of UseDifferent Activities
Limited Attention
![Page 28: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/28.jpg)
28
Limited Physical Resources
A mobile device usually has 1/100 CPU power, 1/30 Screen resources, 1/20 Memory, and extremely limited input devices when compared with desktops in the same era. Small Screen Geography is different
a. Large Screenb. Small Screen
Diversified Context of Use
![Page 29: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/29.jpg)
29
Different Activities
People use small-screen devices for different activities than desktops; don’t assume you understand these activities already
Limited Attention
Don’t assume your applications have people’s full attention; they’re doing something else while using your device.
![Page 30: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/30.jpg)
30
Context, Activity, Attention
There is more opportunity for purpose-specific or context-specific devices than for general-purpose solutions that try to work for everyone in any situation.
Agenda
Why Mobile Devices Matters
Key Challenges in Designing Mobile Applications
Input Techniques for Mobile DevicesOutput Techniques for Mobile Devices
Interact With Other Devices
![Page 31: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/31.jpg)
31
Input Techniques for Mobile Devices
PointingMarker Based Input
Common Pointing/Navigation Techniques
iPod Dialpad
TrackPoint
JogDial
Touch ScreenFour-directional keypad
![Page 32: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/32.jpg)
32
TinyMotion – Camera Phone Based Motion Sensing
Detecting the movements of cell phones in real time by analyzing image sequences captured by the built-in camera. Typical movements include - horizontal and vertical movements, rotational movements and tilt movements.
Implementation
Motorola v710 Camera Phone from VerizonARM9 Processor, 4M Ram, 176x220 Display
BREW 2.11 (Binary Runtime Environment for Wireless)Realview ARM C/C++ Compiler 1.2TinyMotion generates 12 movement estimates* per second, 19-22ms for each image
* Without displaying the captured image and additional computation, v710 can capture images at the maximal rate of 15.2 frames/sec
![Page 33: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/33.jpg)
33
Sample Applications
Motion MenuVision TiltTextImage/Map ViewerMobile Gesture
Camera TetrisCamera SnakeCamera BreakOut
More Complex Applications: Handwriting/Gesture Recognition
The last row is a list of four Chinese words (with two Chinese characters in each word) meaning “telephone”, “design”, “science”, and “foundation” respectively. No smoothing operation was applied.
![Page 34: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/34.jpg)
34
TinyMotion Demo
FingerSense – Button Disambiguation by Fingertip Identification
Differentiating a pressing action by identifying the actual finger involvedCan be Faster than Regular Tapping When the Adjacent Tapping Involves Different Fingers and Different Buttons (59% on a phone keypad)
![Page 35: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/35.jpg)
35
Emerging Marker Based Interactions on Camera Phones
Towards More Sensitive Mobile Devices
![Page 36: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/36.jpg)
36
Agenda
Why Mobile Devices Matters
Key Challenges in Designing Mobile Applications
Input Techniques for Mobile DevicesOutput Techniques for Mobile Devices
Interact With Other Devices
Peephole Displays (With Demo)
![Page 37: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/37.jpg)
37
Zoomable Interface on Mobile Devices
ZoneZoom By Microsoft
Take advantage of spatial memory
VS.
Halo - A Virtual Periphery for Mobile Devices
Provding Visual Cue for Objects Located Out of the Small Screen
![Page 38: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/38.jpg)
38
Agenda
Why Mobile Devices Matters
Key Challenges in Designing Mobile Applications
Input Techniques for Mobile DevicesOutput Techniques for Mobile Devices
Interact With Other Devices
Using Mobile Devices with Desktop Computers
Pebbles Project at CMUUsing a PDA as additional keypad, touch pad, scroll wheel and controller of PointPoint slides for desktop Applicationshttp://www.pebbles.hcii.cmu.edu/
![Page 39: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/39.jpg)
39
Using Mobile Devices with Laptops
Wang 2002
Using Mobile Devices with Large Displays
Ballagas 2005
![Page 40: Understanding Technology use in the Home · – Applying machine learning techniques. 2 ... Participant Interviews. 7 Method and Infrastructure Location Data Computer Usage Logs Application](https://reader034.vdocuments.net/reader034/viewer/2022050507/5f98cc2dadc0b8014602510a/html5/thumbnails/40.jpg)
40
Question and Answer