fall 20066.831 ui design and implementation1 lecture 20: hci research topics
TRANSCRIPT
![Page 1: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/1.jpg)
Fall 2006 6.831 UI Design and Implementation 1
Lecture 20: HCI Research Topics
![Page 2: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/2.jpg)
Fall 2006 6.831 UI Design and Implementation 2
UI Hall of Fame or Shame?
Suggested by Chris Child
![Page 3: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/3.jpg)
Fall 2006 6.831 UI Design and Implementation 3
Today’s Topics: HCI Research
• Input modalities– Vision, speech, pen, tangible
• Output modalities– Large, small, ambient
• Information visualization
• End-user programming
• Ubiquitous computing
![Page 4: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/4.jpg)
Fall 2006 6.831 UI Design and Implementation 4
Input Modalities
• Vision
• Speech
• Pen gesture & sketching
• Tilting & bending
• Tangible objects
• Multimodal: several kinds of inputs at once
![Page 5: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/5.jpg)
Fall 2006 6.831 UI Design and Implementation 5
Input: Vision
• Camera watches the user to detect:– Eye gaze– Head pose– Body gestures– User presence– Movement of physical objects
![Page 6: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/6.jpg)
Fall 2006 6.831 UI Design and Implementation 6
PlayAnywhere
![Page 7: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/7.jpg)
Fall 2006 6.831 UI Design and Implementation 7
Eye Tracking in User Testing
![Page 8: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/8.jpg)
Fall 2006 6.831 UI Design and Implementation 8
Input: Pen & Touch
• Handwriting
• Sketching
• Touch
![Page 9: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/9.jpg)
Fall 2006 6.831 UI Design and Implementation 9
The Perils of Handwriting Recognition
![Page 10: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/10.jpg)
Fall 2006 6.831 UI Design and Implementation 10
Pen Sketching
![Page 11: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/11.jpg)
Fall 2006 6.831 UI Design and Implementation 11
Touch & Play
![Page 12: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/12.jpg)
Fall 2006 6.831 UI Design and Implementation 12
Input: Speech Dialog SystemsMercury: Welcome. How may I help you?
USER: I WOULD LIKE TO FLY FROM BOSTON TO LONDON
Mercury: Flights from Boston to London. What date will you be travelling?
USER: NEXT FRIDAY IN THE EVENING
Mercury: Okay. flights from Boston to London departing between 5:00 pm and midnight on June 25. Can you provide a departure or arrival time? The earliest nonstop flight from Boston to London departing between 5:00 pm and midnight on June 25 leaves at 5:30 p.m. and arrives at 4:55 a.m. on British Airways. You arrive one day later.
USER: IS THERE A UNITED FLIGHT
Mercury: Okay. United flights from Boston to London departing between 5:00 pm and mid night on June 25. One moment please... I have a nonstop United flight leaving at 6:40 p.m. and arriving at 6:25 a.m.?
USER: BOOK THAT FLIGHT
![Page 13: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/13.jpg)
Fall 2006 6.831 UI Design and Implementation 13
Input: Tangible Objects
![Page 14: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/14.jpg)
Fall 2006 6.831 UI Design and Implementation 14
Output Modalities
• Large screens– Multiple monitors, desk surfaces, walls
• Small screens– Handhelds, cellphones, watches
• Ambient displays• Other senses
– Audio: speech, “earcons”– Touch: haptic feedback– Olfactory
![Page 15: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/15.jpg)
Fall 2006 6.831 UI Design and Implementation 15
Output: Large Screens
![Page 16: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/16.jpg)
Fall 2006 6.831 UI Design and Implementation 16
Output: Small Screens
![Page 17: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/17.jpg)
Fall 2006 6.831 UI Design and Implementation 17
Output: Ambient Displays
![Page 18: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/18.jpg)
Fall 2006 6.831 UI Design and Implementation 18
Information Visualization
![Page 19: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/19.jpg)
Fall 2006 6.831 UI Design and Implementation 19
Dynamic Queries
![Page 20: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/20.jpg)
Fall 2006 6.831 UI Design and Implementation 20
Dynamic Queries
![Page 21: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/21.jpg)
Fall 2006 6.831 UI Design and Implementation 21
Dynamic Queries
![Page 22: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/22.jpg)
Fall 2006 6.831 UI Design and Implementation 22
Exhibit
![Page 23: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/23.jpg)
Fall 2006 6.831 UI Design and Implementation 23
End-user Programming
• Why do users need to program?– User analysis can target:
• Whole population: general-purpose applications like MS Excel• Specific user class: bookkeeping for beekeepers• One user: a particular beekeeper’s bookkeeping practices
– The tighter the user analysis, the more functional and usable the application
• But the less revenue will pay for its development• Can a single user ask for more features, more iterations?
• Common kinds of EUP– Customization (e.g. toolbars)– Automation of repetitive tasks (e.g. macros)– Application development (e.g. spreadsheets)
![Page 24: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/24.jpg)
Fall 2006 6.831 UI Design and Implementation 24
Programming by Example (PBE)
• User demonstrates how on concrete examples, using familiar UI operations
• System records user’s demonstration as a program
• Also called programming by demonstration (PBD)
![Page 25: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/25.jpg)
Fall 2006 6.831 UI Design and Implementation 25
Ubiquitous Computing
• Computing infrastructure constantly surrounding us– Small, portable, wearable devices– Large and ambient displays– Sensors throughout the world for vision &
speech– Location sensing & context awareness
• Also called pervasive computing
![Page 26: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/26.jpg)
Fall 2006 6.831 UI Design and Implementation 26
Prototyping for Ubiquitous Computing
![Page 27: Fall 20066.831 UI Design and Implementation1 Lecture 20: HCI Research Topics](https://reader036.vdocuments.net/reader036/viewer/2022062518/56649e885503460f94b8c399/html5/thumbnails/27.jpg)
Fall 2006 6.831 UI Design and Implementation 27
What To Do Next
• Courses in spring 2007– 6.883 Pervasive, Human-centric Computing (Rudolph)– 6.870 Multimodal/Intelligent Interfaces (Darrell/Davis)– MAS.630 Affective Computing (Picard)– MAS.632 Speech Interfaces & Mobile Devices (Schmandt)– MAS.672 New Paradigms for HCI (Maes)
• Research at MIT– CSAIL
• Vision (Darrell)• Pen (Davis)• 3D (Durand, Popovic)• Speech (Glass, Seneff, Zue)• End-user programming & usable security (Miller)• Ubiquitous (Rudolph)
– Media Lab• Tangible (Ishii)• Agents, end-user programming (Lieberman)• Ambient & ubiquitous (Maes)• Wearable (Pentland)• Emotion (Picard)• Speech and audio (Schmandt)• Context aware (Selker)