in car speech user interfaces - swanh education event presentation, january 2009
DESCRIPTION
SwANH presentation - January 2009TRANSCRIPT
![Page 1: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/1.jpg)
In-Car Speech User Interfaces
Andrew Kun
![Page 2: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/2.jpg)
Students @ ECE
Jon Oppelaar Oskar Palinko Zeljko Medenica
Owen Derby Alex Shyrokov Puneet Lakhanpal
![Page 3: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/3.jpg)
Outline
• Ubicomp and cars• Studies• What’s next?
![Page 4: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/4.jpg)
Navigation
![Page 5: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/5.jpg)
Music, phones
![Page 6: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/6.jpg)
Cars in the age of ubicomp
• Car = docking port (Russell Shields, Ygomi)• Good docking port = open interface• Liability?• Profit?
![Page 7: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/7.jpg)
Police cars
• Toys vs. tools• Vanguard of in-car
ubicomp
![Page 8: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/8.jpg)
Project54
![Page 9: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/9.jpg)
Outline
• Ubicomp and cars
• Studies• What’s next?
![Page 10: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/10.jpg)
Studies
• Problem:– In car devices vs. driving performance
![Page 11: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/11.jpg)
Studies
• Goal: – Evaluation tool– Reduce distractions
![Page 12: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/12.jpg)
Studies
• Major hypotheses:– UI characteristics– Road conditions– Psychological state
![Page 13: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/13.jpg)
Evaluating hypotheses
• Driving simulator user studies
![Page 14: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/14.jpg)
DriveSafety driving simulator• tinyurl.com/p54sim
![Page 15: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/15.jpg)
Driving performance
• Variance:– Lane position– Steering wheel angle– Velocity– Distance to leading vehicle
• Lane departures• Collisions• Etc…
![Page 16: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/16.jpg)
Seeingmachines eye tracker• tinyurl.com/eyetracker
![Page 17: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/17.jpg)
Visual attention
• Fixations (> 100 ms): number, timing, etc.• Scanning• Time looking at road• Etc…
![Page 18: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/18.jpg)
Studies
• Glove PTT:– Accuracy– PTT usage– PTT interaction type
• Glove PTT:– Accuracy– PTT usage– PTT interaction type
• Navigation:– Printed, GUI, speech– City, highway, curves
• Navigation:– Printed, GUI, speech– City, highway, curves
![Page 19: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/19.jpg)
Glove PTT study
![Page 20: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/20.jpg)
Fixed PTT operation
![Page 21: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/21.jpg)
Fixed PTT – glances!
![Page 22: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/22.jpg)
Glove PTT operation
![Page 23: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/23.jpg)
Glove PTT – few glances
![Page 24: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/24.jpg)
Navigation study
• Motivation: PNGs proliferating• Task: follow directions to destination• Design:– Directions: paper map/GUI + speech/speech– Road conditions: highway/suburban highway/city
![Page 25: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/25.jpg)
Cabin setup
![Page 26: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/26.jpg)
![Page 27: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/27.jpg)
Printed directions
![Page 28: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/28.jpg)
GUI and voice directions
![Page 29: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/29.jpg)
Voice only directions
![Page 30: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/30.jpg)
Outline
• Ubicomp and cars• Studies
• What’s next?
![Page 31: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/31.jpg)
Navigation study
• Why is LCD screen important?
![Page 32: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/32.jpg)
What’s next?• Frustration?
![Page 33: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/33.jpg)
Acknowledgements
• NSF• US DOJ• Microsoft Research• Tellme
![Page 34: In Car Speech User Interfaces - SwANH education event presentation, January 2009](https://reader036.vdocuments.net/reader036/viewer/2022062614/547710f9b4af9f9f458b4580/html5/thumbnails/34.jpg)
www.eceblogger.comFacebook page: tinyurl.com/eceunhfacebook