investigating receptiveness to sensing and inference in the home using sensor proxies
DESCRIPTION
Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies. Eun Kyoung Choe , Sunny Consolvo , Jaeyeon Jung, Beverly Harrison, Shwetak N. Patel, Julie A. Kientz TsungYun 20130701. Outline. Introduction Study Method Analysis Discussion Conclusion. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/1.jpg)
Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies
Eun Kyoung Choe, Sunny Consolvo, Jaeyeon Jung, Beverly Harrison, Shwetak N. Patel, Julie A. Kientz
TsungYun 20130701
![Page 2: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/2.jpg)
Outline
• Introduction• Study Method• Analysis• Discussion• Conclusion
![Page 3: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/3.jpg)
Introduction
• Recent technical advances accelerate the integration of sensors into consumer devices in the home– Full-body 3D motion capture in games– Facial/voice recognition capabilities– Energy sensing systems– Wearable RFID in security systems
But … is this a good thing? Privacy problem?
![Page 4: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/4.jpg)
Introduction
• Sensing and inference data captured in the home could be highly sensitive– Intimacy/secretive activities– Confidential conversations– Innocuous activities : cooking and eating [4]
• Multiple stakeholders may have different perspectives on what is acceptable– Stakeholder: both householders and visitors
![Page 5: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/5.jpg)
Introduction
• This study investigates householders’ receptiveness to various sensing technologies
• Offer a number of design insights which designers can use to reduce some concerns observed in the study
![Page 6: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/6.jpg)
Study Method
• Three phase– Initial in-lab session– Four weeks using sensor proxies in-situ– Exit interviews
• Participants– 11 households (10 females, 12 males, aged 28-54)– various levels of education, occupation– owned a desktop/laptop with an average of 2.5
computers per household (min=1, max=5)
![Page 7: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/7.jpg)
![Page 8: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/8.jpg)
Study Method
• (I) In-lab session– General population is not familiar with how
sensing technologies work and what might be logged
– Background survey and technology education session
– Four sensing data: video, audio, electricity use, and movement
![Page 9: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/9.jpg)
![Page 10: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/10.jpg)
Study Method
• (I) In-lab session– Encouraged participants to brainstorm possible
application scenarios for each sensing technology– Consider the trade-offs (benefits/risks)– If participants were too positive about the sensors
or applications, we probed about potential risks and vice versa
![Page 11: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/11.jpg)
Study Method
• (II) In-situ Phase– Cultural Probes method [7]• A technique used to inspire ideas in a design process• Probes : small packages that can include any sort of
artifact (like a map, postcard, camera or diary)• participants record specific events, feelings or
interactions using probes– Take-home packages
![Page 12: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/12.jpg)
Study Method
![Page 13: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/13.jpg)
Study Method
• (II) In-situ Phase– 4 weeks– kitchen, master bedroom, family room, and child’s
or guest bedroom/study room– not to turn on the sensor proxies during the first
week– sensor light turned on whenever motion was
detected
![Page 14: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/14.jpg)
Study Method
![Page 15: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/15.jpg)
Study Method
• (III) Exit Interview– Ask participants about…• perceptions toward different sensing data• utility of the potential applications• issues regarding data access• issues regarding notification methods
![Page 16: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/16.jpg)
Analysis
• Perceived benefits and risks– Perceived benefits of in-home sensing applications– Perceived risks and concerns of in-home sensing
• Tensions regarding sensing and inference– Tensions between couples– Tensions between parents and children– Tensions between householders and visitors
![Page 17: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/17.jpg)
Analysis
• Perceived benefits and risks– Perceived benefits of in-home sensing applications– Perceived risks and concerns of in-home sensing
• Tensions regarding sensing and inference– Tensions between couples– Tensions between parents and children– Tensions between householders and visitors
![Page 18: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/18.jpg)
Analysis
• Perceived benefits of in-home sensing applications– People may be willing to accept invasive
technologies if perceived benefits outweigh potential risks [19]
– Applications directly related to household members’ health and safety
– Monetary benefits and incentives
![Page 19: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/19.jpg)
Analysis
• Applications directly related to household members’ health and safety–
–
![Page 20: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/20.jpg)
Analysis
• Still many participants were reluctant to the use of home automation systems–
–
![Page 21: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/21.jpg)
Analysis
• Monetary benefits and incentives–
–
![Page 22: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/22.jpg)
Analysis
• Perceived benefits and risks– Perceived benefits of in-home sensing applications– Perceived risks and concerns of in-home sensing
• Tensions regarding sensing and inference– Tensions between couples– Tensions between parents and children– Tensions between householders and visitors
![Page 23: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/23.jpg)
Analysis
• Perceived risks and concerns of in-home sensing applications– Private Nature of the In-home Sensing and
Inference Data – Unintended Consequences of Recording and
Playback– Possibility of Data Leaks: Security and Data
Storage
![Page 24: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/24.jpg)
Analysis
• Private Nature of the In-home Sensing and Inference Data–
![Page 25: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/25.jpg)
Analysis
• Unintended Consequences of Recording and Playback–
–
![Page 26: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/26.jpg)
Analysis
• Possibility of Data Leaks: Security and Data Storage–
![Page 27: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/27.jpg)
Analysis
• Perceived benefits and risks– Perceived benefits of in-home sensing applications– Perceived risks and concerns of in-home sensing
• Tensions regarding sensing and inference– Tensions between couples– Tensions between parents and children– Tensions between householders and visitors
![Page 28: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/28.jpg)
Analysis
• Tensions between couples–
–
![Page 29: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/29.jpg)
Analysis
• Tensions between couples–
![Page 30: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/30.jpg)
Analysis
• Perceived benefits and risks– Perceived benefits of in-home sensing applications– Perceived risks and concerns of in-home sensing
• Tensions regarding sensing and inference– Tensions between couples– Tensions between parents and children– Tensions between householders and visitors
![Page 31: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/31.jpg)
Analysis
• Tensions between parents and children–
–
![Page 32: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/32.jpg)
Analysis
• Tensions between parents and children– Not everyone agreed on including their child’s
opinion in deciding whether to adopt sensing and inference systems
–
![Page 33: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/33.jpg)
Analysis
• Perceived benefits and risks– Perceived benefits of in-home sensing applications– Perceived risks and concerns of in-home sensing
• Tensions regarding sensing and inference– Tensions between couples– Tensions between parents and children– Tensions between householders and visitors
![Page 34: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/34.jpg)
Analysis
• Tensions between householders and visitors–
![Page 35: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/35.jpg)
Analysis
• Tensions between householders and visitors– Participants had different strategies for how they
communicate an in-home sensing to a visitor– Depending on the relationship between the
householder and visitor
![Page 36: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/36.jpg)
Analysis
• Tensions between householders and visitors–
![Page 37: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/37.jpg)
Discussion
• Mechanisms to Reduce Privacy Risks– Limited capability sensors for the home• A new microphone-based cough sensor that only sends
the relevant features of coughing sounds• Non-invertible audio processing techniques• Convert a general-purpose camera into a single event
detector, e.g., fall detector
![Page 38: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/38.jpg)
Discussion
• Mechanisms to Reduce Privacy Risks– Context-aware sensing• Switch back and forth between high-fidelity (e.g., raw
video) and low-fidelity (e.g., blurred video) sensing• High-fidelity when they are not at home and low-
fidelity when they are at home• Automatically switch
![Page 39: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/39.jpg)
Discussion
• Mechanisms to Reduce Privacy Risks– Secure recording with limited playback• Enforce recorded data to be automatically deleted after
a certain time period• To be viewed only a pre-specified number of times
![Page 40: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/40.jpg)
Discussion
• Tensions between Aesthetics and Visible Notification – Participants did not like to have sensing devices be
visibly installed in their home– System sometimes needs to be hidden (e.g.,
supervising service people and babysitters)– Designing a gentle notification system (e.g., a
location-based reminder on a cell phone) warrants future research efforts.
![Page 41: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/41.jpg)
Conclusion
• While in-home sensing and inference systems can provide numerous benefits, privacy risks and concerns exist
• Conduct in-lab activities and four-weeks in situ with a cultural probe that used sensor proxies with 22 participants
![Page 42: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/42.jpg)
Conclusion
• Gather contextualized feedback on participants’ perceived benefits and risks of in-home sensing applications
• Provide design insights to alleviate perceived privacy concerns and tensions
![Page 43: Investigating Receptiveness to Sensing and Inference in the Home Using Sensor Proxies](https://reader035.vdocuments.net/reader035/viewer/2022062814/568166ce550346895ddadd01/html5/thumbnails/43.jpg)
Q&A
Thanks for your listening