the sociometer: a wearable device for …...m gladwell, the tipping point: how little things make...
TRANSCRIPT
![Page 1: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/1.jpg)
The Sociometer: A Wearable Device for Understanding Human Networks
Tanzeem Choudhury and Alex PentlandMIT Media Laboratory
![Page 2: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/2.jpg)
A human network is the pattern of communication, advice or support which exists among the members of a social system.
Personal NetworkCommunity
What is a Human Network ?
![Page 3: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/3.jpg)
Sensors NOT Surveys
We want to take a data driven approach to modeling human networks – i.e. use sensors to collect data aboutpeople’s interactions
• Need to overcome or deal with uncertainty in sensor measurements
• Needs to be acceptable and comfortable enough for users to wear regularly
• Privacy concerns
![Page 4: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/4.jpg)
Why is it important to understand interactions?
• In any social/work situation our decision making is influenced by others around us –
- Who are the people we talk to- For how long and how often ?- How actively do we participate in the conversation ?
![Page 5: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/5.jpg)
Connection structure and nature of communication among people are important in trying to understand –
• Diffusion of information• Group problem solving• Consensus building• Coalition formation
Why is it important to understand interactions?
![Page 6: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/6.jpg)
Identify Leaders Can we identify the leaders or connectors?Who is the leader influencing the most?
Diffusion of innovation Who do we have connections with ?Who are the people influencing us ?
Effective methods of intervention Can we target the most influential node ?
What can we do by learning group interactions?
![Page 7: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/7.jpg)
Why face-to-face interactions ?
Within a Floor
Within a Building
Within a Site
Between Sites
0 20 40 60 80Proportion of Contacts
Face-to-FaceTelephone
High Complexity Information
Allen, T., Architecture and Communication Among Product Development Engineers. 1997, Sloan School of Management, MIT: Cambridge.
![Page 8: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/8.jpg)
Can we learn the structure of groups in a community ?
Outline of experiment
• A group of people who agree to wear sensors• We collect information over certain period of time• Can we learn the types of groups and the communication structure that exists within the group?
M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social Network Thresholds in the Diffusion of Innovations”, Social Networks, Vol. 18, 1996, pp 69-89.M. Granovetter. “The strength of weak ties”, American Journal of Sociology, 78(6), 1360-1380 (1973).
How do we measure group interactions ?
![Page 9: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/9.jpg)
How do we measure group interactions ?
![Page 10: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/10.jpg)
The Sociometer
![Page 11: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/11.jpg)
The sociometer stores the following information for each individual
• Information about people nearby (sampling rate 17Hz – sensor IR)• Speech information (8KHz - microphone)• Motion information (50Hz - accelerometer)
Other sensors (e.g. light sensors, GPS etc.) can also be added in the future using the extension board.
The Sociometer
![Page 12: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/12.jpg)
What do we want to learn ?
Detect people in proximitySegment speakers Identify conversations Estimate conversation duration
Build model of the communication link structureBuild model of influence between people
Who talks to whom ?
Who are the connectors, experts? How does information flow ?
![Page 13: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/13.jpg)
The Experiment
• 23 subjects wore sociometers for 2 weeks – 6 hours everyday• 60 hours of data per subject – total 1518 hours of interaction data
![Page 14: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/14.jpg)
Speaker Segmentation
Threshold Energy
Raw speech signal Output of energy threshold
Output of HMM
![Page 15: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/15.jpg)
Speaker Segmentation
![Page 16: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/16.jpg)
Finding Conversations (Basu 2002)
Consider two voice segment streams- How tightly synchronized are they?- Alignment measure based on Mutual Information
1 2
1 21 2
, 1 2
[ ] ( [ ], [ ])( [ ] , [ ] )( [ ] , [ ] ) log
( [ ] ) ( [ ] )i j
a k I v t v t kp v t i v t k jp v t i v t k j
p v t i p v t k j
= −= − =
= = − == − =∑
1.6 seconds 16 seconds 2.5 minutes
![Page 17: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/17.jpg)
Why Does It Work So Well? (Basu 2002)
Voicing segs: pseudorandom bit sequence- The conversational partner is a noisy complement
![Page 18: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/18.jpg)
![Page 19: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/19.jpg)
Identifying People in Face-to-Face Proximity
Day1
Day2
Day3
Day4
Day5
IR output for person 1
Signal received from person 3
Person 1’s IR receiver output
![Page 20: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/20.jpg)
From Features to Network Models
• Transcription of the sensor data into descriptive labels (such as conversation duration and types).
• Characterization of the communication network i.e. the network structure/map
• Participation types and dynamic models of interactions
• Prediction of future interactions
We have features but still need to do -
![Page 21: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/21.jpg)
The Influence Model
•The "Influence Model" is a generative model for describing the connections between many Markov chains with a simple parameterization in terms of the “influence” each chain has on the others.
•Computationally tractable
The parts of the model:
•Each node represents an individual as a full-fledged Markov Process.
•Each arrow represents some form of influence that one individual has on another.
Reference:C. Asavathiratham, "The Influence Model: A Tractable Representation for the Dynamics of Networked Markov Chains," in Dept. of EECS. Cambridge: MIT, 2000, pp. 188.
![Page 22: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/22.jpg)
Inside the Influence Model
Inside each node is one or more Markov Processes that can represent:
• the state of the individual• the dynamics of the individuals state-changing behavior
![Page 23: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/23.jpg)
7
56
8
21
3
4ijα
: Amount of influence that person i has on person j{ }ijα1( | )i j
t tP S S − : How person i is influenced by person j
{ }ijαInfluence Parameters:
11 1 1( | ,..., ) ( | )i N i j
t t t ij t tj
P S S S P S Sα− − −= ∑
![Page 24: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/24.jpg)
Take Sensor Measurements of individuals as they interact
Represent the Interaction DynamicsWith a Dynamic Bayes’ Net (DBN)
Basic Approach
11 1 1( | ,..., ) ( | )i N i j
t t t ij t tj
P S S S P S Sα− − −= ∑
7
56
8
21
3
4ijα
![Page 25: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/25.jpg)
Link Structure of the Group Duration vs. Frequency
Interaction structure based on duration Interaction structure based on frequency
![Page 26: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/26.jpg)
Interaction Distribution
Fraction of interaction based on duration Fraction of interaction based on frequency
![Page 27: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/27.jpg)
Conclusions
• Sensor-based models of human communication networks• Continuous sensing on interaction without relying onpersonal recall or surveys
• Models of communication links structure• Inter/intra group interactions• Influence model for group interactions
http://www.media.mit.edu/~tanzeem/shortcuts
![Page 28: The Sociometer: A Wearable Device for …...M Gladwell, The Tipping Point: How little things make can make a big difference. 2000, New York: Little Brown.Thomas W. Valente, “Social](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d90727e708231d43afb97/html5/thumbnails/28.jpg)
Acknowledgements
Special thanks to Brian Clarkson, Rich DeVaul, VadimGerasimov and Sumit Basu