data science, demography and social media challenges and ...€¦ · data science, demography and...
TRANSCRIPT
![Page 1: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/1.jpg)
Data Science, Demography andSocial Media
Challenges and Opportunities
Emilio Zagheni
Department of Sociology and eScience InstituteUniversity of Washington, Seattle
February 2, 2017
![Page 2: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/2.jpg)
Today’s seminar
1. How data science and social media are
transforming demography
2. How demographic thinking helps us
make sense of messy and biased data
3. How misuse of new tools and data may
lead to dangerous outcomes
![Page 3: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/3.jpg)
Outline
a. Background on ‘digital demography’
b. An example from my own research:
Estimating migration using Facebook
advertisement data
c. Potential misuse of online advertising
platforms
d. Making sense of messy data: an example
using Twitter data
![Page 4: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/4.jpg)
credit: Emmanuel Letouze
![Page 5: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/5.jpg)
Demography is the study of populations(including non-human populations). It deals withprocesses related to mortality, fertility, migration.
It attempts to explain the causes andconsequences of population dynamics.
![Page 6: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/6.jpg)
“Demography is the quintessential quantitative socialscience. It bears something of the same relationship to othersocial sciences that physics bears to other natural sciences”
- Ken Wachter, Essential Demographic Methods
⇒ Demography is a discipline that plays a central role inthe social sciences
![Page 7: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/7.jpg)
“Demography is the quintessential quantitative socialscience. It bears something of the same relationship to othersocial sciences that physics bears to other natural sciences”
- Ken Wachter, Essential Demographic Methods
⇒ Demography is a discipline that plays a central role inthe social sciences
![Page 8: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/8.jpg)
“Biodemography fundamentally deepens our understandingof the underlying evolutionary drivers of demographicpatterns across the tree of life”
- Jim Vaupel
⇒ Demography as an engine of innovation in the biologicalsciences
![Page 9: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/9.jpg)
“Biodemography fundamentally deepens our understandingof the underlying evolutionary drivers of demographicpatterns across the tree of life”
- Jim Vaupel
⇒ Demography as an engine of innovation in the biologicalsciences
![Page 10: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/10.jpg)
One of Demography’s many traits
Demography is (or aspires to be) a driver of
innovation for all sciences and is energized
by exchange of ideas with other disciplines
![Page 11: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/11.jpg)
Parallels with Data Science
Demography Data Science is (or aspires to
be) a driver of innovation for all sciences
and is energized by exchange of ideas with
other disciplines
![Page 12: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/12.jpg)
What has made Demography successful?
I The intrinsic nature of the discipline:- It deals with quantities that are relatively easy to
measure- The object of analysis is suitable for mathematical
modeling- Everything is a population
I Extrinsic factors:- Data availability (often collected from authorities for
a number of purpose)- The questions asked have policy relevance- Major demographic issues faced by societies (e.g.
population growth, population aging)
![Page 13: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/13.jpg)
What is the next frontier in Demography? What
are the challenges ahead?
![Page 14: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/14.jpg)
“Digital Demography”
I The Web, social media and smartphones havehad a sudden and unprecedented impact onour lives and have given researchers new datato study demographic behavior.
I ‘Digital demography’ is about:1. Studying the implications of the digital revolution on
demographic behavior2. Using new data sources to better understand
demographic processes
![Page 15: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/15.jpg)
“Digital Demography”
I The Web, social media and smartphones havehad a sudden and unprecedented impact onour lives and have given researchers new datato study demographic behavior.
I ‘Digital demography’ is about:1. Studying the implications of the digital revolution on
demographic behavior2. Using new data sources to better understand
demographic processes
![Page 16: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/16.jpg)
Using Facebook Advertisement Data toEstimate Migration
Joint work with Ingmar Weber (QCRI) and KrishnaGummadi (MPI)
![Page 17: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/17.jpg)
What ads looked like in the 1930s...
![Page 18: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/18.jpg)
Today: Online (targeted) advertising
![Page 19: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/19.jpg)
![Page 20: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/20.jpg)
Targeting a demographic group on Facebook
![Page 21: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/21.jpg)
You can access the data in a programmatic way
![Page 22: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/22.jpg)
Leveraging Facebook to study Migration
![Page 23: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/23.jpg)
●●
●
●●●●●
●
●●
●
●●
●●
●●●
●●●
●
●●
●
●●
●●●●●
●
●●●●●
●●●●
●●●●●
●
●
●
●
●●●●
●●●●
●
●
●●●●●●●●●
●
●
●
●
●●●
●
●
●●
●●
●
●●●●
●●●●●●
●
●●
●●●●
●
●●●●●
●●
●
●●
●
●●●
●●
●
●●●●
●
●
● ●
●
●
●●
●●●
●
●●●●
●●
●
●●
●●●●●●
●
●●
●●●●●
●
●●●●
●
●●●●●●
●●●●●
●
●●●●●
●●●
●
●
●
●●
●
●●●●
●
●
●
●
●●●●
●
●
●
●
●●●●
●
●●●
●●
●●●●●●
●
●
●
●●●●●
●
●●●●●●
●●●●●●
●
●●●●
●
●●●●
●●●
●
●●
●
●●●●●●
●
●●●●●
●●●●●●●●
●
●●●●●●
●●●●●●●●
●●
●●
●
●●
●
●
●●●
●
●●●●
●
●●●●●●●
●
●
●
●●●
●●
●
●●●●●●●●
●
●●
●●
●
●
●●●●●
●
●●●●
●
●
●●●●●●●●
●●●
●●●●●
●
●●●●●●●
●
●●●●
●●
●●●●●
●
●●●●●●
●●●●
●
●●
●●●●●●●
●●●●●●
●
●●●●●
●
●●●●●●●●
●
●●
●
●●●
●
●●●
●
●●●●●
●
●●●
●●
●
●●
●
●●● ●●●
●
●
●●●●
●●
●●●
●
●
●●●●
●●
●
●
●
●●
●
●●●●
●●●
●
●
●
●
●●●●●
●
●●●
●
●
●●●●●●●●
●
●
●
●
●●●
●
●
●
●●●●
●
●●●●●●
●●●●●
●
●●●●●●●
● ●●
●●●●●●●●●●●
●●●●●●
●●●●●●●
●●●
●●●●●●
●
●● ●●
●●
●
●
●●
●●●●●
●
●
●●●
●●
●●●●●●●●●●
●
●
●●●●●●
●
●
●
●●●●●
●●●
●
●
●
●
●●●●
●
●●●●
●●●
●
●●●●●●
●●●●●
●●●●●●●●●
●
●●●●●
●
●
●●●●
●●●●●●
●●●●●●●●●●
●
●●●●●●
●
●●
●●●
●●●●●
●
●●
●
●
●
●
●●●
●
●●●●
●●
●●
●●●●
●
●●●●●
●●
●●
●●●
●
●●●
●●
●●●●●●
●
●
●
●
●●●
●●
●●●●●●
●●●●●●●●●
●●●●
●
●●●●
●
0.00 0.05 0.10 0.15
0.00
0.05
0.10
0.15
Migrants to US states for different countries of origin
Fraction of 'expats' in Facebook
Fra
ctio
n of
fore
ign
born
in th
e A
CS
Mexicans in CA
Filipinos in HIMexicans in NM
1e−04 5e−04 5e−03 5e−02
1e−
051e
−03
1e−
01
log−log plot
![Page 24: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/24.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
−6
−4
−2
0
−4 −3 −2 −1 0
log(Fraction of immigrants in Facebook)
log(
Fra
ctio
n of
imm
igra
nts
− W
orld
Ban
k)
Continent●
●
●
●
●
●
Africa
Asia
Europe
Latin America
North America
Oceania
Fraction of immigrants by country of destination
![Page 25: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/25.jpg)
A tool potentially useful for demographic
and survey research, but that could also be
misused...
![Page 26: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/26.jpg)
![Page 27: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/27.jpg)
![Page 28: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/28.jpg)
https://www.propublica.org/article/
breaking-the-black-box-what-facebook-knows-about-you
![Page 29: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/29.jpg)
Making sense of noisy and messy data
![Page 30: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/30.jpg)
Can you recognize this city?
![Page 31: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/31.jpg)
Does this look a bit more familiar?
![Page 32: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/32.jpg)
The original picture
![Page 33: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/33.jpg)
Can we infer the height of the Space Needle from
one of the images?
I No distortions ⇒ Compare with buildingsaround it
I Distortions consistent across the image ⇒you can still compare with buildings nearby
I No clear pattern in distortions ⇒ develop astatistical model to understand patterns
![Page 34: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/34.jpg)
Can we infer the height of the Space Needle from
one of the images?
I No distortions ⇒ Compare with buildingsaround it
I Distortions consistent across the image ⇒you can still compare with buildings nearby
I No clear pattern in distortions ⇒ develop astatistical model to understand patterns
![Page 35: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/35.jpg)
Can we infer the height of the Space Needle from
one of the images?
I No distortions ⇒ Compare with buildingsaround it
I Distortions consistent across the image ⇒you can still compare with buildings nearby
I No clear pattern in distortions ⇒ develop astatistical model to understand patterns
![Page 36: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/36.jpg)
Can we infer the height of the Space Needle from
one of the images?
I No distortions ⇒ Compare with buildingsaround it
I Distortions consistent across the image ⇒you can still compare with buildings nearby
I No clear pattern in distortions ⇒ develop astatistical model to understand patterns
![Page 37: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/37.jpg)
Social Media offer a “distorted” image of the real
world
I We want to know the true rates for the
underlying population
⇒ Combining different sources of
information is key to extracting value
from potentially biased data
![Page 38: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/38.jpg)
Social Media offer a “distorted” image of the real
world
I We want to know the true rates for the
underlying population
⇒ Combining different sources of
information is key to extracting value
from potentially biased data
![Page 39: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/39.jpg)
Social Media offer a “distorted” image of the real
world
I We want to know the true rates for the
underlying population
⇒ Combining different sources of
information is key to extracting value
from potentially biased data
![Page 40: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/40.jpg)
...Social media data were produced and collected
for reasons other than population studies
There is a lot of useful information in big
social data, but we need to work hard to
interpret the new data sources
![Page 41: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/41.jpg)
Example: Inferring Migration/Mobility
patterns from Twitter Data
Zagheni, Garimella, Weber and State 2014
![Page 42: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/42.jpg)
Geo-located Twitter data
I We collected a large sample of geo-locatedTwitter tweets (with geographic coordinates)for the period 2011-2013 in OECD countries
I We evaluated short-term mobility (periods of4 months)
I No official statistics to calibrate a model
⇒ We proposed a difference-in-differencesapproach to estimate trends
![Page 43: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/43.jpg)
Geo-located Twitter data
I We collected a large sample of geo-locatedTwitter tweets (with geographic coordinates)for the period 2011-2013 in OECD countries
I We evaluated short-term mobility (periods of4 months)
I No official statistics to calibrate a model
⇒ We proposed a difference-in-differencesapproach to estimate trends
![Page 44: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/44.jpg)
Geo-located Twitter data
I We collected a large sample of geo-locatedTwitter tweets (with geographic coordinates)for the period 2011-2013 in OECD countries
I We evaluated short-term mobility (periods of4 months)
I No official statistics to calibrate a model
⇒ We proposed a difference-in-differencesapproach to estimate trends
![Page 45: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/45.jpg)
Geo-located Twitter data
I We collected a large sample of geo-locatedTwitter tweets (with geographic coordinates)for the period 2011-2013 in OECD countries
I We evaluated short-term mobility (periods of4 months)
I No official statistics to calibrate a model
⇒ We proposed a difference-in-differencesapproach to estimate trends
![Page 46: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/46.jpg)
Geo-located Twitter data
I We collected a large sample of geo-locatedTwitter tweets (with geographic coordinates)for the period 2011-2013 in OECD countries
I We evaluated short-term mobility (periods of4 months)
I No official statistics to calibrate a model
⇒ We proposed a difference-in-differencesapproach to estimate trends
![Page 47: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/47.jpg)
Geographic mobility for Twitter users
● ●
●
●
●
0.00
0.01
0.02
0.03
0.04
0.05
Mob
ility
rat
es fo
r Tw
itter
use
rs
●
●
●●
●
●
● ●
●
●
●
●
●
●
●
●
●
● ●
●
May−Aug11 Sep−Dec11 Jan−Apr12 May−Aug12 Sep−Dec12
average OECDMexicoUSAGermanyJapan
Source: Zagheni, Garimella, Weber and State, WWW’14
![Page 48: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/48.jpg)
Assumptions when ‘ground truth’ data do not
exist
Consider the following situation:
yti︸︷︷︸Observation from
social mediafor location i
= n︸︷︷︸bias for
location i
+ xti︸︷︷︸“true” rate
for location i
and
ytz︸︷︷︸Observation from
social mediafor location z
= m︸︷︷︸bias for
location z
+ xtz︸︷︷︸“true” rate
for location z
Additive bias different across regions, but constant (orchanges by the same amount across regions) over shortperiods of time
![Page 49: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/49.jpg)
Assumptions when ‘ground truth’ data do not
exist
Consider the following situation:
yti︸︷︷︸Observation from
social mediafor location i
= n︸︷︷︸bias for
location i
+ xti︸︷︷︸“true” rate
for location i
and
ytz︸︷︷︸Observation from
social mediafor location z
= m︸︷︷︸bias for
location z
+ xtz︸︷︷︸“true” rate
for location z
Additive bias different across regions, but constant (orchanges by the same amount across regions) over shortperiods of time
![Page 50: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/50.jpg)
Assume that we knew the ‘true’ rates (x) for
France and Spain
xt+1FR = 0.7 xt+1
SP = 0.5xtFR = 0.5 xtSP = 0.4
Let’s define δt+1 as the differential in the variation ofthese quantities of interest between time t and (t+ 1)
δt+1 = (xt+1FR − x
tFR)− (xt+1
SP − xtSP )︸ ︷︷ ︸
difference in the increments
=?
δt+1 = (0.7− 0.5)− (0.5− 0.4) =
= 0.2− 0.1 = 0.1
![Page 51: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/51.jpg)
Assume that we knew the ‘true’ rates (x) for
France and Spain
xt+1FR = 0.7 xt+1
SP = 0.5xtFR = 0.5 xtSP = 0.4
Let’s define δt+1 as the differential in the variation ofthese quantities of interest between time t and (t+ 1)
δt+1 = (xt+1FR − x
tFR)− (xt+1
SP − xtSP )︸ ︷︷ ︸
difference in the increments
=?
δt+1 = (0.7− 0.5)− (0.5− 0.4) =
= 0.2− 0.1 = 0.1
![Page 52: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/52.jpg)
Assume that we knew the ‘true’ rates (x) for
France and Spain
xt+1FR = 0.7 xt+1
SP = 0.5xtFR = 0.5 xtSP = 0.4
Let’s define δt+1 as the differential in the variation ofthese quantities of interest between time t and (t+ 1)
δt+1 = (xt+1FR − x
tFR)− (xt+1
SP − xtSP )︸ ︷︷ ︸
difference in the increments
=?
δt+1 = (0.7− 0.5)− (0.5− 0.4) =
= 0.2− 0.1 = 0.1
![Page 53: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/53.jpg)
Plato’s allegory of the Cave
![Page 54: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/54.jpg)
All we see is a distorted image (y) of the ‘true’
rates (x)
yt+1FR = 0.2 + 0.7 yt+1
SP = 0.1 + 0.5ytFR = 0.2 + 0.5 ytSP = 0.1 + 0.4
What is δt+1?
δt+1 = (yt+1FR − y
tFR)− (yt+1
SP − ytSP )︸ ︷︷ ︸
difference in the increments
=?
δt+1 = (0.9− 0.7)− (0.6− 0.5) =
= 0.2− 0.1 = 0.1
Same as before...
![Page 55: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/55.jpg)
All we see is a distorted image (y) of the ‘true’
rates (x)
yt+1FR = 0.2 + 0.7 yt+1
SP = 0.1 + 0.5ytFR = 0.2 + 0.5 ytSP = 0.1 + 0.4
What is δt+1?
δt+1 = (yt+1FR − y
tFR)− (yt+1
SP − ytSP )︸ ︷︷ ︸
difference in the increments
=?
δt+1 = (0.9− 0.7)− (0.6− 0.5) =
= 0.2− 0.1 = 0.1
Same as before...
![Page 56: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/56.jpg)
All we see is a distorted image (y) of the ‘true’
rates (x)
yt+1FR = 0.2 + 0.7 yt+1
SP = 0.1 + 0.5ytFR = 0.2 + 0.5 ytSP = 0.1 + 0.4
What is δt+1?
δt+1 = (yt+1FR − y
tFR)− (yt+1
SP − ytSP )︸ ︷︷ ︸
difference in the increments
=?
δt+1 = (0.9− 0.7)− (0.6− 0.5) =
= 0.2− 0.1 = 0.1
Same as before...
![Page 57: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/57.jpg)
Difference in differences estimator
δt+1 = (yt+1i − yt+1
z )− (yti − ytz)
After substituting:
δt+1 = (xt+1i − xti)− (xt+1
z − xtz)︸ ︷︷ ︸difference in the increments
Additive values of the bias (m and n) cancel out
![Page 58: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/58.jpg)
Twitter example
AUS BEL CAN CHL DNK FIN FRA DEU GRC HUN IRL ITA JPN KOR MEX NLD NZL NOR PRT ESP SWE CHE TUR GBR USA
Diff
eren
ce in
diff
eren
ce o
f out
−m
obili
ty r
ates
−0.
015
−0.
005
0.00
50.
015
Source: Zagheni, Garimella, Weber and State, WWW’14
![Page 59: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/59.jpg)
Remarks
If the bias is expected to be multiplicative:
yti︸︷︷︸Observation from
social mediafor location i
= n︸︷︷︸bias for
location i
× xti︸︷︷︸“true” rate
for location i
Use a logarithmic transformation
log(yti) = log(n) + log(xti)
Then use the difference-in-differences estimator on the logs:
δt+1 = [log(yt+1i )− log(yt+1
z )]− [log(yti)− log(ytz)]
![Page 60: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/60.jpg)
Remarks
If the bias is expected to be multiplicative:
yti︸︷︷︸Observation from
social mediafor location i
= n︸︷︷︸bias for
location i
× xti︸︷︷︸“true” rate
for location i
Use a logarithmic transformation
log(yti) = log(n) + log(xti)
Then use the difference-in-differences estimator on the logs:
δt+1 = [log(yt+1i )− log(yt+1
z )]− [log(yti)− log(ytz)]
![Page 61: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/61.jpg)
Remarks
If the bias is expected to be multiplicative:
yti︸︷︷︸Observation from
social mediafor location i
= n︸︷︷︸bias for
location i
× xti︸︷︷︸“true” rate
for location i
Use a logarithmic transformation
log(yti) = log(n) + log(xti)
Then use the difference-in-differences estimator on the logs:
δt+1 = [log(yt+1i )− log(yt+1
z )]− [log(yti)− log(ytz)]
![Page 62: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/62.jpg)
Tip of the iceberg
I Digital demography is potentially relevant forevery area of population studies. Examplesinclude
1. How is online dating affecting household formation?
2. How do people behave in the online marriage market?And how do they react to demographic imbalancesand shocks?
3. How are new technologies affecting intergenerationalrelationships?
4. How does online exposure to peers affect health andfertility behavior?
5. What do Google searches reveal about fertility orabortions?
![Page 63: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/63.jpg)
Tip of the iceberg
I Digital demography is potentially relevant forevery area of population studies. Examplesinclude
1. How is online dating affecting household formation?
2. How do people behave in the online marriage market?And how do they react to demographic imbalancesand shocks?
3. How are new technologies affecting intergenerationalrelationships?
4. How does online exposure to peers affect health andfertility behavior?
5. What do Google searches reveal about fertility orabortions?
![Page 64: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/64.jpg)
Underlying themes
1. How to access and make sense of new, messyand biased data sources?
2. To what extent traditional research designcan be re-purposed to address newchallenges?
3. What is the impact of new data and newtools on our society?
⇒ SOC 401: “Data Science and PopulationProcesses”, is offered in the Fall
![Page 65: Data Science, Demography and Social Media Challenges and ...€¦ · Data Science, Demography and Social Media Challenges and Opportunities ... 1.How data science and social media](https://reader034.vdocuments.net/reader034/viewer/2022042220/5ec60755640bd704231ec79d/html5/thumbnails/65.jpg)
Underlying themes
1. How to access and make sense of new, messyand biased data sources?
2. To what extent traditional research designcan be re-purposed to address newchallenges?
3. What is the impact of new data and newtools on our society?
⇒ SOC 401: “Data Science and PopulationProcesses”, is offered in the Fall