![Page 1: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/1.jpg)
The all pervasive impact of Big Data in daily lifeFrom Causality to Correlation
H.Jaap van den Herik1,2,3
Rob van Eijk2,3 (1) Leiden University,
LCDS
(2) Leiden University, eLaw
(3) Leiden University, CRK
Launch Future Center – Smart Systems Leiden Centre of Data ScienceThe Hague, 23 April 2014
Sessie 13.30-14.00
1
![Page 2: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/2.jpg)
Acknowledgements
With much pleasure I would like
to thank Hans Konstapel and Jeroen van der Leijé.
Research is team work over a long period. Thus, the list of collaborators would be long. Below I provide a selection. So, I would like to
acknowledge for their help and inspiration:
Stan Bentvelsen, Yvo van Schulpen, Jos Vermaseren, Aske Plaat,
Ben Ruijl, Peter de Kock, Ron Boelsma, Roel in ’t Veld,
Joke Hellemons and Eric Postma
2
![Page 3: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/3.jpg)
Contents
1. What is Big Data?2. Where do we find Big Data?3. Role of Big Data4. Big Data in action: NOS Zomercolumn5. Social Innovation6. New developments7. Narrative Science8. From correlations to causation?9. Leiden Centre of Data Science
3
![Page 4: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/4.jpg)
BIG DATA• Definition van Tom White (2012) :
“Big Data is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand databases management tools or traditional data processing applications.”
• The challenges capture:1. curation,2. storage, 3. search,4. sharing, 5. transfer, 6. analysis, 7. visualization, 8. interpretation,9. real-time (van Eijk, 2013)
4
![Page 5: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/5.jpg)
Higgs particle
The breakthrough of the century
5
![Page 6: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/6.jpg)
Three perspectives onthe development of Big Data
(1) An overflow of Data Results
(e.g.,in particle physics)
(2) A lack of coordination among the information items
(as in the 9/11 events, Boston 15 April, 2013)
(3) The power of Big Data
(by using concepts as visualization and
narrative science)
6
![Page 7: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/7.jpg)
The role of BIG DATA
- Social-economic Ph.D theses from 1970 to 2000 are frequently “outdated” by BIG DATA developments.
- Deep Knowledge vs. Partial Knowledge
- Real-time bidding (RTB) happens in 30 milliseconds (0,030 sec.)
7
![Page 8: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/8.jpg)
NOS Journal interview met Rob van Eijk
http://nos.nl/video/527311-handel-in-een-fractie-van-een-seconde.html8
![Page 9: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/9.jpg)
Ideas on INNOVATION
Technological Innovation Social Innovation
Cloud The new way of working
Crowd Communication via Social Media
Narrative Science Tracking & Tracing of the Individual
9
![Page 10: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/10.jpg)
From Social Change to Social Innovation
Two difficult social changes:- To fill up without paying- Cracking Thud
- Liability at the Oil Companies (not at the Police or Public Prosecutor)- Liability at the Banks (not at the Police or Public Prosecutor)
10
![Page 11: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/11.jpg)
Social InnovationDefinition: Social Innovation is the development and implementation of novel
ideas (products, services, and models) to satisfy social needs, and to create new social relations or partnerships.
Seen as a process:
1. Identification of social needs
2. Invention of new solutions
3. Evaluation of effectiviness
4. Rescaling of effective social innovations
Social Innovation EU Reporthttp://ec.europa.eu/bepa/pdf/publications_pdf/social_innovation.pdf
http://ec.europa.eu/regional_policy/newsroom/detail.cfm?id=597&LAN=EN
11
![Page 12: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/12.jpg)
Applications1. Safety (politics, military)
2. Public Safety (Live View) Example 1
3. Commerce (ads)
4. Banking (money streams)
5. Health care Example 2
6. Judiciary (CODR)
7. Waterway transport Example 3
8. Communication (twitter, phablet)
9. Education (MOOC)
10. Public governance
11. Warfare (Multi Agent Systems, Socio Cognitive Models)
MOOC = Massive Open Online Courses12
![Page 13: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/13.jpg)
Public Safety
13
![Page 14: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/14.jpg)
Flu prediction from correlation with Google search results
14
![Page 15: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/15.jpg)
Transport behavior by one vessel
15
![Page 16: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/16.jpg)
The places of all vessels at one moment
16
![Page 17: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/17.jpg)
New Developments
1. Computational Turn
2. Real-time Bidding (Sentiment mining)
3. Narrative Science
17
![Page 18: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/18.jpg)
Computational Turn: From causality to correlation
• Sampling is no longer at stake. Nowadays data from big populations (Twitter feeds, clicking behavior, Facebook data) are important.
• Insight into causal relations has lost its importance at many places.• Correlation (what works well and what not) has taken over priority.
This development is called Computational Turn.• Computational Turn asks for reflection from economics, law, social
sciences, behavioral sciences, and philosophical perspectives.
18
![Page 19: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/19.jpg)
Narrative Science
BIG DATA: - collection
- awareness
- usage
How did it happen that way?
- generation of data (collection)
- visualization of data (Napoleon)
- narrative science (which story is in BIG DATA?
e.g., Wiki Leaks?)
19
![Page 20: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/20.jpg)
Verdict collection
A “First” Collection by Ch.J. Enschedé
Collecting verdicts by the Dutch Courts is important for:
- Legal Certainty- Equality of Treatment
20
![Page 21: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/21.jpg)
Napoleon
21
![Page 22: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/22.jpg)
Narrative science
• Finding the causations behind the correlations: make a story• Examples:
– Boston April 2013– Google Flu chart
Future for AI:
Reason about correlations to predict causations
22
![Page 23: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/23.jpg)
Leiden Data Science Center
• The new center will focus on multidisciplinary research• Emphasis on data science: big data and small data• We start with:
– Bioscience– Human genome– Physics– Mathematics– Advanced computer science– Aviation– Law
23
![Page 24: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/24.jpg)
Leiden Centre of Data Science
24
![Page 25: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/25.jpg)
Leiden Centre of Data Science
25
![Page 26: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/26.jpg)
Theoretical physics
Leiden Centre of Data Science
26
Higgs boson found at LHC4 July 2012
![Page 27: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/27.jpg)
Leiden Centre of Data Science
27
![Page 28: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/28.jpg)
Leiden Centre of Data Science
28
![Page 29: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/29.jpg)
Leiden Centre of Data Science
29
![Page 30: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/30.jpg)
Leiden Centre of Data Science
30
![Page 31: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/31.jpg)
Leiden Centre of Data Science
31
![Page 32: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/32.jpg)
Leiden Centre of Data Science
32
![Page 33: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/33.jpg)
33
Leiden Centre of Data Science
![Page 34: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/34.jpg)
Leiden Centre of Data Science
34
Business Optimization
Activities
![Page 35: The all pervasive impact of Big Data in daily life From Causality to Correlation H.Jaap van den Herik 1,2,3 Rob van Eijk 2,3 (1) Leiden University, LCDS](https://reader036.vdocuments.net/reader036/viewer/2022062500/56649cee5503460f949bbd44/html5/thumbnails/35.jpg)
Leiden Centre of Data Science
35