big data and alternative data sources on migration · fernando reis, task-force big data european...
TRANSCRIPT
![Page 1: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/1.jpg)
The use of big data in official statistics
Fernando Reis, Task-Force Big Data
European Commission (Eurostat)
Big Data and Alternative Data Sources on Migration
Ispra, 30th November 2017
![Page 2: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/2.jpg)
Big Data Action Plan and Roadmap @ a glance
Policy Quality Skills
Experience sharing
Legislation IT
Infrastructures
Methods Ethics /
Communication Big data sources
Governance
Pilots
![Page 3: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/3.jpg)
Mobile network data for population statistics (Belgium)
Census (2011) Number of devices at 2:30 - 4:00 (8 Oct 2015)
![Page 4: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/4.jpg)
From Internet of Things and Smart Systems…
• The network of interconnected smart devices
• Smart devices
• Connected
• Interactive
• Intelligent Predictive
Function autonomously
• Smart technologies
• Adapt automatically
• Sense things with sensors
• Draw conclusions from rules
• Capable of learning Licensed under the terms of cc-by-2.0.
![Page 5: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/5.jpg)
… to Trusted Smart statistics
• Data capturing, processing and analysis will be embedded in the system itself
• Intelligence along data life-cycle enhanced with cognitive processes
•
![Page 6: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/6.jpg)
Trusted Smart Statistics
Proofs-of- concept
• Give life to an idea
• Provide evidence that IoT data (eco)systems can be used for official statistics
Prototypes
• Functional model of producing statistics leveraging BD + IoT
• Monitored use
• Sandbox infrastructure
• Methodology constructing
• Quality evaluating
• Ethical guidelines evaluating
• Limited number of NSIs
Working products
•Fully operational
•Integration with other statistics •Up-sized prototype •Unmonitored use
•IT infrastructure
•Methodology
•Quality
•Ethics
•ESS
?
?
![Page 7: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/7.jpg)
Partnerships
• National Statistical Institutes or other statistical authorities
• Mobile network operators
• Telecommunication regulators
• Data protection authorities
![Page 8: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/8.jpg)
Role of statistical authority
• Has legal mandate to produce official statistics (statistical law)
• Has legal basis to collect personal data (statistical authority)
• Has legal guarantees and obligations to protect it (statistical confidentiality)
• Has experience in statistical production
• Has access to other data sources to assess and guarantee quality / accuracy
![Page 9: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/9.jpg)
Role of mobile network operator
• Data holder
• Knowledge on the data source
• Technical capacity (IT)
• Collaboration will depend on: • Maturity in the exploration of the data
• Technical capacity to explore / handle the data for purposes other than managing the infrastructure
• Regulatory requirements
• Potential gains for MNO: • Profit from statistical expertise of NSI
• Access to other data sources in the NSI
• Image and social responsibility
![Page 10: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/10.jpg)
Role of telecommunications regulator
• May already have mandate to collect records
• Already has regular contacts with MNOs
• Can facilitate the partnership in the initial phase before regular statistical production is established
![Page 11: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/11.jpg)
Role of data protection authority
• Sometimes obligatory by law to involve DPA
• Can help strike balance between public interest and privacy preservation
• Can enhance public trust in the partnership
![Page 12: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/12.jpg)
Other stakeholders
• Research community
• Third parties (e.g. with expertise in the data source)
• International organisations (e.g. if project involves several countries)
• Legislators
![Page 13: Big Data and Alternative Data Sources on Migration · Fernando Reis, Task-Force Big Data European Commission (Eurostat) Big Data and Alternative Data Sources on Migration Ispra, 30th](https://reader033.vdocuments.net/reader033/viewer/2022041418/5e1ce87c8f4bbf783a42fe3d/html5/thumbnails/13.jpg)
Thank you for your attention
Fernando Reis
Eurostat Task Force on Big Data
https://github.com/reisfe/
https://twitter.com/reisfe/
https://linkedin.com/in/reisfe/