big data for the social sciences

34
Big Data for the Social Sciences David De Roure, Strategic Adviser for Data Resources @dder

Upload: david-de-roure

Post on 07-May-2015

241 views

Category:

Social Media


0 download

DESCRIPTION

Expert talk at JISC Digifest, March 2014, Birmingham, UK

TRANSCRIPT

Page 1: Big Data for the Social Sciences

Big Data for the Social SciencesDavid De Roure, Strategic Adviser for Data Resources @dder

Page 2: Big Data for the Social Sciences

Big Data doesn’t respect disciplinary boundaries

Digital Social Research

Page 3: Big Data for the Social Sciences

theODI.org

Page 4: Big Data for the Social Sciences
Page 5: Big Data for the Social Sciences
Page 6: Big Data for the Social Sciences
Page 7: Big Data for the Social Sciences

Mandy Chessell

Page 8: Big Data for the Social Sciences

The Big Picture

More people

More

mach

ines

Big DataBig Compute

Conventional Computation

“Big Social”Social Networks

e-infrastructure

onlineR&D

Big Data Production& Analytics

deeplyaboutsociety

The f

utu

re

Page 9: Big Data for the Social Sciences

RCUK and Big Data▶ ‘Big data is a term for a collection of datasets

so large and complex that it is beyond the ability of typical database software tools to capture, store, manage, and analyse them. ‘Big’ is not defined as being larger than a certain number of ‘bytes’ because as technology advances over time, the size of datasets that qualify as big data will also increase’ (RCUK)

▶But why do we want it?New forms of data enable us to

1. Answer existing research questions in new ways

2. Ask entirely new research questions

Page 10: Big Data for the Social Sciences
Page 11: Big Data for the Social Sciences

NERC Big Data

...as diverse as our science• From micro- to macro-scale• Many sources:

• Monitoring campaigns• Field sites & sensors• State-of-the-art laboratories• Ships & aircraft• Remote Sensing & EO• Regulator networks• Volunteers/citizen science• Model output

• Long-term and unique!

10µm

Page 12: Big Data for the Social Sciences

100 TB

Big data: time-based media including film, tv, cctv footage - retail data - geospatial data - email and social media - images and associated metadata - performance data including raw data of recordings, choreography, performance structure - open government data - music - large-scale digital scans - library, museum & gallery archives and metadata

Page 13: Big Data for the Social Sciences

Research benefits of new data▶Undertaking research on pressing policy-related

issues without the need for new data collection

• Food consumption, social background and obesity

• Energy consumption, housing type and climatic conditions

• Rural location, private/public transport alternatives and incomes

• School attainment, higher education participation, subject choices, student debt and later incomes

▶New data such as social media enable us to ask big questions, about big populations, and in real time – this is transformative

Page 14: Big Data for the Social Sciences

Big Data Network

Page 15: Big Data for the Social Sciences

Phase 1 and 2

Page 16: Big Data for the Social Sciences
Page 17: Big Data for the Social Sciences
Page 18: Big Data for the Social Sciences

E-i

nfr

ast

ruct

ure

Leaders

hip

C

ounci

l

Page 19: Big Data for the Social Sciences
Page 20: Big Data for the Social Sciences

Mandy Chessell

Page 21: Big Data for the Social Sciences
Page 22: Big Data for the Social Sciences

F i r s t

Page 23: Big Data for the Social Sciences

Interdisciplinary and “in the wild” *

* “in it” versus “on it”

Page 24: Big Data for the Social Sciences

Nigel Shadbolt et al

Page 25: Big Data for the Social Sciences

Real life is and must be full of all kinds of social constraint – the very processes from which society arises. Computers can help if we use them to create abstract social machines on the Web: processes in which the people do the creative work and the machine does the administration... The stage is set for an evolutionary growth of new social engines. The ability to create new forms of social process would be given to the world at large, and development would be rapid.

Berners-Lee, Weaving the Web, 1999 (pp. 172–175)

The Order of Social Machines

Page 26: Big Data for the Social Sciences

Some Social Machines

SOCIAM: The Theory and Practice of Social Machines is funded by the UK Engineering and Physical Sciences Research Council (EPSRC) under grant number EPJ017728/1 and comprises the Universities of Southampton, Oxford and Edinburgh. See sociam.org

Page 27: Big Data for the Social Sciences

Edwards, P. N., et al. (2013) Knowledge Infrastructures: Intellectual Frameworks and Research Challenges. Ann Arbor: Deep Blue. http://hdl.handle.net/2027.42/97552

Page 28: Big Data for the Social Sciences

Web as

lensWeb as artefact

Web as

infrastructure

Web Observatorieshttp://www.w3.org/community/webobservatory/

Page 29: Big Data for the Social Sciences

Big data elephant versus sense-making network?

The challenge is to foster the co-constituted socio-technical system on the right i.e. a computationally-enabled sense-making network of expertise, data, models and narratives.

Iain Buchan

Page 30: Big Data for the Social Sciences

Join the W3C Community Group www.w3.org/community/rosc

Jun Zhao

www.researchobject.org

Page 31: Big Data for the Social Sciences

Pip Willcox

Page 32: Big Data for the Social Sciences

Take homes

▶New forms of data enable us answer old questions in new ways and to answer entirely new questions

▶There are multiple shifts occurring:– Volumes of data– Realtime analytics– Computational infrastructure– Dataflows vs datasets (and curation

infrastructure)– Correlation vs causation– Increasing automation– Machine-to-Machine in Internet of Things

Page 33: Big Data for the Social Sciences

[email protected]

www.oerc.ox.ac.uk/people/dder

@dder

Slide and image credits: Fiona Armstrong, Christine Borgman, Iain Buchan, Mandy Chessell, Neil Chue Hong, Nigel Shadbolt, Pip Willcox, Jun Zhao, Guardian newspaper

Page 34: Big Data for the Social Sciences

www.oerc.ox.ac.uk

[email protected]@dder