Modernization Modernization of official statisticsof official statistics

Eric HermouetStatistics Division, ESCAP

hermouete.unescap@un.org

Changing environmentChanging environment

The data deluge New competitors Changing user demand Economic pressure

2

The data delugeThe data deluge

3

The internethad 1800exabytes ofdata in 2011

exa = 10^18

The data delugeThe data deluge

4

50 000 exabytes by 2020

Even if 99.9% are videos, photos, audio files, text messages etc., that still leaves a huge amount of potentially relevant data

New competitorsNew competitors

Google:– Real-time price indices– Public Data Explorer– First point of reference for the “data generation”

Facebook, store cards, credit agencies, ...– What if they link their data?

Can they provide an alternative to population censuses?

5

Changing user demandsChanging user demands

Statistics made available faster Need to answer wider range of user

– Need to package data differently

Need for more detailed information Need for integrated data products

– Linking logically datasets from different sources

6

Response of official statistics communityResponse of official statistics community

Develop and promote new:

Sources Processes Products

High-Level Group for Strategic Directions in Business Architecture in Statistics (HLG-BAS)– Created by the Conference of European Statisticians in

2010– 9 heads of national and international statistical

organizations

Civil Registration and Vital Statistics7

8

The Challenges are too big for statistical organizations to tackle on their own.

We need to work together

Collaboration

Coordination

Communication

9

What is modernization?What is modernization?

Common processes Common tools Common methodologies Recognizing that all statistics are produced in a

similar way:

No domain is “special” Increased flexibility to adapt to new sources and

produce new outputs

10

Industry standardsIndustry standards

Generic Statistical Business Process Model

Generic Statistical Information Model

Statistical Data and Metadata eXchange

Data Documentation Initiative

11

GSBPM – The BackgroundGSBPM – The Background

Statistical production has traditionally been organised by topic, e.g. transport, trade, …

Some statistical organisations are moving towards a process-based approach

12

GSBPM: Why do we need a model?GSBPM: Why do we need a model?

To define and describe statistical processes in a coherent way

To standardize process terminology To compare and benchmark processes within and

between organisations To identify synergies between processes To inform decisions on systems architectures and

organisation of resources

13

GSBPM: ApplicabilityGSBPM: Applicability

All activities undertaken by producers of official statistics which result in data outputs

National and international statistical organisations Independent of data source, can be used for:

– Surveys / censuses– Administrative sources / register-based statistics– Mixed sources

14

15

Key features of GSBPMKey features of GSBPM

Not a linear model Sub-processes do not have to be followed in a

strict order It is a matrix, through which there are many

possible paths, including iterative loops within and between phases

Some iterations of a regular process may skip certain sub-processes

16

Other uses of the GSBPMOther uses of the GSBPM

Harmonizing statistical computing systems Facilitating sharing of statistical software Framework for process quality management Structure for storage of documents Measuring operational costs

18

GSIMGSIM

The Generic Statistical Information Model is a reference framework of information objects, which enables generic descriptions of data and metadata definition, management, and use throughout the statistical production

process

Another model is needed to describe data and metadata objects and flows within the statistical business process

19

GSIMGSIM

Provide a common reference model for statistical information

Define the information required to drive statistical production processes and define outputs

Facilitate building efficient metadata driven collection, processing, and dissemination systems

20

Civil Registration and Vital Statistics21

Leads to a modular approach in designing software

Plug and play tools

Related ESCAP activitiesRelated ESCAP activities

EGM in June 2011 SIAP Management Seminar in December 2011 Moscow workshop, April 2012

On the agenda of the upcoming Committee on Statistics, December 2012

http://www.unescap.org/stat/MSIS/index.asp

Civil Registration and Vital Statistics22

Further informationFurther information

GSBPM– http://www1.unece.org/stat/platform/display/metis/The+

Generic+Statistical+Business+Process+Model

GSIM– http://www1.unece.org/stat/platform/display/metis/Gene

ric+Statistical+Information+Model+(GSIM)

HLG-BAS– http://www1.unece.org/stat/platform/display/hlgbas

23

THANK YOU.

Questions?

Civil Registration and Vital Statistics24