managing data to maximise value supporting flexible and efficient production of official statistics...
DESCRIPTION
Statistics 2020 – Te Kāpehu Whetū 6/03/20163 Nine year programme of change Transforming the way that Official Statistics are delivered Efficiency Data is able to be re-used Work across the entire OSS A sustainable organisationTRANSCRIPT
Managing data to maximise valueSupporting flexible and efficient production of
official statistics
Adam BrownDecember 2012
Statistics 2020 – Te Kāpehu WhetūBenefits of managing statistical informationVisionSteps to the futureExperiencesBuilding an ecosystem across the OSS
08/05/23 2
Statistics 2020 – Te Kāpehu Whetū
08/05/23 3
Nine year programme of change
Transforming the way that Official Statistics are delivered• Efficiency• Data is able to be re-used• Work across the entire OSS• A sustainable organisation
Managing statistical information
‘Metadata’ - information describing aspects of the statistical business process and the resulting data and statistics
Metadata Infrastructure project
08/05/23 4
Data is expensive – re-use is vital
08/05/23 6
Flexible and efficient
Respond to changing user needs
Reduce ‘time to market’
Reduce re-work and duplication of effort
To enable this we need to ensure …Data is easily discoverable
Data definitions (e.g. classifications) are standardised
Consistent and comprehensive high quality metadata is captured throughout the statistical production process
The ability to easily and flexibly reuse metadata across systems – capture once use many times
08/05/23 7
Vision
Information required to support statistical production is easily available to be used and reused, and where it
doesn’t yet exist, is easy to create
08/05/23 8
08/05/23 9
How well is the mining industry doing in New Zealand? How much did they earn in sales last year?
10
Look
How well is the mining industry doing in New Zealand? How much did they earn in sales last year?
11
Look
How well is the mining industry doing in New Zealand? How much did they earn in sales last year?
12
Reuse
Census of Mining
data
Existing definitions of mining
Industrial classification
13
Create How well is the mining industry doing in New Zealand? How much did they earn in sales last year?The New Mining Survey
ANZSIC 2006
New concept of
mining
Delivering change
08/05/23 14
1. Know what we’ve got
Identify the information and data that is held by the organisation
Find out what can be re-used, where it is located and key considerations for use
Retention, Preservation and Disposal statements
08/05/23 15
08/05/23 16
2. Know how to use it
Simple templates to capture information about context and definitions for data
Central shared system to enable discovery of information in a single authoritative resource
Content guidelines
08/05/23 17
08/05/23 18
08/05/23 19
08/05/23 20
08/05/23 21
08/05/23 22
08/05/23 23
3. Put the information to work
Create documentation
Share information with processing and dissemination systems
Make new connections
08/05/23 24
25
Process system n Analyse system n
Micro Economic Platform
Macro Economic Platform Stats.govt.nz
Dissemination PlatformCollection Platform
Social & Population Platforms
Metadata
4. Improve development of new components
New classification management system in development
Prototype questionnaire design tool
08/05/23 26
5. HarmonisationTerminology• How do we define a concept, variable?
Definitions• 27 definitions of income!• Implicit to explicit
Structure
08/05/23 27
Our approach
Utilise standards where they work for us
Use what is available
Staged approach – learn as we go
08/05/23 28
OSS metadata ecosystem
Data management support
Colectica pilot
Confidentiality and privacy advice
Data Archive
08/05/23 29