role of metadata in data dissemination presented at the

1 Role of Metadata

Role of Metadata in Data Dissemination

Presented at the UN Regional Seminar on Census Data

Dissemination and Spatial Analysis

Motale PhirwaStatistics South Africa17th September 2010

Nairobi, Kenya

2 Role of Metadata

What is metadata?

• Data about data.

• Information that enhances the understanding of data.

3 Role of Metadata

Categories of Metadata for Surveys

• Survey Metadata•Concepts and definitions including the way the question is asked in the survey •Classifications (code lists)•Operational metadata including methodology •Data editing instruction

4 Role of Metadata

Categories of metadata for Surveys

• Survey Instance Metadata – information about a particular occurrence of a survey

•Response rates•Imputations rules and results•Any deviations from the survey norm

5 Role of Metadata

Metadata Development @ Statistics South Africa

6 Role of Metadata

Electronic Data - Unit records on CD

• All unit records of sample household surveys. 10% sample of population census unit record. All unit records are confidentialised.

• Who should use this?Researchers and value-add service providers

• What is available?Quarterly labour force survey, General household survey.

7 Role of Metadata

Electronic Data – Time Series

• Time series data in ASCII, Excel and PX-web that can be downloaded. PX-web allows a user to subset the data.

• Who should use this?The general public

• What is available?Building statistics, Civil cases for debt, Consumer Price Index, Electricity generated and available for distribution, Gross Domestic Product, Food and Beverages, Land Transport survey, Liquidations and insolvencies, Manufacturing Production and Sales, Mining Production and Sales, Motor trade sales, Production Price Index, Retail trade sales, Tourism and migration, Tourist Accommodation, Utilisation of production capacity, Wholesale trade sales, mid year Population Estimates

8 Role of Metadata

Electronic Data -Superweb

• The web-based version of SuperCross for users to tabulate and download tables, charts and maps.

•  Who should use this?The more advanced user looking for more detail

• What is available?Census 2001, Community Profiles, Community Survey 2007: Community Profiles, Income and Expenditure of Households 2005/2006

9 Role of Metadata

Electronic Data - Unit Records on CD

• View QLFS

10 Role of Metadata

11 Role of Metadata

12 Role of Metadata

Databases in Nesstar

13 Role of Metadata

14 Role of Metadata

15 Role of Metadata

description

# of records

graph

variable name

16 Role of Metadata

17 Role of Metadata

Critical Success Factors for Metadata

• Appropriate documentation from all involved in the survey value chain

• Skills to do data preparation– Information technology– Data management– Statisticians

• Good telecommunication infrastructure– Mid to high end stand alone desk/laptop– Web servers– Bandwidth

18 Role of Metadata

Benefits of Metadata

• Reduced burden on resources of the NSO in responding to user enquiries– promote user self service resulting in increased use of data. – Statistician can focus on other work

19 Role of Metadata

Thank you