federal department of home affairs fdha federal statistical office fso meeting of the oecd expert...

Federal Department of Home Affairs FDHAFederal Statistical Office FSO

Meeting of the OECD Expert Group on SDMX

13 - 14 September, OECD, Paris

Centralized Metadata System based on SDMX”Case Study : Swiss Federal Statistical Office

Jean-François Fracheboud

2 Meeting of the OECD Expert Group on SDMX / Centralized Metadata System based on SDMX

Author : FSO / Jean-François Fracheboud


SDMX through the GSBPM

1Specify

Needs

2 Design

3 Build

4 Collect

5 Process

6 Analyse

7 Disseminate

8 Archive

9 Evaluate

SDMX generally focuses on dissemination (transmission of

data and metadata)

What about SDMX in the production of statistics ?

Case Study ot the Swiss Federal Statistical OfficeHow a statistical metadata system based entirely on

SDMX has been implemented




Challenges

• A centralised system for a decentralised management of metadata

• An integrated system for the whole life cycle of statistics

• A unique entry of metadata and a multiple usage of them

• A harmonisation of metadata on several levels :

• Harmonisation of the form : according to SDMX model

• Harmonisation of codelists

• Harmonisation of variables (concepts)

• Harmonisation of data and metadata models

• Acceptance of the system and adoption by the statistician




• Improve the comparability of data and metadata at national and international levels

• Support for harmonisation

• More efficiency in every statistical processes

• Optimise reuse of metadata and data

• Ensure the tracability in statistics

• Improve the quality of metadata and data

Why a SMS ?

• Reduce delays in publishing




Contrat

Repository

Repository

Repository

Repository

Web Server IIS

Web S

ervices

SDMX editor

ETLSASC#, .NET, etc.

Standard request

Standard documents

Repository

SMS Architecture

http://www.google.ch/imgres?imgurl=http://icdn.pro/images/fr/d/o/document-xml-icone-9378-128.png&imgrefurl=http://icones.pro/document-xml-image-png.html&usg=__MGXMKnmwLR3W27U5hnbyaH8cSYw=&h=128&w=128&sz=12&hl=fr&start=4&zoom=1&tbnid=pw5IdLn6sx_knM:&tbnh=91&tbnw=91&ei=9uxET6mlKIOhOpvKvZkC&prev=/search?q=xml&hl=fr&sa=X&tbs=isz:i&tbm=isch&prmd=ivns&itbs=1

http://www.google.ch/imgres?imgurl=http://a.dryicons.com/images/icon_sets/coquette_part_5_icons_set/png/64x64/html_file.png&imgrefurl=http://dryicons.com/icon/coquette-part-5-icons-set/html-file/&usg=__1AkPyyC5XaU3wgCZOxy-CJj64LQ=&h=64&w=64&sz=8&hl=fr&start=8&zoom=1&tbnid=hnLuxuA85WZs7M:&tbnh=64&tbnw=64&ei=J_BET9HfHoqZOtq_jY4C&prev=/search?q=HTML&hl=fr&sa=X&tbs=isz:i&tbm=isch&prmd=ivnsb&itbs=1

http://www.google.ch/imgres?imgurl=http://www.ducommun.ch/img/imanager/general/pdf_icon.png&imgrefurl=http://www.ducommun.ch/index.php?c=MTc=&usg=__6FyjlMiYQae_dNnbVcMznUF1r_A=&h=128&w=128&sz=8&hl=fr&start=10&zoom=1&tbnid=o5oK3kGWafaAJM:&tbnh=91&tbnw=91&ei=h_BET-XfLoagOrOxlZAC&prev=/search?q=PDF&hl=fr&sa=X&tbs=isz:i&tbm=isch&prmd=ivnsb&itbs=1

http://www.google.ch/imgres?imgurl=http://c.dryicons.com/images/icon_sets/coquette_part_5_icons_set/png/128x128/csv_file.png&imgrefurl=http://dryicons.com/icon/coquette-part-5-icons-set/csv-file/&usg=__XRgoULHBJ1MlubCMCOrNbyTEEdk=&h=128&w=128&sz=9&hl=fr&start=4&zoom=1&tbnid=1h27_2O8ORU2SM:&tbnh=91&tbnw=91&ei=yPNET-ifN4rpOeDG6IkC&prev=/search?q=csv&hl=fr&sa=X&tbs=isz:i&tbm=isch&prmd=ivns&itbs=1




Admin

Metadata Editing

Advanced Functions

Plug-ins

Functionalities




Manage-ment

Base

Fonctionnalités avancées

Plugins

Functionalities

Metadata editing

Entry Create, Modify, Validate,Versions, Historic, Save

Import-Export SDMX, excel, Word, pdf, etc.

Accessibility Web Services, Navigation, Visualisation




Advanced Functions

Plug-ins

Metadata Editing

Admin

Functionalities

Plugins (extensions)

• Export of metadata on other systems (SAS,

Oracle, SQL Server, etc.), automatic creation

of tables (from a DSD for example)

Generator of codebook (DDI)

• Interface extension (customizing)

• Electronic questionnaire

• Validation of data with DSD

• Etc.• etc.




FunctionalitiesAdvanced Functions

Metadata Editing

Plug-ins

Admin

Vision for the future

• Accessing the data by the metadata

• Multidimensional visualisation of data

• Modeling and monitoring of business processes




Metadata through the GSBPM

Creation of metadata

Use of metadataMost of metadata should be created during the first three stages




Statistical

Domains

Variables

Classifications and codelists

Metadata Structure

Definitions

Data Structure

Definitions

Simplified Model




• Defining the statistical activities of FSO (political mandate)

• Organising these activities in one or more hierarchies (example : FSO statistical programme)

• Defining the data- and metadata-flows linked to these statistical activities

Statistical domains and activities




Model for Statistical Activities

Statistical Activity Instance

Statistical Activity

Statistical Activity Family

Statistical Activity Family

Statistical Activity

Statistical Activity Instance

1




Statistical

Activities

(occurences)

Metadataflows

Dataflows

Attach metadataflows and dataflows to the activities




Statistical

Domains

Variables


Metadata Structures

Data Structures

Simplified Model




Variables / Concepts

Identification, nom et description des variables

Définition type et format

Nomenclatures associées

Hiérarchisation des variables

• Import standard ConceptSchemes

• Create domain specific ConceptSchemes

• Describe the variables/concepts (definition, format, reference, etc.)

• Link the codelist to the variables




Statistical

Domains

Variables


Metadata Structures

Data Structures

Simplified Model




18


• Import standard national and international codelists

• Create cross domain or domain specific classifications and codelists




Statistical

Domains

Variables


Metadata Structures

Data Structures

Simplified Model




20

Data and MetadataStructure Definitions

• Modeling statistical data and metadata

• Description of data and metadata (tables or files)

• Defining attributes (quality, confidentiality, observation status, etc.) at required level (record, item, cell, etc.)

• Description of macro-data (times series, hypercubes, etc.)




Data Warehouse

data

Data Structure




identify describe

Structural Metadata

SDMX Artefacts

• Concepts• Codelists • Data Structures

Data Warehouse

metadata

data

Data Structure




identify describe

Statistical Metadata SystemStructural Metadata

SDMX Artefacts

• Concepts• Code lists • Data Structures

Data Warehouse

metadata

data

Data Structure




Predefined MetadataStatistical

Domains

Variables


Metadata Structures

Data Structures

Extensions

Annotations

MSD

DSD

Metadata

Question-

naires

Quality

Metadata




The basic IT application for the SMS is available free of charge and can be found at the following adresses:

www.sdmx.org or

www.sdmx.ch

Download the IT application

http://www.sdmx.org/

http://www.sdmx.ch/




For more information about the Swiss Statistical Metadata System

please contact :[email protected]

Contacts

federal department of home affairs fdha federal statistical office fso meeting of the oecd expert...

Documents

statistical metadata

sdmx author

harmonisation of metadata

reuse of metadata

quality of metadata

importexport sdmx

fso statistical programme

oecd expert group