the quality framework of european statistics by the escb quality conference vienna, 3 june 2014...
TRANSCRIPT
The quality framework of European statistics by the ESCB
Quality Conference Vienna, 3 June 2014
Aurel Schubert1)
European Central Bank
1) This presentation reflects the personal views of the author and not necessarily those of the ECB or the ESCB.
Rubric
www.ecb.europa.eu
AGENDA
1
2
3
Development of the framework
Quality assurance procedures
Presentation of ESCB public commitment
4 Conclusions and outlook
Rubric
www.ecb.europa.eu © 3
General public statement
Quality principles and associated indicators of good practice
ESCB public commitment
P1. Professional independence
P2. Mandate for data collection
P3. Adequacy of resources
P4. Commitment to quality
P5. Statistical confidentiality
P6. Impartiality & objectivity
P7. Sound methodology
P8. Appropriate statistical procedures
P9. Minimisation of reporting burden
P10. Cost-effectiveness
P11. Relevance
P12. Accuracy and reliability (incl. stability)
P13. Timeliness (incl. punctuality)
P14. Consistency and comparability
P15. Accessibility and clarity
Institutional environment
Statistical processes
High output quality
Rubric
www.ecb.europa.eu © 4
ESCB public commitment
Public statement
legal mandate
compliance with European and internationally agreed standards, guidelines and good practices
independence of the ESCB statistical function
collaboration with the ESS
efficient use of resources
Minimisation of reporting burden
confidentiality protection
Principles and good practice indicators
based on principles of existing quality frameworks adapted to ESCB institutional environment and operational features
5 models analysed:
similar scope and similar objectives interesting features in implementation and monitoring clear similarities with institutional environment of ESCB statistical function.
Rubric
www.ecb.europa.eu © 5
Bank of England Code of Practice (2004)
European Statistics Code of Practice (2005)
IMF DQAF (2003)
UN Fundamental Principles of Official Statistics (1994)
OECD Quality Framework (2003)
Development of ESCB framework
Provides the foundations for all quality frameworks
Rooted in the UN Fundamental Principles Provides an organised structure to assess existing practices against
best practices, including international methodologies; Easily applicable
Adaptation of the UN Fundamental Principles and DQAF to OECD institutional environment
Interesting monitoring of the implementation via the use of quality assurance procedures
Based on the Code of Practice of UK NSI Similar institutional environment Concepts of cost-efficiency and non-excessive burdens to respondents Code addressed to all stakeholders
Coherent with UN Fundamental Principles and IMF DQAF Of high relevance for the ESCB in view of the close cooperation with
the ESS
Rubric
www.ecb.europa.eu © 6
ESCB quality assurance procedures
Objectives
Characteristics
inform on activities, methods and tools used to implement the public commitment
address all key stakeholders
cover whole statistical production chain (incl. supporting IT infrastructure)
Rubric
www.ecb.europa.eu © 7
ESCB quality assurance procedures
Different domains:
Governance issues
Strategy, work programme and procedures to identify new user requirements and develop new statistics
Protection of statistical confidentiality
Quality assurance procedures related to the collection of data
Quality assurance procedures related to the compilation and the statistical analysis
Quality assurance procedures related to data accessibility and dissemination policy
Monitoring and reporting
Statistical processes monitoring
High output quality monitoring and reporting
Rubric
www.ecb.europa.eu © 8
ESCB statistical processes monitoring with IAC audit reviews
Audit reviews carried out by ESCB Internal Audit Committee (IAC):
Team of independent and specialized auditors on statistical issues
Audit scope focused on statistical processes
Statistical audits performed simultaneously in the ECB and all NCBs
audit recommendations applicable to whole ESCB
IAC follow-up procedure on implementation of recommendations with regular reporting to ECB decision-making bodies
13 statistical audits since 1999
all European statistics produced by the ESCB
ESCB statistical information systems
ESCB procedure to develop new statistics
Governance of ESCB statistical databases projects
Rubric
www.ecb.europa.eu © 9
High output quality monitoring
ESCB prepares annual quality reports to assess availability and quality of all European statistics from ESCB – reports also published on ECB website
provide a good overview of the availability of the statistics
assess quality in terms of punctuality, timeliness, methodological soundness, reliability and stability
report on state of affairs concerning implementation of enhanced or new statistical requirements
provide information on possible further improvements to data collection and compilation methods and to level of detail and/or frequency of input data.
frequency, number, direction, magnitude and patterns of revisions
internal and external consistency of data
Objectives:
Quantitative indicators to assess:
Rubric
www.ecb.europa.eu © 10
Conclusions and outlook
useful communication tool
provides ESCB staff with complementary benchmark for day-to-day compilation work, release of statistics and development of new statistical products
continuously tries to improve statistical output quality and statistical processes
scrutinises quality management and assurance procedures
ESCB public commitment ESCB statistical function
New initiatives
development of comprehensive ESCB quality framework with publication of ESCB quality assurance procedures together with quality principles
establishment of comprehensive list of all aspects to be possibly integrated in statistical audits
improve user-friendly access to statistical data and metadata
importance of sharing good practices with other statistical authorities
Thank you for your attention.