Unified information system Unified information system ofof statistical data collection, statistical data collection, processing,processing,

storage and dissemination storage and dissemination (Rosstat UIS(Rosstat UIS ) )

OverviewOverview

FEDERAL STATE STATISTICS SERVICE (ROSSTAT)

Elena Priakhina,Director of the Scientific - Research and Project Institute of Rosstat , Moscow

FEDERAL STATE STATISTICS SERVICE STRUCTURE

DISTRICT STATISTICAL DIVISIONS (DSD)

TERRIRORIAL STATE STATISTICS OFFICES (TSO)

ROSSTAT MAIN COMPUTING CENTER

ROSSTAT CENTRAL OFFICE

RESEARCH & PROJECT INSTITUTEI

FEDERAL STATE STATISTICS SERVICE STRUCTURE

Rosstat has the distributed hierarchical structure and includes: At the Federal level:At the Federal level: Rosstat Central Office responsible for methodology and for the presentation of

official statistical information to the government, to ministries and agencies and other users

Main computing center responsible for data collection from regional level, data processing and presentation to Rosstat Central Office

Scientific - Research and Project Institute engaged in the development of application software for all stages of technological process

At regional level:At regional level: Territorial statistical offices (TSO) allocated in regions of the Russian Federation

have to ensure statistical data collection, processing, storage and dissemination at the regional level

At district level:At district level:

District (town) statistical Divisions of TSO are engaged mainly in statistical data collection from enterprises and organizations and presentation to regional level

Regional levelRegional level – 83 – 83 Territorial statistical offices (TSO)Territorial statistical offices (TSO)District levelDistrict level – – >> 2000 2000 District (town) statistical Divisions of TSO DSDDistrict (town) statistical Divisions of TSO DSD

Copyright (с) Госкомстат России, 2004

ЭвенкийскийАО

Республика Саха (Якутия)

РеспубликаБурятия

Таймырский(Долгано-Ненецкий

АО)

Красноярскийкрай

Читинскаяобл.

АгинскийБурятский АО

Усть-ОрдынскийБурятский АО

Иркутская обл.

Ямало-Ненецкий

АОХанты-Мансийский

АОСвердловскаяобл.

Тюменскаяобл.

Омскаяобл.

Томскаяобл.

Алтайскийкрай

РеспубликаАлтай

РеспубликаХакасия

РеспубликаТыва

Кемеровскаяобл.

Новосибирскаяобл.

Курганскаяобл.

Челябинскаяобл. Амурская

обл.

Мурманскаяобл.

НенецкийАО

РеспубликаКарелияПсковская обл.

Калининградская обл.

Ленинградская обл.

16

15Архангельская

обл.

Республика Коми9

14

Смоленская обл.

Тверская обл.

Брянская обл. 5

13 642118

12

107

13

23

Ростовскаяобл.

Волгоградскаяобл.

Астраханская обл.

Роспублика Калмыкия

РеспубликаДагестан

Оренбургскаяобл.

24

22

20

17

192118

31

37

33

3227

38

30 26

3625

28 2935

34

Чукотский АО

КорякскийАО

Магаданскаяобл.

Хабаровскийкрай

Приморскийкрай

Камчатскаяобл.

Сахалинская обл.

Еврейскаяавтономная

обл.Цифрами на карте обозначены:

31 - Кировская область

28 - Республика Татарстан

25 - Республика Башкортостан

37 - Саратовская область19 - Кабардино-Балкарская Республика 38 - Ульяновская область

27 - Республика Мордовия10 - Орловская область16 - Новгородская область2 - Владимирская область

34 - Пермская область

13 - Тульская область 30 - Чувашская Республика

21 - Республика Северная Осетия - Алания

5 - Калужская область 18 - Республика Ингушетия

33 - Пензенская область1 - Белгородская область 32 - Нижегородская область

23 - Краснодарский край

35 - Коми-Пермяцкий АО

24 - Ставропольский край

36 - Самарская область6 - Костромская область

3 - Воронежская область9 - Московская область

11 - Рязанская область

7 - Курская область

29 - Удмуртская Республика12 - Тамбовская область

14 - Ярославская область

8 - Липецкая область

4 - Ивановская область

26 - Республика Марий-Эл

22 - Чеченская Республика

15 - Вологодская область 20 - Карачаево-Черкесская Республика

17 - Республика Адыгея

• Official Federal Plan of Statistical Works contains more than 400 statistical works

• More than 20 000 statistical indicators

• Rosstat generates 60% of total volume of statistical information in Russia

• 250 statistical forms (questionnaires) including: some 120 – annual, 60 – quarterly, 60 – monthly

• Number of units under statistical observation comprise more than 3 million

Russian Statistics today

Unified information systemUnified information system of statistical data collection,of statistical data collection, processing, processing, storage and dissemination (Rosstat UISstorage and dissemination (Rosstat UIS))

Main goalsMain goals

• Decrease of data collection and processing periodDecrease of data collection and processing period• Decrease of labor costDecrease of labor cost• Implementation of modern information technologyImplementation of modern information technology

Basic principlesBasic principles • UnificationUnification• AdaptabilityAdaptability

Problems and Solutions

Problems SolutionsVarious applications for 400 statistical works

Single unified software for all statistical works

Lack of metadata for system to be adjusted to changes in questionnaires

Common Metadata Concept and Rules for Metadata description for collecting, processing and dissemination

Different version of classifications… Unified system of classifications

Different technologies and user interfaces for statistical works

Unified technology and user interface for all works

Main information flows of the systemMain information flows of the system of statistical data collection,of statistical data collection, processing, storage and disseminationprocessing, storage and dissemination

Enterprises and organisations

District level Regional level Federal level

WEB

Electronic questionnaires

Paperquestionnaires

USERSUSERS

CSICSI GUGU CSICSI GUGU

Warehouse Warehouse

SDCP ofdistrict level

SDCP ofdistrict level

SDCP ofregional level

SDCP ofregional level

SDCP offederal level

SDCP offederal level

ArchitectureArchitecture of the systemof the system of statistical data collection,of statistical data collection, processing, processing, storage and disseminationstorage and dissemination ((Rosstat UISRosstat UIS))

CSIGUSSESQ

DWFL

CWS

CSDB

RSDB

Uploading data must be correspond to indicators of CSI

Data warehouse and ЕTL allow to upload the information even at change of input forms

WEB-forms data input

From paper

Input forms on the paper

Off-line

From file

The subsystem of data collection

and processing (SDCP)

The subsystem of classificationsE

TL

ET

L

Datainput application

E-mail

district

SDCP

Federal level

Regional (district) level

Enterprise level

federal

Unified system ofuser access

Unified system ofuser access

The subsystem of storage and dissemination

On-line

DWRL

Subsystem of classificationsSubsystem of classifications

• Data base of classificationsData base of classifications

• Data base of enterprises andData base of enterprises and organizationsorganizations

• Data base of statistical indicatorsData base of statistical indicators

The subsystem of data collection and processingThe subsystem of data collection and processing

• Unified software application for all statistical works Unified software application for all statistical works - - UnifiedUnified SystemSystem « «STATECSTATEC»»

ComponentComponent for electronic data collection from for electronic data collection from

enterprisesenterprises

Component Component for receptionfor reception ( (inputinput), ), verificationverification, , processing and table generation processing and table generation

• Metadata baseMetadata base• Operating data bases for statistical works Operating data bases for statistical works

____________________________________ ____________________________________ • DBMSDBMS MS SQL ServerMS SQL Server• ClientClient--Server application is based on PowerBuilderServer application is based on PowerBuilder• WebWeb--applicationapplication is based on ASP.NETis based on ASP.NET

MS SQL Server

Operational databases of statistical works

SDCP based on «STATEC»

Unified business logic for all works Statistical

reportsOutput tables

RespondentsEconomists and Analytics

Operator of data collecting and processing subsystem

The subsystem of statistical information storage, presentation and dissemination

• Data Warehouse (DWH) of statistical data have the same structure at federal and regional levels

• DWH structure is based on Catalog of statistical indicators (CSI)

• Data marts are generated from DWH for different aims (data dissemination, analysis of selected branches and sectors of the economy)

• Data dissemination is carried out via web-interfacewith Central statistical data base (CSDB) on web-site of Rosstat

• Unified system for internal user access to DWH of statistical data is being developed now

_________________________________• DBMS MS SQL Server• Applications are based on PowerBuilder, ASP.NET

Federal State Statistics Service (Rosstat)

SCREENSHOTS OF SUBSYSTEM

Statistical reports collection in electronic modeStatistical reports collection in electronic mode

Respondent logs in to the system

selects a statistical form

verifies a report

saves and sends a report

exports a report to MS Word or Adobe

PDF

fills a form (makes a report)

signs a report by digital signature before sending

gets the stamp of sending

Work 3

Work 2Work 1

Statistical data processingStatistical data processing

Basic stagesBasic stages Data input Data control Data processing (aggregation) Printing output tables

Work place for data entry

Work place for verification

Work place for tables generation

Storage and presentation of statistical data Storage and presentation of statistical data

Select a category of the data

Select values of dimensions

Select indicators from the DW catalogue

Build model of output table

Get the result

Printing from browser

MS Excel XML (SDMX)

There is ability to find value on name or code

Select: Macro or micro data.

Catalogue of indicators corresponds to CSI. There is ability to find indicator on name or code.

Set of dimensions depends on selected indicators. Values of dimensions has linear or hierarchical structure. There is ability to find а value of dimension on name or code from dictionary.

Data arrangement in the output table depends on arrangement of dimensions and measure in the model.

Results

• Unified system of data collection and processing on basis of “STATEC” is used for 400 Statistical works

• Collection of statistical reports in electronic mode has been implemented for 20% of reporting units

• Statistical data Warehouse is being loaded with respective data

Federal State Statistics Service (Rosstat)

THANK YOU FOR ATTENTIONTHANK YOU FOR ATTENTION ! !