jodi-gas data reporting system, quality assessment · other modules. • data exchange ... gecf...

29
GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org JODI-Gas Data Reporting System, Quality Assessment By Mr. Majid Badihi , Senior ICT Analyst and Mr. Mohamed Arafat , Databank Analyst Joint Organisations Data Initiative (JODI) 14 th Regional Training Workshop 09 11 May 2016, Moscow, Russia No portion of this presentation may be reproduced, reused or otherwise distributed in any form without prior written consent

Upload: others

Post on 18-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

JODI-Gas Data Reporting System, Quality Assessment

By Mr. Majid Badihi , Senior ICT Analyst

and Mr. Mohamed Arafat , Databank Analyst

Joint Organisations Data Initiative (JODI)

14th Regional Training Workshop

09 – 11 May 2016, Moscow, Russia

No portion of this presentation may be reproduced, reused or otherwise distributed in any form without prior written consent

Page 2: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Outline

Background(Who is the GECF, GECF Vision and Mission, GECF role in gas market)

GECF Data Reporting Mechanism

Mapping GECF and JoDI-Gas Questionnaires

GECF Data Exchange Center

Quality Indicators Sustainability of Submission, Timeliness,

Completeness

Data validation techniques

Consistency with other energy statistics

Participation assessment (smiley face) approach

Future Plans.

2

Page 3: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 3

Algeria

Bolivia

Egypt

Iran

Libya

Nigeria

Oman

Trinidad

and Tobago

Equatorial Guinea

Venezuela

Russia

MEMBERS

Qatar

The Netherlands

Norway

Kazakhstan OBSERVERS: Iraq

United Arab

Emirates

Peru

Azerbaijan

Page 4: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

GECF Overview

4

• The Member countries of the Forum are: Algeria, Bolivia,

Egypt, Equatorial Guinea, Iran, Libya, Nigeria, Qatar,

Russia, Trinidad and Tobago, United Arab Emirates and

Venezuela. Azerbaijan, Iraq, Kazakhstan, the

Netherlands, Norway, Oman and Peru have the status of

Observer Members.

• With the current number of Members the GECF has a

strong position on the world gas market and among

international energy organizations. Its potential rests on

the enormous natural gas reserves of the Member

Countries all together accumulating 67% of the world

proven natural gas reserves.

Page 5: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 5

To become an authentic platform for

Gas activities

A Credible reference in gas studies

and debate

A center for exchange of data and

information on gas

A center for policy debate on gas and

energy

A center for exchange of experience

on Gas

Vision

To promote the use of Gas as a clean fuel and

contribute to the clean environment and

sustainable development;

To increase the market share of Gas in the

global energy mix;

To contribute to the stability of the global gas

market;

To exchange data, information and experience

among member countries;

To develop Dialogue with all stakeholders,

including other producers and consumers.

Mission

Background: GECF Vision & Mission

Supporting the rights and interests of the Member countries on gas resources

Page 6: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 6

Step II

Test

Step I

Start-up

Step III

implementation

Step IV

improvement

- Develop IT infrastructure for

collaborative work

- Identify all possible data

sources

- Definition and communication

of Data collection procedure

- Identify Technical coordinators

for data submission

- Meetings & Workshops with

members countries

- Test of the reporting system

- Meetings of working party

on flow of statistics

- Visit to the Member

Countries (designation of

focal point for statistics)

- Direct data communication

with the MCs

- Establish a manual

- Publication of a Monthly

report

- Monthly and quarterly

statistical reports

- Annual questionnaire &

statistical bulletin

- Online-based library and

system for data collection

- Promote, cooperate to the

launch of the « Joint Gas

Data initiative :JGDI » and

then coordinate for MC’s

- Continuous improvement

in coverage

- Assess data quality

- Annual Meetings on

statistics

- Acquiring data from

external sources

- Involve International /

regional organizations in

Annual Statistical

Meetings

- Training and workshops

Establishment of a Reporting System

Page 7: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

GECF Monthly Questionnaire

7

Production / Consumption Natural Gas Balance

Gas Production Reinjection/

Shrinkage

Flaring/

Uses/

Losses

Gas

Production

Other Sources

Gas Marketed

Production

Marketed

Gas

Production

LNG self

consumption

Other

Losses Imports

Domestic

Gas

Consumption

Exports

Production balance

Consumption balance

Of which LNG

production Of which Power

Generation/industrial Use Pipeline/LNG

Stock

change

Gas Exporting Countries Forum

Instructions

Deadline For Submission: 20 th day of each Month (M) for Data of Month (M-1)

1.Please do not change the format of the Excel Form

2.Please make sure that you read the definitions before filling the Form

3.Please only enter round number without decimal

4.Please fill the Form based on requested unit, if you have to use other unit do not forget to mention it

Please save and send the form to: [email protected]

For more information please contact to: Data Administrator Contact No. +974 4404 8420

Monthly Questionnaire

12-20 Data points

in one unit

Page 8: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 8

Mapping GECF to JoDI-Gas

Natural Gas

in million m3

(at 15oC, 760 mm hg)

Natural Gas

in Terajoules

Natural Gas

(LNG)

in 1000 metric tons

Production 3888.427982

Receipts from Other Sources 340.123177

Imports 0

LNG 0 0

Pipeline 0

Exports 0

LNG 0 0

Pipeline 0

Stock Change 42.043871

Gross Inland Deliveries (Calculated) 3846.384111 0

Statistical Difference (Calculated) 0 0

Gross Inland Deliveries Observed 3833.698

of which: Electricity and Heat Generation 2087.42

Closing stocks

Marketed

Production – From

Other Sources

JoDI-GAS Quest. GECF Quest.

Page 9: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Role-based Security System

9

• What a user can see or do depends on what role(s) he has.

• Roles: Focal point, Analyst, Administrator, ……

Page 10: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

GECF Monthly Questionnaire in DEC

10

Unified GECF monthly questionnaire and related products and flows

definitions are in place.

Page 11: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

DEC : Data Accessibility / Transparency

11

A Focal Point can browse, group , search , filter , sort monthly questionnaire data

of all GECF countries.

Page 12: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

DEC data Accessibility: Simple and Advanced Filter

12

Filter by one or more columns

Build a complex query with several

conditions

Page 13: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

13

Export data into different file formats including Excel.

DEC data availability : Data Export

Page 14: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Monthly Questionnaire: Excel and DEC

14

MC Focal Point can fill the monthly questionnaire template in Excel file or directly

update the web-based Data Exchange Center (DEC).

Page 15: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

DEC Data Quality: Country Specific Data Entry Validation Rules

15

Page 16: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Quality Indicators : Sustainability of Submission

16

Year Algeria Bolivia Egypt Eq. Guinea Iran Libya Nigeria Oman Qatar Russia Trinidad and Tobago United Arab Emirates Venezuela Grand Total

2011 0 12 12 0 7 0 0 12 0 0 12 0 12 67

2012 0 12 12 6 0 12 0 12 0 0 12 0 12 78

2013 0 12 12 12 0 12 0 12 11 0 12 0 12 95

2014 12 12 12 6 7 12 0 12 12 0 12 0 12 109

2015 12 12 12 12 12 12 0 5 4 0 12 12 12 117

2016 8 8 9 0 0 3 9 0 0 0 8 9 5 59

Grand Total 32 68 69 36 26 51 9 53 27 0 68 21 65 525

Red

Yellow

Green

GECF DRM: Monthly Questionnaire (MQs) Sustainability*

<= 25% of the expected questionnaires( <=3)

> 75% of the expected questionnaires(=>9)

*Sustainability: refers to the continuity of submitting monthly gas questionnaire data to GECF, regardless of the timeliness of submission or

completeness of data.

Sustainability is measured as number of monthly questionnaires received from a country per year.

> 25% & < 75 % of the expected questionnaires (4-8)

Page 17: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Quality Indicators : Sustainability of Submission

17

Page 18: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Quality Indicators : Timeliness

18

Page 19: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Quality Indicators : Completeness (GECF Questionnaire)

19

Page 20: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Quality Indicators : Timeliness and Completeness

20

Page 21: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

GECF Databank Platform

21

• GECF participation in the JoDI-Gas Data initiative is being managed as

part of the organization’s integrated Data Management Process.

• GECF Integrated Data Bank Platform: Data Exchange Center (DEC),

Daily News Brief Web and Mobile App, Energy databases / data sets, and

other modules.

• Data Exchange Center (DEC) is the collaboration and communication

database for GECF member countries’ monthly and annual questionnaires.

• Data Transparency: all MCs have read access to data of other countries

and related statistical analytical reports.

• Future plans to expand the Databank Platform.

• GECF Databank is being developed in-house by DISD staff.

Page 22: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

DEC Data Quality: Country Specific Data Entry Validation Rules

22

Page 23: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Data Quality Visual Check : Time-Series

23

Page 24: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Data Quality Visual Check : Time-Series 2

24

Page 25: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Data Quality Visual Check : Monthly Growth Rate

25

Page 26: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 26

Data Quality Visual Check : Monthly Growth Rate

Page 27: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 27

Data Quality Visual Check : Monthly Growth Rate

Page 28: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org 28

Participation Assessment _ Smiley Face Approach – Jan to June 2016

[for JoDI-Gas Monthly Questionnaire Format & M- 2]

Country Sustainabilit

y

Timeliness Completenes

s (%)

Sustainabilit

y

Timeliness Completenes

s (%)

Algeria 2 0 77% L L K

Bolivia 6 5 77% J K K

Egypt 6 6 77% J J K

Eq. Guinea 0 0 0% L L L

Iran 0 0 0% L L L

Libya 3 0 77% L L K

Nigeria 0 0 0% L L L

Oman 0 0 0% L L L

Qatar 0 0 0% L L L

Russia 0 0 0% L L L

Trinidad and Tobago 6 1 77% J L K

United Arab Emirates 6 3 20% J L L

Venezuela 0 0 0% L L L

From Jan 2016 to June 2016

Page 29: JODI-Gas Data Reporting System, Quality Assessment · other modules. • Data Exchange ... GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: 28 Participation

GECF Secretariat: 47th, 48th Floor, Tornado Tower, West Bay, Doha, Qatar, Website: www.gecf.org

Thank You

for Your attention

www.gecf.org