THORPEX Interactive Grand Global Ensemble (TIGGE)

Feifei Yang

China Meteorological Administration

April 3, 2019 Reading

Progress on TIGGE Archive

Center in CMA

Current Situation

TIGGE Archive Centres and Data Providers

➢ TIGGE project contains data from 11 centers and which is backed up by two global

archiving centers, ECMWF and CMA.

BoM (Australia), CMA (China), ECCC (Canada), ECMWF (European Center), NCEP (USA),

UKMO (UK), Météo France (France), JMA (Japan), KMA (Korea), CPTEC (Brazil), NCMRWF

(India)

3

Test platform

established

2006.7: Infrastructure(LDM Server, Internet) ready.

Cooperation between CMA, ECMWF & NCAR

MARS system

localized2007.07-2008.12: Localized MARS

system and data environment

- R O A D M A P T I G G E - C M A -

1 32

5 6 7

LDM server

upgraded2008.10-2009.04: Hardware upgrade &

software update for multi-receiving

System Upgraded for

better data management2010.10: LDM hardware upgrade &

data management system upgrade

Network Performance

Upgrade2010.10-2011.10: Network Performance

Upgrade to Ensure the Integrity of

Received Data

TIGGE-Cloud

migration2018.03-2018.12: TIGGE archiving with

QC from LDM to FTP, and now to cloud

4

MARS for

Data archiving2009.05

Progress overview

Data and Service

Total received Data by Centers

2007-2018 (TB)

➢The total TIGGE data of CMA from 2007 to 2018 is 1671.83 TB.

1206.88

43.45 22.27

125.3

8.99 32.75 22.7873.27

131.88

4.260

200

400

600

800

1000

1200

1400

ecmf kwbc cwao egrr ammc sbsj rjtd rksl babj lfpw

Archived data volume

Archived Data Integrity Diagram （TB)

104.70

87.50

128.10

167.10

234.30

221.80 224.20 215.60

206.20

189.10

39.80

0

50

100

150

200

250

2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017

Data and Service

Weather Forecast Department of National Meteorological Center, CMA

Mid-Term Weather Forecast Operational Users

Hong Kong Observatory

Korea Meteorological Administration

Nanjing University

NWP Center of National Meteorological Center

Institute of Atmosphere, Chinese Academy of Sciences

Guangdong Tropical Institute

Real-time data service User

Offline data service User

Typhoon and Marine Meteorological Forecast Center

Sichuan Meteorological Service

Application

➢ June 2008, TIGGE was widely used extreme precipitation in South China, medium-term

precipitation forecast in Jiangsu Province, Persistent Extreme Precipitation Incentered

Eastern China, Rainfall Forecast in Qinghe Basin and Flood Forecasting for Chaihe River

Basin.

➢ The TIGGE application in multi-model integrated forecasting of subtropical westerly jet in

East Asia, tropical cyclone in West Pacific and subtropical cyclone is significant.

Application of TIGGE

Data Update

EC

CMA

Problem and Background

➢ TIGGE data was transmitted and interacted to ECMWF by

LDM before 2018.

➢ Due to the limitation of LDM software mechanism on system

performance, in January 2018, ECMWF contacted CMA and

suggested to adopt FTP to replace LDM in TIGGE system.

➢ In April, ECMWF and CMA determined the adjustment

requirements for TIGGE data.

➢ In September, the ECCODES tool was introduced to solve the

problem of invalid messages in TIGGE-BABJ.

Design, Adjustment of TIGGE Data Format and Establishment of Quality Control Process in Non-LDM Environment

Center Times Files Number/Times

Data volume per day

File type

BABJ 00/12 1 54G tar

Center Times Files Number/Times

Data volume per day

File type

BABJ 00/12 30 54G Grib2

➢ Old data format

➢ New data format

➢ In 2018, TIGGE-BABJ sent 19.25TB

data. After data quality control, the error

rate of sending data was 0, and the

data integrity reached 99.9%. This

effectively guaranteed the operation of

ECWMF.

Complete the adjustment and implementation of TIGGE data format and the establishment of quality control process in non-LDM environment.

20182018.09-11

2018.8.22

LDM services should be

discontinued, and this system

serves as the only channel to

provide TIGGE-BABJ data in

a new data format to EC

2018.4.25

The new data began to

be transmitted

continuously on April

25 and exchanged with

EC

2018

LDM

transmission

2019-2023

By WMO's requirements

of TIGGE project five-

year expansion , the

filing center will continue

to perform its duties.

Complete the installation,

deployment and secondary

development of ECMWF-

ECCODES. At present,

ECMWF-ECCODES is used

to check the quality of the

data issued at each timeFTP

transmission

TIGGE-BABJ

(00/12 hours/day,

1 TAR file/day)

TIGGE-BABJ

(00/12/day, 30

GRIB2 files/day)

Data process

Data exchange cluster

Outside network DMZ area

TIGGE data flow in CMA before

Storage area

MARSPortal

Online data

Online data

CMAUSERS

Data service

Data receive

Data send

Data Source

INTERNET USERS

INTER

NET

WEB/FTP

MARS

Inside network

Data process

Storage area

Offline data

HPC system

WEB/FTP

10

Flow chart after data upgrate

Data Resource

Multi-moda Data Extraction and Analysis

TIGG

E D

ata

S2S D

ata

...Oth

er M

od

el

Cloud analysis

Download on demand For Users

Meteorological Big Data Cloud Platform

Open Capability

Resource SharingData resource

Algorithm resource

Interface resource

meteorological data

Industry data

Society DataMeteorological

algorithm

Mining analysis

visualizationComputing interface

Storage interface

Access interface

converge converge converge

Satellite DetectionWeather/Climate

Service ResearchGovernme

nt affair

Interchangeable

ComputableSelf-

Manageable

ServiceableOther Model

Data

Architecture Diagram of Upgraded CMA Data Process Deployment

WIS2.0

- The End -