migration from traditional alphanumeric codes (tac) to …...status: the good, the bad and the ugly...

30
TI12b – Sep. 2015 Migration from Traditional Alphanumeric Codes (TAC) to Table Driven Code Forms (TDCF) at the German Weather Service Daniel Lee, German Weather Service (DWD)

Upload: others

Post on 07-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Migration from Traditional Alphanumeric Codes (TAC) to Table Driven Code Forms (TDCF) at the German Weather Service

Daniel Lee, German Weather Service (DWD)

Page 2: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

1. Overview: The BUFR migration

2. Status: The good, the bad and the ugly

3. Quality control: Trust is good...

Agenda

Page 3: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

The BUFRmigration

Page 4: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Diverse, high-volumeobservations

FM12FM13

FM18

FM20

FM35

FM42

FM88

FM87

Page 5: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

FM94 BUFR:One format to rule them all

Page 6: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

"In compliance with the WMO deadlines, DWD will cease distribution of FM12 (TAC) messages at the end of 2010." - DWD, 2009

The good news:We're all done!

Page 7: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

"In compliance with the WMO deadlines, DWD will cease distribution of FM12 (TAC) messages at the end of 2010." - DWD, 2009

The good news:We're all done!

"Following a decision of the CBS (WMO Commision for Basic Systems) Meeting... TAC (Traditional Alphanumeric Codes) of SYNOP, TEMP and CLIMAT may be disseminated after January 2011 until all countries are able to provide BUFR, latest until the end of 2014." - DWD, 2010

Page 8: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

The good news:We're all done!

Page 9: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Current status

Page 10: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

The good

Page 11: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

RMS from obs over time by assimilating BUFR

Page 12: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Higher resolution data

Page 13: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Feb. 2015

Batteries included:Metadata in the message

Page 14: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Batteries included:Metadata in the message

Page 15: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Batteries included:Metadata in the message

Page 16: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

The bad

Page 17: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

● Failed sanity checks● Air temperature● Dew point temperature● Air pressure● Relative humidity● Wind speed / direction● Cloud types with no cloud cover

● Contradictory messages

Problems with content

Page 18: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Page 19: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Page 20: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Page 21: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

The ugly

Page 22: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Reformatted TEMPs

TAC: 4 messages per ascentBUFR: max. 2 messages per ascent

Same GTS header, no longer distinguishable

Page 23: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Page 24: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

● Database issues● Data types● Values that map differently (e.g. vertical

significance)● Differing classification systems (e.g. station

type)● New units of measurement (e.g. km h-1)

Compatibility problems

Page 25: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Quality control

Page 26: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Workflow

Originating centre informs of intent to migrate via RTH, WIS

2 months paralleldissemination

QC by participatingcentres & lead centremonitoring

TAC disseminationdiscontinued

OC requested to rectify problems &continue TAC dissemination

OC presents plan and deadlines to produce validBUFR [Data OK]

[Problems]

Page 27: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Watching the watchmen:Reporting fluctuations

Page 28: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Watching the watchmen:Tests in operational systems

● Red: Tests pending● Yellow: Tested in data assimilation● Green: Tested with climate users

Page 29: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Page 30: Migration from Traditional Alphanumeric Codes (TAC) to …...Status: The good, the bad and the ugly 3. Quality control: Trust is good... Agenda TI12b – Sep. 2015 The BUFR migration

TI12b – Sep. 2015

Thanks!

Questions?