1Copyright© 2003 Empress Software, Inc. All Rights Reserved.

2

User-Friendly Presentation of BUFR data

Ninth Workshop On Meteorological Operational SystemsECMWF, Reading, United Kingdom November 11, 2003

3

Presentation of BUFRObjectiveSpecificationsToolsMethodologyLive DemonstrationsQuestions and Answers

4

BackgroundBUFR as a standard data exchange

Ultimate goal of WMOOmnipotentCompressed dataUnreadable by humans

BUFR DecodersDivergentRequire practical knowledge

5

ObjectiveAbility to “read” data inside BUFR records over the Internet using a user-friendly browser based interface.

6

SpecificationsData to be stored in BUFR

BUFR is not relationalData to be decodedData to be extracted according to user defined criteria specified interactivelyData to be presented in a readable formData to be presented a wide range of user interface environments

7

ToolsSYSTEM

BUFR

INTERNETINTRANET USER

8

ToolsDatabase system

High level application programming interfaces (API)

JDBC, HTML, XML, ODBC, PHP, PerlHigh level API’s are augmented with the BUFR decoder functionalityBUFR decoder becomes meta data in database

Internet ServerApache HTTP, Tomcat, MS IIS

9

ToolsSYSTEM

Database SystemInternet Server

10

End UserAPPLICATION

EMPRESS API’s

Database System

OPERATING SYSTEM

HARDWARE

11

End UserAPPLICATION

EMPRESS API’s

EMPRESS DB ENGINE

OPERATING SYSTEM

HARDWARE

12

End UserJAVA

JDBC

EMPRESS DB ENGINE

OPERATING SYSTEM

HARDWARE

13

End UserMS-Excel

ODBC

EMPRESS DB ENGINE

OPERATING SYSTEM

HARDWARE

14

End UserBrowser

HTML/XML

EMPRESS DB ENGINE

OPERATING SYSTEM

HARDWARE

15

End UserBrowser

PERL or PHP

EMPRESS DB ENGINE

OPERATING SYSTEM

HARDWARE

16

End UserAPPLICATION

EMPRESS API’s

EMPRESS DB ENGINE

OPERATING SYSTEM

HARDWARE

17

End UserAPPLICATION

EMPRESS API’s

EMPRESS DB ENGINE

UNIX

HARDWARE

18

End UserAPPLICATION

EMPRESS API’s

EMPRESS DB ENGINE

LINUX

HARDWARE

19

End UserAPPLICATION

EMPRESS API’s

EMPRESS DB ENGINE

MS-WINDOWS

HARDWARE

20

End UserAPPLICATION

EMPRESS API’s

EMPRESS DB ENGINE

Real Time OS

HARDWARE

21

DATABASE

EMPRESS DB ENGINE

INTERNET SERVER

Tools

22

DATABASE

EMPRESS DB ENGINE

INTERNET SERVER

Methodology

23

DATABASE

EMPRESS DB ENGINE

Methodology

24

MethodologyIngest BUFR Data into databaseAugment database system with decoding functions

25

DATABASE

EMPRESS DB ENGINE

Methodology

BUFR DECODER

26

Ingesting BUFR into databaseBUFR does not naturally translate into rows and columnsIngest is a batch processRange of ingest methods:

Minimum – store each BUFR record as BLObRecommended – store each BUFR record as BLOb alongside decoded product definition section (originating centre, date and time)Complete – decode all of BUFR records and store it in a relational format

27

BUFR Decoder as meta dataPersistent Stored Modules

a.k.a. User-defined functionsDecode all or parts of BUFR records as SELECT queryExtend decoding functionality to all API’s (SQL, ODBC, JDBC, PHP, HTML, Perl, etc.)Range of functions, each tailored for specific requirementsDatabase tables are perfect for BUFR reference tablesUDF decoders, BUFR reference tables and BUFR data make up a single entity

28

Live Demonstration45 650 BUFR messages3 145 145 subsets (observations)Each subset contains 156 elementsPreprocessing batch:

All BUFR messages stored in 45 650 records as BLOb data type

A few user-defined functions (PSM’s) containing decoding functionality stored in the same database

29

End UserJAVA (JSP app)

JDBC

EMPRESS DB ENGINE

WIN 2000

INTEL X86 /256 MB RAM

30

EMPRESS DB ENGINE

TOMCAT JSP Server

Internet Explorer Browser

31

EMPRESS DB ENGINE

Empress Connectivity Server

MS-Excel

32

Live Demonstration

33

Benefits“Readable” BUFR dataSearch through BUFR dataDownload decoded BUFR dataImproved handling of BUFR messagesImproved management of BUFR reference tablesBUFR messages and its decoders united as a single logical entity - databaseSeamless BUFR exchange independent of user data presentation environment

34

The Main Benefit

Facilitates the WMO objective to standardize on table driven codes

BUFR and CREX

35

US inquiries:Telephone: 301-220-1919Fax: 301-220-1997

11785 Beltsville DriveBeltsville, MD 20705USA

WEB SITE: www.empress.comE-mail: info@empress.com

International inquiries:Telephone: 905-513-8888Fax: 905-513-1668

3100 Steeles Avenue EastMarkham, Ontario L3R 8T3Canada

Serge SavchenkoSerge SavchenkoEmpress Software Inc.Empress Software Inc.

ssavchenkossavchenko@empress.com@empress.com