meteo-grid: performing local weather forecast using grid computing c.-j. lenz, d. majewski

74
Meteo-GRID: Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski Deutscher Wetterdienst (DWD) e-mail: [email protected] [email protected]

Upload: min

Post on 31-Jan-2016

43 views

Category:

Documents


0 download

DESCRIPTION

Meteo-GRID: Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski Deutscher Wetterdienst (DWD) e-mail: [email protected] [email protected]. Contents. Introduction to Meteo-GRID Tasks of Meteo-GRID, data flow in Meteo-GRID - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Meteo-GRID: Performing Local Weather Forecast

Using GRID Computing

C.-J. Lenz, D. Majewski

Deutscher Wetterdienst (DWD)

e-mail: [email protected] [email protected]

Page 2: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

• Introduction to Meteo-GRID

• Tasks of Meteo-GRID, data flow in Meteo-GRID

• Presentation of the GUI of the LM-Plugin

• Application example

Contents

Page 3: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Goal of Meteo-GRID

To provide

high-resolution short range weather forecasts

with the

relocatable nonhydrostatic “Lokal-Modell” (LM)

of the Deutscher Wetterdienst (DWD)

for any desired region in the world

via Internet and EUROGRID

Page 4: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Meteo-GRID

- ... is one of the application-specific GRID workpackages

of EUROGRID

- ...is done by close collaboration of three EUROGRID

partners:

- Deutscher Wetterdienst (DWD)

- Centro Svizzero di Calcolo Scientifico (CSCS)

- Centre Nationale de Récherche Scientifique - Institut du Développement et des Ressources en Informatique Scientifique (CNRS-IDRIS)

Page 5: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

What`s special about Meteo-GRID ? (1)

- Real-time weather forecasting is a time-critical task,

a 48-h forecast must be completed in less than

60 minutes

- LM is a large MPP code of about 100.000 lines of code,

Fortran95, MPI for message passing

- Weather forecasting is computationally expensive

~ 4000 Flop/grid point and time step

~ 15 Tflop for a 48-h forecast (160 x 160 x 35 grid points,

grid resolution ~ 7 km)

~ 3000 sec at a sustained speed of 5 Gflop/s

Page 6: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

What`s special about Meteo-GRID ? (2)

- Weather forecasting requires high band width for data

transfer

Forecast data (at hourly intervals): (48+1) x 20 Mbyte = 1 GByte

Transfer in less than 1 hour: 2.4 Mbit/sec

- “Weather” has large social and economic impact

worldwide (storms, floodings, snow, freezing rain ...)

Page 7: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Disasters (1)

@dpa@ Behr & Wojcik

Page 8: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Disasters (2)

www.dresden.de www.dresden.de www.dresden.de

@dpa

Page 9: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Tasks of Meteo-GRID (1)

- Selection of

model domain,

grid resolution,

forecast date and

forecast range,

forecast products

in a Graphical User Interface (GUI)

Page 10: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Tasks of Meteo-GRID (2)

- Derivation of

topographical data

for the selected

model domain

from high-resolution

(1 km x 1 km) data sets

at DWD

water

peat

clay

loamy clay

loam

loamy sand

sand

rock, concrete

ice, glacier

undefined

Page 11: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Tasks of Meteo-GRID (3)

- Extraction of

initial data and

lateral boundary data

sets for LM

from result data

of the global model GME

of DWD from the

ORACLE data base

Page 12: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Tasks of Meteo-GRID (4)

- Interpolation of GME results to the LM model grid

(interpolation program GME2LM) is performed on any

supercomputer available in EUROGRID

- LM forecast run is performed on any supercomputer

available in EUROGRID

Page 13: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Tasks of Meteo-GRID (5)

- Forecast data (up to 20 GByte in GRIB code) are

returned to the user via the internet and EUROGRID

AND/OR

- Visualization of LM forecasts ( 1 to 5 dimensional

graphics) on a computer within EUROGRID or on the

user’s computer

- Verification and validation of LM forecasts for any

region worldwide

Page 14: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Information and Data Flow (1)

1.1. Set up of LM-domain Set up of LM-domain

User

Global topographicaldata set (GIS),~ 7 GByte

Topographical data set(~ 1 MByte)

DWDDWD

GUI:GUI:Selection of- domain corners- grid resolution- forecast date- forecast range- forecast products

Calculation at DWD onSGI Origin, IBM RS/6000-SP (~ 15 min. wallclock time)

Page 15: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Information and Data Flow (2)

2. Define forecast date and range

GME data base (Oracle)

Hourly initial and lateral boundarydata sets on GME grid (~50 Mbyte)

UserDWDDWD

Extraction of GME results covering the LM domain at DWD (SGI Origin O 2000, IBM-RS/6000-SP) ~ 30 min. wallclock time

Page 16: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Information and Data Flow (3)

3.3. Perform GME2LM interpolation on EUROGRID HPC 1Perform GME2LM interpolation on EUROGRID HPC 1

User DWD

Topographical data set

Initial and lateral boundarydata sets on GME grid

HPC 1

GME2LMinterpolation of

GME results to LM grid

~1 MByte

~50 MByte

Initial and hourly lateral boundarydata sets on LM grid (50 MByte to 20 GByte)

Page 17: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Information and Data Flow (4)

4.4. Perform LM-forecast on EUROGRID HPC 2Perform LM-forecast on EUROGRID HPC 2

User HPC 2

LMcalculation of

weather forecast

50 MByte to20 GByte

LM-forecast data visualization

Initial and hourly lateral boundarydata sets on LM grid

HPC 1

50 MByte to 20 GByte

hourly forecast data of LM (50 MByte to 20 GByte)

Page 18: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Information and Data Flow (5)

5.5. Visualization of LM results Visualization of LM results

UserHPC 2

Visualizationof model results

Graphic files(up to 1 MByte)

up to 1 MByte

Page 19: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

GUI of the LM Plugin (1)

Page 20: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

GUI of the LM Plugin (2)

Page 21: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

GUI of the LM Plugin (3)

Page 22: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

GUI of the LM Plugin (4)

Page 23: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

GUI of the LM Plugin (5)

Page 24: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

GUI of the LM Plugin (6)

Page 25: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski

Application example

-Selection of hurricane Isabel /US East Coast,

18 - 20 August 2003)

Page 26: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 27: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 28: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 29: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 30: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 31: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 32: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 33: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 34: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 35: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 36: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 37: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 38: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 39: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 40: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 41: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 42: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 43: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 44: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 45: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 46: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 47: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 48: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 49: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 50: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 51: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 52: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 53: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 54: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 55: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 56: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 57: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 58: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 59: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 60: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 61: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 62: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 63: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 64: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 65: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 66: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 67: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 68: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 69: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 70: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 71: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 72: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 73: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski
Page 74: Meteo-GRID:  Performing Local Weather Forecast Using GRID Computing C.-J. Lenz, D. Majewski