hands-on exercise: running the nwp system · 20121027_i12_f000_gfs003.grb2...

17
Hands-on Exercise: Running the NWP system Pre-processing through visualization

Upload: others

Post on 13-Jul-2020

14 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

Hands-on Exercise: Running the NWP system

Pre-processing through visualization

Page 2: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

External datasource

WRF Pre-processingSystem

WRF MODEL

WRFTerrestrial

DATA

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

WPSgeogrid

metgrid

ungrib

Post-Processing &Visualization

REAL MET

NCL

UPP

WRF

METviewer

Verification & Visualization

GSI

Pre-processing Model Post-

processing Visualization Verification

Numerical Weather Prediction workflowhttps://dtcenter.org/tutorial-version-3/introduction

Page 3: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

Some environment variables

� Our AWS environment uses the bash shell

cd /home/ec2-user

export PROJ_DIR=`pwd`

export CASE_DIR=${PROJ_DIR}/sandy

mkdir -p ${CASE_DIR}

cd ${CASE_DIR}

mkdir -p wpsprd wrfprd gsiprd postprd nclprd metprd metviewer/mysql

We also recommend logging on in a second window and running the first three commands again; this will allow us to follow along with log files while executables are running

https://dtcenter.org/tutorial-version-3/hurricane-sandy-case-27-oct-2012/set-environment

Page 4: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

Breaking down docker commands� A breakdown of our docker commands:docker run --rm -it -e LOCAL_USER_ID=`id -u $USER` --volumes-from wps_geog --volumes-from sandy \-v ${PROJ_DIR}/container-dtc-nwp/components/scripts/common:/home/scripts/common \-v ${PROJ_DIR}/container-dtc-nwp/components/scripts/sandy_20121027:/home/scripts/case \-v ${CASE_DIR}/wpsprd:/home/wpsprd \--name run-sandy-wps dtc-wps_wrf /home/scripts/common/run_wps.ksh

docker run Runs a docker container

--rm Removes the container when you exit

-it Runs container in interactive mode-e LOCAL_USER_ID=`id -u $USER` -e sets an environment variable; we are passing the variable

“LOCAL_USER_ID” to do some trickery that sets correct permissions in our containers

--volumes-from NAME Mounts directories from the data container “NAME”

Page 5: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

Breaking down docker commands� A breakdown of our docker commands:docker run --rm -it -e LOCAL_USER_ID=`id -u $USER` --volumes-from wps_geog --volumes-from sandy \-v ${PROJ_DIR}/container-dtc-nwp/components/scripts/common:/home/scripts/common \-v ${PROJ_DIR}/container-dtc-nwp/components/scripts/sandy_20121027:/home/scripts/case \-v ${CASE_DIR}/wpsprd:/home/wpsprd \--name run-sandy-wps dtc-wps_wrf /home/scripts/common/run_wps.ksh

-v DIR1:DIR2 Mounts DIR1, a directory on the home system (outside of container-land), into DIR2, a directory inside the container. Files created in DIR2 inside the container will persist outside of it in DIR1

--name run-sandy-wps Name this new container “run-sandy-wps”

dtc-wps_wrf The name of the image we are using to create the container

/home/scripts/common/run_wps.ksh A script that will execute inside the container; it will run WPS

Page 6: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

External datasource

WRF Pre-processingSystem

WRF MODEL

WRFTerrestrial

DATA

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

WPSgeogrid

metgrid

ungrib

Post-Processing &Visualization

REAL MET

NCL

UPP

WRF

METviewer

Verification & Visualization

GSI

Pre-processing Model Post-

processing Visualization Verification

WRF Preprocessing System (WPS)

Page 7: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

WPSgeogrid.exe

metgrid.exe

ungrib.exe

https://dtcenter.org/tutorial-version-3/hurricane-sandy-case-27-oct-2012/run-nwp-initialization-components

WRFTerrestrial

Data

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

Pre-processing Model Post-

processing Visualization Verification

WRF Preprocessing System (WPS)

WPS_GEOG/

20121027_i12_f000_GFS003.grb220121027_i12_f003_GFS003.grb220121027_i12_f006_GFS003.grb2

geo_em.d01.nc

FILE:2012-10-27_12FILE:2012-10-27_15FILE:2012-10-27_18

met_em.d01.2012-10-27_12:00:00.ncmet_em.d01.2012-10-27_15:00:00.ncmet_em.d01.2012-10-27_18:00:00.nc

ncview

ncview

Page 8: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

External datasource

WRF Pre-processingSystem

WRF MODEL

WRFTerrestrial

DATA

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

WPSgeogrid

metgrid

ungrib

Post-Processing &Visualization

REAL MET

NCL

UPP

WRF

METviewer

Verification & Visualization

GSI

Pre-processing Model Post-

processing Visualization Verification

real.exe

Page 9: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

WPS

metgrid.exe

Pre-processing Model Post-

processing Visualization Verification

real.exe

geo_em.d01.nc

FILE:2012-10-27_12FILE:2012-10-27_15FILE:2012-10-27_18

met_em.d01.2012-10-27_12:00:00.ncmet_em.d01.2012-10-27_15:00:00.ncmet_em.d01.2012-10-27_18:00:00.nc

real.exe

wrfinput_d01 wrfbdy_d01

https://dtcenter.org/tutorial-version-3/hurricane-sandy-case-27-oct-2012/run-nwp-initialization-components

ncview

Page 10: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

External datasource

WRF Pre-processingSystem

WRF MODEL

WRFTerrestrial

DATA

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

WPSgeogrid

metgrid

ungrib

Post-Processing &Visualization

REAL MET

NCL

UPP

WRF

METviewer

Verification & Visualization

GSI

Pre-processing Model Post-

processing Visualization Verification

GSI data assimilation

Page 11: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

Pre-processing Model Post-

processing Visualization Verification

GSI data assimilation

real.exe

wrfinput_d01 wrfbdy_d01

wrf.exe

gsi.xwrf_inout wrf_inout wrfinput_d01

https://dtcenter.org/tutorial-version-3/hurricane-sandy-case-27-oct-2012/run-nwp-initialization-components

Page 12: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

External datasource

WRF Pre-processingSystem

WRF MODEL

WRFTerrestrial

DATA

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

WPSgeogrid

metgrid

ungrib

Post-Processing &Visualization

REAL MET

NCL

UPP

WRF

METviewer

Verification & Visualization

GSI

Pre-processing Model Post-

processing Visualization Verification

WRF Model

Page 13: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

https://dtcenter.org/tutorial-version-3/hurricane-sandy-case-27-oct-2012/run-nwp-initialization-components

Pre-processing Model Post-

processing Visualization Verification

WRF Model

wrfbdy_d01

wrf.exewrfinput_d01

wrfout_d01_2016-01-23_12_00_00.ncwrfout_d01_2016-01-23_13_00_00.ncwrfout_d01_2016-01-23_14_00_00.ncwrfout_d01_2016-01-23_15_00_00.ncwrfout_d01_2016-01-23_16_00_00.ncwrfout_d01_2016-01-23_17_00_00.ncwrfout_d01_2016-01-23_18_00_00.nc

ncview

Page 14: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

External datasource

WRF Pre-processingSystem

WRF MODEL

WRFTerrestrial

DATA

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

WPSgeogrid

metgrid

ungrib

Post-Processing &Visualization

REAL MET

NCL

UPP

WRF

METviewer

Verification & Visualization

GSI

Pre-processing Model Post-

processing Visualization Verification

Unified Post-Processor (UPP)

Page 15: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

https://dtcenter.org/tutorial-version-3/hurricane-sandy-case-27-oct-2012/run-nwp-initialization-components

Pre-processing Model Post-

processing Visualization Verification

Unified Post-Processor (UPP)

wrfout_d01_2016-01-23_12_00_00.ncwrfout_d01_2016-01-23_13_00_00.ncwrfout_d01_2016-01-23_14_00_00.ncwrfout_d01_2016-01-23_15_00_00.ncwrfout_d01_2016-01-23_16_00_00.ncwrfout_d01_2016-01-23_17_00_00.ncwrfout_d01_2016-01-23_18_00_00.nc

unipost.exe

wrfprs_d01.12wrfprs_d01.13wrfprs_d01.14wrfprs_d01.15wrfprs_d01.16wrfprs_d01.17wrfprs_d01.18

Page 16: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

External datasource

WRF Pre-processingSystem

WRF MODEL

WRFTerrestrial

DATA

Gridded Data:NAM,GFS,

RUC, NNRPAGEMET(soil)

WPSgeogrid

metgrid

ungrib

Post-Processing &Visualization

REAL MET

NCL

UPP

WRF

METviewer

Verification & Visualization

GSI

Pre-processing Model Post-

processing Visualization Verification

NCL Graphics

Page 17: Hands-on Exercise: Running the NWP system · 20121027_i12_f000_GFS003.grb2 20121027_i12_f003_GFS003.grb2 20121027_i12_f006_GFS003.grb2 geo_em.d01.nc FILE:2012-10-27_12 FILE:2012-10-27_15

https://dtcenter.org/tutorial-version-3/hurricane-sandy-case-27-oct-2012/run-nwp-initialization-components

Pre-processing Model Post-

processing Visualization Verification

NCL Graphics

wrfout_d01_2016-01-23_12_00_00.ncwrfout_d01_2016-01-23_13_00_00.ncwrfout_d01_2016-01-23_14_00_00.ncwrfout_d01_2016-01-23_15_00_00.ncwrfout_d01_2016-01-23_16_00_00.ncwrfout_d01_2016-01-23_17_00_00.ncwrfout_d01_2016-01-23_18_00_00.nc

ncl

DBZ1_d01.gifPrecip_total_d01.gifSurface_multi_d01.gifplt_Precip_multi_total_d01.000001.pngplt_Precip_multi_total_d01.000002.png...wps_show_dom.png

display