improving ensemble qpf in nmc dr. dai kan national meteorological center of china (nmc)...
TRANSCRIPT
![Page 1: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/1.jpg)
Improving Ensemble QPF in NMCImproving Ensemble QPF in NMC
Dr. Dai KanNational Meteorological Center of China (NMC)
International Training Course for Weather Forecasters
11/1, 2012, Kunming
![Page 2: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/2.jpg)
OutlineOutline QPF operations in NMCQPF operations in NMC Improving QPF by ensembleImproving QPF by ensemble Improving PQPFImproving PQPF
![Page 3: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/3.jpg)
WFO-- subdivision of NMC (National Meteorological
Center)
NMCNMC
Administrative Office
Personnel and Staff Education Division
Division of Operational & Reach Management and S. T. development
Integrative Office
Weather Forecasting Office
NWP Operating and Developing Division
Typhoon and Marine Met. Division
Applied Met. Services Division
NMC Agricultural Met. Center
Met. Service for Decision-making Office
Open Forecast System Laboratory
Retirees Office
Operations( 8)
Management( 5)
Severe Weather Prediction Center
![Page 4: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/4.jpg)
QPE
QPF (no PQPF)
Early warning of heavy rain
Precipitation phase in Winter
Total process precipitation forecast
QPF’s duties
![Page 5: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/5.jpg)
7-Day 24Hour Precipitation Forecast:
Day1-3: Updated Twice a day, at 00,12UTC
Day4-7: Updated Once a day, at 00UTC
00UTC
12UTC
Threshold: 0.1, 10, 25, 50, 100, 250mm
![Page 6: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/6.jpg)
Various observation dataOperational
determinate model Ensemble model
Distinguish w
eather system
QP
F verification
Ensem
ble QP
FE
nsemble Q
PF
QPF Products
Multi-m
odel ensemble Q
PF
Multi-m
odel ensemble Q
PF
Point to point forecast
Synoptic situation forecast
Grid editing technique
QPF revise
Blending m
ethod QP
F
Historical data query
QP
F G
ridding
Key method
QPF technical support and operational process
![Page 7: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/7.jpg)
Ensemble systemEnsemble system
T213-GEPS, 10 days, 15 mem.T213-GEPS, 10 days, 15 mem. WRF-REPS, 60 hours, 15 mem.WRF-REPS, 60 hours, 15 mem. ECMWF, NCEP GEPSECMWF, NCEP GEPS TIGGE dataset (not real-time, 3 TIGGE dataset (not real-time, 3
days-delay)days-delay)
![Page 8: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/8.jpg)
Ensemble analysis and visualization systemEnsemble analysis and visualization system
Ensemble Predication Toolkits V0.3
probability spaghetti Stamp
Box-plot
![Page 9: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/9.jpg)
OutlineOutline QPF operations in NMCQPF operations in NMC Improving current QPF by ensembleImproving current QPF by ensemble Improving PQPF Improving PQPF
![Page 10: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/10.jpg)
Ensemble outputs as a single forecast
Mean and spread
Max, middle, min
%10, %25, %75, %90 quantile
Probability-matching ensemble mean (PM)Compared with deterministic forecast
Advantages and disadvantages of each product
How to improve current operational QPF by ensemble
![Page 11: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/11.jpg)
Observations:
Longitude: 110~122E
Latitude: 28~38N
Covering Huaihe catchment
745 observation stations
~0.4 degree space
Forecasts:
ECMWF global EPS
2007~2012, summer
Verification
![Page 12: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/12.jpg)
Verifications resultsModel forecast to stations, 1-day 24h rain rate ~ frequency
deterministic forecast, PM approximate to
ensemble member
Compared with observation curve:
— <33mm, over-forecast
— >33mm, under-forecast
![Page 13: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/13.jpg)
Verifications results
Mean and middle forecast:
More under-forecasts for heavy rain
No improvement for light or moderate
rain
![Page 14: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/14.jpg)
Verifications results
Max forecast:
More over-forecast
Close to observation for heavy rain (>150mm)
Min forecast:
More under-forecast
Close to observation for light rain (<10mm)
![Page 15: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/15.jpg)
Verifications results
10% 25%
75% 90%Close to obs. for different precipitation amount
![Page 16: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/16.jpg)
Except PM, no statistic products close to deterministic forecast
Each product has advantages and disadvantages
Can we construct a single product which fuse advantages of each product?
![Page 17: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/17.jpg)
Fusing productFor each grid point, there are 51 member
forecast MF.
Set fusing value FP = :(1)If max(MF) >= 100mm, then
FP=max(MF);
(2)If %90(MF) >= 50mm, then FP=
%90(MF) ;
(3)If %75(MF) >= 25mm, then FP=
%75(MF) ;
(4)If middle(MF) >= 10mm, then FP=
middle(MF) ;
(5)Else FP= %10(MF)
![Page 18: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/18.jpg)
Verifications results
FP approximate to observations
for different precipitation amount
![Page 19: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/19.jpg)
Verifications results
FP has higher Threat score than
deterministic forecast for each
precipitation amount
Threat score
![Page 20: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/20.jpg)
Fusing product( 1 ) Good for short-range (0~72h) QPF,
higher TS than deterministic forecast for
different amount rain.
( 2 ) Easily implemented in QPF
operations.
( 3 ) Risk of high false alarm ratio,
special for medium-range
( 4 ) Threshold decided roughly and
subjectively.
( 5 ) In future, use frequency match
algorithm to precisely calibrate frequency
error.
![Page 21: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/21.jpg)
OutlineOutline QPF operations in NMCQPF operations in NMC Improving QPF by ensembleImproving QPF by ensemble Improving PQPF Improving PQPF
![Page 22: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/22.jpg)
Verifications results2007~2012, Summer, 1day precipitation – station obs.
Under-dispersiveness:Under-dispersiveness:U shape of Talagrand histogram
![Page 23: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/23.jpg)
Verifications results2007~2012, Summer, 1day precipitation – station obs.
Lack of reliability:Lack of reliability:
Reliability curve not on the diagonal
•0.1mm/1Day, Overforecasting (wet bias)
•25mm/1Day, Poor resolution (overconfident)
0.1mm/1Day 25mm/1Day
![Page 24: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/24.jpg)
Verifications results2007~2012, Summer, 1day precipitation – station obs.
Low accuracy for high thresholds:Low accuracy for high thresholds:ROC area 0.74 < 0.8 for thresholds > 50mm/1Day
50mm/1Day
Relative operating characteristic
![Page 25: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/25.jpg)
Post-processingTo provide reliable forecasts
Logistic regression approach
Choice of predictors x. Estimation of the b0 and b1 over a training period. Calibrated probabilities p for a threshold T directly addressed.
![Page 26: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/26.jpg)
Post-processing
Logistic regression approach
Predictors: ensemble mean and spread with 1/3 power transformation
Training period: latest 30 days ; or 2007~2011 5 years summer history forecast (from TIGGE archive )
Forecast period: 2012 summer
![Page 27: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/27.jpg)
Post-processing0.1mm/1dayOriginal
0.1mm/1dayCalibration(history forecast)
0.1mm/1dayCalibration(30 train days)
![Page 28: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/28.jpg)
Post-processing10mm/1dayOriginal
10mm/1dayCalibration(30 train days)
10mm/1dayCalibration(history forecast)
![Page 29: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/29.jpg)
Post-processing25mm/1dayOriginal
25mm/1dayCalibration(history forecast)
50mm/1dayOriginal
50mm/1dayCalibration(history forecast)
![Page 30: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/30.jpg)
Logistic Regression PQPF( 1 ) Calibrate ensemble PQPF
effectively
( 2 ) More training samples, more better
results
( 3 ) History forecast errors may change
with model updating, which influence the
calibration.
( 4 ) Reforecast can offer a better way,
which we can not gain these dataset.
![Page 31: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/31.jpg)
![Page 32: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/32.jpg)
No product close to deterministic forecast Each product has advantages and
disadvantages
Can we get a statistic product which close to deterministic forecast or member forecast
Can we construct a product which fuse advantages of each product
![Page 33: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/33.jpg)
Probability matching
1. Rank the gridded rainfall from all n QPFs from largest to smallest, the keep every nth
value starting with the n/2-th value.
2. Rank the gridded rainfall from the ensemble mean from largest to smallest.
3. Match the two histograms, mapping rain rates from (1) onto locations from (2).
(from Beth Ebert )
……………
… … … … …
…
…
…
…
1~51
52~102
Rank form largest to smallest
Ensemble mean
Ensemblemember
![Page 34: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/34.jpg)
Verifications results
PM approximate to ensemble
member or deterministic forecast
![Page 35: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/35.jpg)
QPF Products
Day1: 6-h QPF, updated 3 times a day at 00, 06, 12 UTC
![Page 36: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/36.jpg)
Winter: Day1-3 24-h QPF updated twice a day
Including the snow, freezing rain, sleet.
24h 48h 72h
Precipitation phase forecast:
![Page 37: Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,](https://reader031.vdocuments.net/reader031/viewer/2022013011/56649f005503460f94c16086/html5/thumbnails/37.jpg)
Total process precipitation (for the whole life of a synoptic system)