![Page 1: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/1.jpg)
An Improved Wind Probability Program:A Year 2 Joint Hurricane Testbed Project Update
Mark DeMaria and John Knaff, NOAA/NESDIS, Fort Collins, COStan Kidder, CIRA/CSU, Fort Collins, CO
Buck Sampson, NRL, Monterey, CAChris Lauer and Chris Sisko, NCEP/TPC, Miami, FL
Presented at the Interdepartmental Hurricane Conference
March 5, 2009
![Page 2: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/2.jpg)
Monte Carlo Wind Probability Model
• Estimates probability of 34, 50 and 64 kt wind to 5 days• Implemented at NHC for 2006 hurricane season• Replaced Hurricane Strike Probabilities• 1000 track realizations from random sampling NHC
track error distributions• Intensity of realizations from random sampling NHC
intensity error distributions– Special treatment near land
• Wind radii of realizations from radii CLIPER model and its radii error distributions
• Serial correlation of errors included • Probability at a point from counting number of
realizations passing within the wind radii of interest
![Page 3: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/3.jpg)
1000 Track Realizations 64 kt 0-120 h Cumulative Probabilities
MC Probability ExampleHurricane Ike 7 Sept 2008 12 UTC
![Page 4: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/4.jpg)
Project Tasks
1. Improved Monte Carlo wind probability program by using situation-depending track error distributions
• Track error depends on Goerss Predicted Consensus Error (GPCE)
2. Improve timeliness by optimization of MC code
3. Update NHC wind speed probability product • Extend from 3 to 5 days• Update probability distributions (was based on
1988-1997)
![Page 5: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/5.jpg)
Tasks 2 and 3 Completed
• Optimized code implemented for 2007 season– Factor of 6 speed up
• Wind Speed Probability Table – Calculated directly from MC model intensity
realizations– Implemented for 2008 season
![Page 6: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/6.jpg)
Task 1: Forecast Dependent Track Errors
• Use GPCE input as a measure of track uncertainty
• Divide NHC track errors into three groups based on GPCE values– Low, Medium and High
• For real time runs, use probability distribution for real time GPCE value tercile– Different forecast times can use different distributions
• Relies on relationship between NHC track errors and GPCE value
![Page 7: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/7.jpg)
Goerss Predicted Consensus Error (GPCE)
• Predicts error of CONU track forecast– Consensus of GFDI, AVNI, NGPI, UKMI, GFNI
• GPCE Input– Spread of CONU member track forecasts– Initial latitude– Initial and forecasted intensity
• Explains 15-50% of CONU track error variance • GPCE estimates radius that contains ~70% of
CONU verifying positions at each time• In 2008, GPCE predicts TVCN error
– GFS, UKMET, NOGAPS, GFDL, HWRF, GFDN, ECMWF
![Page 8: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/8.jpg)
72 hr Atlantic NHC Along Track Error Distributions Stratified by GPCE
0
5
10
15
20
25
30
35
40
-600 -400 -200 0 200 400 600 800
Along Track Error (nmi)
Fre
qu
en
cy
(%
)
Lower GPCE Tercile
Upper GPCE Tercile
![Page 9: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/9.jpg)
2008 Evaluation Procedure
• GPCE version not ready for 2008 real time parallel runs
• Re-run operational and GPCE versions for 169 Atlantic cases within 1000 km of land at t=0
• Qualitative Evaluation: Post 34, 50, 64 kt probabilities on web page for NHC– Operational, GPCE and difference plots
• Quantitative Evaluation: Calculate probabilistic forecast metrics from output on NHC breakpoints
![Page 10: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/10.jpg)
GPCE MC Model Evaluation Web Page
http://rammb.cira.colostate.edu/research/tropical_cyclones/tc_wind_prob/gpce.asp
![Page 11: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/11.jpg)
Individual Forecast Case Page
![Page 12: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/12.jpg)
Tropical Storm Hanna 5 Sept 2008 12 UTC
34 kt 0-120 h cumulative probability difference field (GPCE-Operational)All GPCE values in “High” tercile
![Page 13: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/13.jpg)
Hurricane Gustav 30 Aug 2008 18 UTC
64 kt 0-120 h cumulative probability difference field (GPCE-Operational)All GPCE values in “Low” tercile
![Page 14: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/14.jpg)
Quantitative Evaluation
• Calculate probabilities at NHC breakpoints– Operational and GPCE versions
• 34, 50 and 64 kt• 12 hr cumulative and incremental to 120 h
– 169 forecasts X 257 breakpoints = 43,433 data points at each forecast time
• Two evaluation metrics– Brier Score– Optimal Threat Score
![Page 15: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/15.jpg)
Operational and GPCE Probabilities Calculated at 257 NHC Breakpoints
West Coast of Mexicoand Hawaii breakpointsexcluded to eliminate zero or very low probability points
![Page 16: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/16.jpg)
Brier Score (BS)
• Common metric for probabilistic forecasts
• Pi = MC model probability at a grid point (0 to 1)
• Oi = “Observed probability” (=1 if yes, =0 if no)
• Perfect BS =0, Worst =1• Calculate BS for GPCE and operational versions• Skill of GPCE is percent improvement of BS
2
1
][1
ii OPN
BSN
i
![Page 17: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/17.jpg)
Brier Score Improvements2008 GPCE MC Model Test
0
1
2
3
4
5
6
7
8
9
10
12 24 36 48 60 72 84 96 108 120
Forecast Period
Bri
er
Sc
ore
Imp
rov
em
en
t (%
)
64 kt Cumulative
50 kt Cumulative
34 kt Cumulative
0
1
2
3
4
5
6
7
8
9
10
12 24 36 48 60 72 84 96 108 120
Forecast Period
Bri
er S
core
Imp
rove
men
t (%
)
64 kt Incremental
50 kt Incremental
34 kt Incremental
Cumulative Incremental
![Page 18: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/18.jpg)
Threat Score (TS)
• Choose a probability threshold to divide between yes or no forecast
• Calculate Threat Score (TS)• Repeat for wide range of thresholds
– Every 0.5% from 0 to 100%• Find maximum TS possible• Compare best TS for GPCE and operational model runs
ab cForecast Area Observed Area
)( cba
aTS
![Page 19: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/19.jpg)
Threat Score Improvements2008 GPCE MC Model Test
-6
-4
-2
0
2
4
6
8
10
12
12 24 36 48 60 72 84 96 108 120
Forecast Period (hr)
TS
Ove
rlap
Are
a In
crea
se (
%)
64 kt Incremental
50 kt Incremental
34 kt Incremental
Cumulative Incremental
-6
-4
-2
0
2
4
6
8
10
12
12 24 36 48 60 72 84 96 108 120
Forecast Period (hr)
TS
Ove
rlap
Are
a In
crea
se (
%)
64 kt Cumulative
50 kt Cumulative
34 kt Cumulative
![Page 20: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/20.jpg)
Potential Impact of GPCE on Hurricane Warnings
• Automated hurricane warning guidance from MC probabilities under development– Schumacher et al. (2009 IHC)
• Warning algorithm run for Hurricane Gustav (2008)– Operational and GPCE
versions
![Page 21: An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update](https://reader035.vdocuments.net/reader035/viewer/2022062808/568154e4550346895dc2de80/html5/thumbnails/21.jpg)
Summary
• Code optimization and wind speed table product are complete– Implemented before 2007 and 2008 seasons
• GPCE-dependent MC model – Tested on 169 Atlantic cases from 2008 – Results are qualitatively reasonable– Improves Brier Score at all time periods relative to
operational MC model– Improves Threat Score at most time periods
• Not tested in the eastern and western Pacific