sensitivity analysis of mesoscale forecasts from large ensembles of randomly and non-randomly...
TRANSCRIPT
![Page 1: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/1.jpg)
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly
Perturbed Model Runs
William Martin
November 10, 2005
![Page 2: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/2.jpg)
Sensitivity Analysis Has a Number of Uses:
-- Identifying physical connections
-- Data assimilation
-- Targeting observations
-- Weather modification
![Page 3: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/3.jpg)
ADJOINTS
For determining the sensitivity field of a forecast to conditions at an earlier time, the use of the adjoint of a forward numerical model has, until recently, been the only method available.
Adjoints are integral parts of 4-dimensional variational data assimilation systems (4DVAR) in which the model state is sought which minimizes the difference between the forecast and a set of observations. The sensitivity of model error to initial fields is determined by an adjoint calculation. This is then used in a minimization scheme.
![Page 4: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/4.jpg)
• Adjoints are easiest to understand in terms of the chain rule for differentiation applied recursively.
• Consider, for example, the following implementation of the Lorenz model (1963):
![Page 5: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/5.jpg)
Using simple first order time differencing, the forecast parameters of the Lorenz model over one time step are:
)1(
)1()(
)()1(
111
1111
11
tcZtYXZ
tXZtYtbXY
taYtaXX
NNNN
NNNNN
NNN
![Page 6: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/6.jpg)
• For a response function, J, we choose the total energy:
• And we might be interested in the sensitivity of J to the initial conditions:
222NNN ZYXJ
000
,,Z
J
Y
J
X
Js
![Page 7: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/7.jpg)
• As J is defined at the forecast time, N, we start at that time with:
• For the sensitivity of J to the model state at the previous time step, we invoke the chain rule:
NN
NN
NN
ZZ
JY
Y
JX
X
J2,2,2
1111
N
N
NN
N
NN
N
NN Y
Z
Z
J
Y
Y
Y
J
Y
X
X
J
Y
J
1111
N
N
NN
N
NN
N
NN Z
Z
Z
J
Z
Y
Y
J
Z
X
X
J
Z
J
1111
N
N
NN
N
NN
N
NN X
Z
Z
J
X
Y
Y
J
X
X
X
J
X
J
![Page 8: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/8.jpg)
In matrix notation this is:
tctX
tXtta
tYtZtbta
Z
J
Y
J
X
J
Z
J
Y
J
X
J
N
N
NN
NNNNNN 10
1
1
,,,,
1
1
11
111
Or:
1-NtN
t1-N TJJ
And by recursion:
))...T)T)TTJ((((Js 03N2N1NtN
t0
Terms on RHS associate, but don’t commute
![Page 9: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/9.jpg)
• For the Lorenz model with 3 degrees of freedom, the adjoint is easy to code and implement.
• For a complex mesoscale model with millions of degrees of freedom and thousands of lines of code, differentiation is difficult.
• Also, calculating the adjoint requires storing the model state at every time step from the forward run.
![Page 10: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/10.jpg)
• As part of the IHOP (2002) program, we wanted to obtain the sensitivity of model forecasts of convective initiation.
• Delays in having the adjoint of the ARPS (the Advanced Regional Prediction System) ready, led to an attempt to obtain this information using Very Large Ensembles (VLE) of forward model runs.
• This is a brute-force way of solving the problem, with the brute being large parallel computing systems at PSC and NCSA.
![Page 11: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/11.jpg)
• The VLE method finds the sensitivity of J to some initial variable at some point in space by applying an initial perturbation at that point and in that variable.
• The assembly of sensitivity fields requires the consideration of such perturbations at every location and in every variable. This is potentially a very large number of perturbations (the model configuration we use has over 6 million degrees of freedom).
• Each perturbation needs a separate forward model run.
![Page 12: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/12.jpg)
Model Configuration
• ARPS model with numerous physical paramemterizations
• 135X135X53 grid points ~ 1 million grid points
• DX=DY=9 km
![Page 13: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/13.jpg)
Initial fields used for the ARPS model run
10-m water vapor 10-m wind barbs
![Page 14: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/14.jpg)
10-m water vapor 10-m wind barbs
6-hour forecast fields
![Page 15: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/15.jpg)
Forecast Precipitation Fields
Vertically integrated liquid Total accumulated ppt
![Page 16: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/16.jpg)
• In order to reduce the number of perturbations, the horizontal domain is divided into 45 X 45 tiles (3 grid points by 3 grid points).
• Sensitivity to boundary layer fields can then be found if we use perturbations 1 km deep at the surface at each of these tiles.
• 45 X 45 perturbations + 1 unperturbed run =2026 perturbed model runs to make.
• This runs in parallel in about 7 hours.
![Page 17: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/17.jpg)
Sample Initial Perturbation
1 g/kg perturbation in a patch 27X27X1 km
![Page 18: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/18.jpg)
),(),(
),(00
yxa
J
a
yxJyxs
Backward sensitivities at an (x,y) location are calculated as the change in response function value (unperturbed minus perturbed) divided by the initial perturbation size at that location. This approximatesThe exact sensitivity if the perturbations are small enough:
),(),( yxJJyxJJ dunperturbeperturbed
![Page 19: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/19.jpg)
Non-Dimensional Sensitivity
0
0
/
/
aa
JJS
With J0=unperturbed run valueAnd a0=unperturbed field value
![Page 20: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/20.jpg)
Sensitivity of forecast Qv in box to initial boundary layer Qv perturbations
Effects of diffusion spread over time
Which combines with advection
No rain in this region
After 6 hours:dryline
![Page 21: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/21.jpg)
Forward- and Backward-in-Time Sensitivities
Backward in time Forward in time
dryline
![Page 22: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/22.jpg)
Sensitivity of Total Rain Along the Dryline to ABL Water Vapor Perturbations
+1 g/kg perturbations -1 g/kg perturbations
![Page 23: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/23.jpg)
Sensitivity of Rain Along the Cold Front to Initial ABL Moisture
+1 g/kg perturbations -1 g/kg perturbations
![Page 24: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/24.jpg)
Strong Non-Linear Sensitivity Near Cold Front
Control run
led to 3 cm precip here
Initial perturbation here
![Page 25: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/25.jpg)
Strong Non-Linear Sensitivity Near Cold Front
Control run
led to 12 cm precip here
Initial perturbation here
![Page 26: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/26.jpg)
• Perturbing more than one initial variable
simultaneously does not ordinarily work as the effects of two separate perturbations interfere with each other, and there is no way to undo the combined effects in the forecasts.
• However, if a large number of randomly perturbed runs is attempted, then statistics may be applied.
• This is similar to the method of calculating error covariances using the Ensemble Kalman Filter.
![Page 27: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/27.jpg)
• If you have N forecasts in which every variable has a random perturbation, then you obtain N different values for the response function, J.
• To determine the sensitivity of the forecast to an initial value of some field at some point in space, these N J values can be linearly regressed against the N random (but known) perturbations of that variable.
![Page 28: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/28.jpg)
• Slope of best fit line provides
J
Delta X
0
),(
a
yxJ
![Page 29: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/29.jpg)
• For this test, we used binary perturbations;
that is, the perturbations were either plus or minus some fixed value, say, 1 K of temperature. Whether the value is to be + or – 1 K is chosen at random.
• The RANDOM_NUMBER function of FORTRAN90 is used, which may not be good enough.
![Page 30: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/30.jpg)
Far more negative perturbations
Than positive perturbations
![Page 31: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/31.jpg)
Sensitivity of Potential Temperature in Box to initial Potential Temperature Perturbations
MAX=.0020 Max=.0021
VLE Random400 runs
2026 runs
![Page 32: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/32.jpg)
Sensitivity of Total PPT in the Box to Initial Boundary Layer Potential Temperature
Max=5.2 Max=5.4
VLE Random
2026 model runs 400 model runs
![Page 33: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/33.jpg)
Log-log plot of RMS noise of a sensitivity field versus ensemble size
![Page 34: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/34.jpg)
Theoretically, noise should scale with the square root of the ensemble size.
O=theoretical noise reduction
![Page 35: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/35.jpg)
Summary
• Both the VLE and random perturbation techniques work well and produce similar results.
• They are viable alternatives to an adjoint, but do require considerable computing resources.
• Using forward model runs can give different information than an adjoint because an adjoint provides the exact sensitivity to a infinitesimal perturbation, while a perturbation method provides the actual impact of a finite perturbation.
• The random perturbation method requires potentially fewer forward model runs, but the reduction of noise to an acceptable level may still require a large ensemble.
![Page 36: Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f165503460f94c2ce00/html5/thumbnails/36.jpg)