za¨is university ; cecile mercadier lyon, france and mario...
Post on 19-Aug-2020
2 Views
Preview:
TRANSCRIPT
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Computing the maximum of random processesand series
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington StateUniversity ; Cecile Mercadier Lyon, France and Mario Wschebor
Universite de Toulouse
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 1 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
1 Introduction
2 MCQMC computations of Gaussian integralsReduction of varianceMCQMC
3 Maxima of Gaussian processes
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 2 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Introduction
The lynx data
0 20 40 60 80 100 1200
1000
2000
3000
4000
5000
6000
7000
Annual record of the number of the Canadian lynx ”trapped” in theMackenzie River district of the North-West Canada for the period1821 - 1934, (Elton and Nicholson, 1942)
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 3 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Introduction
After passage to the log and centering
0 20 40 60 80 100 120−4
−3
−2
−1
0
1
2
3
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 4 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Introduction
Testing
The maximum of absolute value of the series is 3.0224. An estimationof the covariance with WAFO gives
0 20 40 60 80 100 120−1.5
−1
−0.5
0
0.5
1
1.5
2
Can we judge the significativity of this quantity ?
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 5 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Introduction
We assume the series is Gaussian.Let ϕΣ the Gaussian density in R114. We have to compute∫∫ 3.0224
−3.0224ϕΣ(x1, . . . , x114)dx1, . . . , dx114
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 6 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
MCQMC computations of Gaussian integrals
Reduction of variance
Let us consider our problem in a general setting. Σ is a n× ncovariance matrix
I :=∫ u1
l1· · ·∫ un
lnϕΣ(x)dx (1)
By conditioning or By Choleski decomposition we can write
x1 = T11z1
x2 = T12z1 + T22z2
.....................................
Where the Zi’s are independent standard. Integral I becomes
I :=∫ u1/T11
l1/T11
ϕ(z1)dz1
∫ u2 − T12z1
T22l2 − T12z1
T22
ϕ(z2)dz2 · · · · · · (2)
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 7 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
MCQMC computations of Gaussian integrals
Reduction of variance
Now making the change of variables ti = Φ(zi)
I :=∫ Φ−1(u1/T11)
Φ−1(l1/T11)
dt1
∫ Φ−1(u2 − T12Φ−1(t1)T22
)Φ−1( l2 − T12Φ−1(t1)
T22
) dt2 · · · · · · (3)
And by a final scaling this integral can be written as an integral on thehypercube [0, 1]n.
I :=∫
[0,1]nh(t)dt. (4)
At this stage, if form (4) is evaluated by MC it corresponds to animportant reduction of variance (10−2, 10−3) with respect to the form(1). The transformation up to there is elementary but efficient.
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 8 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
MCQMC computations of Gaussian integrals
MCQMC
QMC
In the form (4) the MC evaluation is based on
I = 1/MM∑
i=1
h(ti)
it is well known that its convergence is slow : O(M−1/2).The Quasi Monte Carlo Method is based on the of searchingsequences that are “more random than random”. A popular method isbased on lattice rules. Let Z1 be a “nice integer sequence” in Nn, therule consist of choosing
ti ={ i.z
M
},
where the notation{}
means that we have taken the fractional partcomponentwise. M is chosen prime.
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 9 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
MCQMC computations of Gaussian integrals
MCQMC
Theorem(Nuyens and cools, 2006) Assume that h is the tensorial product ofperiodic functions that belong to a Koborov space (RKHS). Then theminimax sequence and the worst error can be calculated by apolynomial algorithm. Numerical results show that the convergence isroughly O(M−1).
This result concerns the “worst case” so it is not so relevant
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 10 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
MCQMC computations of Gaussian integrals
MCQMC
A meta theorem
If h does not satisfies the conditions of the preceding theorem we canstill hope QMC to be faster than MC
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 11 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
MCQMC computations of Gaussian integrals
MCQMC
MCQMC
Let (ti, i) be the lattice sequence, the way of estimating the integralcan be turn to be random but exactly unbiased by setting
I = 1/MM∑
i=1
h({
ti + U})
where U is uniform on [0, 1]n.By the meta theorem I has small variance.
So we can make N independent replications of this calculation andconstruct Student-type confidence intervals. It is correct whatever theproperties of the function h are.N must be chosen small : in practical 12.
Conclusion : At the cost of a small loss in speed (√
12 ) we have areliable estimation of error.
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 12 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
MCQMC computations of Gaussian integrals
MCQMC
This method has been used to construct confidence bands forelectrical load curves prediction. Azaıs, Bercu, Fort, Lagnoux L e(2009)
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 13 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
Do processes exist ?
In this part X(t) is a Gaussian process defined on a compact interval[0,T].Since such a process is always observed in a finite set of times andsince the previous method work with say n = 1000, is it relevant toconsider continuous case ?Answer yes : random process occur as limit statistics. Consider forexample the simple mixture model{
H0 : Y ∼ N(0, 1)H1 : Y ∼ pN(0, 1) + (1− p)N(µ, 1) p ∈ [0, 1], µ ∈M ⊂ R (5)
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 14 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
Theorem (Asymptotic distribution of the LRT)
Under some conditions the LRT of H0 against H1 has , under H0, thedistribution of the random variable
12
supt∈M{Z2(t)}, (6)
where Z(.) is a centered Gaussian process covariance function
r(s, t) =est − 1√
es2 − 1√
et2 − 1.
In this case there is no discretization.
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 15 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
The record method
P{M > u} = P{X(0) > u}+∫ T
0IE(X′(t)+1IX(s)≤u,∀s<t
∣∣X(t) = u)pX(t)(u)dt
(7)after discretization of [0,T], Dn = {0,T/n, 2T/n, . . . ,T} Then
P{supt∈Dn
X(t) > u} ≤ P{M > u} ≤ P{X(0) > u}
+∫ T
0IE(X′(t)+1IX(s)≤u,∀s<t,s∈Dn
∣∣X(t) = u)pX(t)(u)dt (8)
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 16 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
Now the integral is replaced by a trapezoidal rule using the samediscretization. Error of the trapezoidal rule is easy to evaluate .
Moreover that the different terms involved can be computed in arecursive way.
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 17 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
An example
Using MGP written by Genz , let us consider the centered stationaryGaussian process with covariance exp(−t2/2)[ pl, pu, el, eu, en, eq ] = MGP( 100000, 0.5, 50,@(t)exp(-t.2/2), 0, 4);pu upper bound witheu = estimate for total error,en = estimate for discretization error, andeq = estimate for MCQMC error;pl lower boundel = error estimate (MCQMC)
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 18 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
Extensions
Treat all the cases : maximum of the absolute value, non centered,non-stationary. In each case some tricks have to be used.
A great challenge is to use such formulas for fields .
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 19 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
References
Level Sets and Extrema of Random Processes and FieldsJean-Marc Azaïs and Mario Wschebor
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 20 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
Azaıs Genz, A. (2009),Computation of the distributionof the maximum of stationary Gaussian sequences andprocesses. In preparationAllan Genz web sitehttp ://www.math.wsu.edu/faculty/genz/homepageMercadier,C. (2005). MAGP tooolbox,http ://math.univ-lyon1.fr/ mercadier/Mercadier, C. (2006), Numerical Bounds for theDistribution of the Maximum of Some One- andTwo-Parameter Gaussian Processes, Adv. in Appl.Probab. 38, pp. 149–170.Nuyens, D., and Cools, R. (2006), Fast algorithms forcomponent-by-component construction of rank-1 latticerules in shift-invariant reproducing kernel Hilbertspaces, Math. Comp 75, pp. 903–920.
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 21 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
THANK-YOUMERCIGRACIAS
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 22 / 22
IntroductionMCQMC computations of Gaussian integrals
Maxima of Gaussian processes
Computing the maximum of random processes and series
Maxima of Gaussian processes
THANK-YOUMERCIGRACIAS
Jean-Marc AZAIS Joint work with : Alan Genz ,Washington State University; Cecile Mercadier Lyon, France and MarioWschebor (Universite de Toulouse ) 22 / 22
top related