l-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf ·...

24
L-curve-based regularization parameter selection 10 1.4 10 1.5 10 1.6 10 1.7 10 1.8 10 1.9 10 1 10 2 10 3 10 4 misfit regularization 10 -3 10 -2 10 -1 5 × 10 -1 10 0 5 × 10 0 10 1 O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babu ˇ ska Forum 36 / 67

Upload: others

Post on 02-Oct-2020

10 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

L-curve-based regularization parameter selection

101.4 101.5 101.6 101.7 101.8 101.9

101

102

103

104

misfit

regu

lari

zati

on

10−3

10−2

10−1

5 × 10−1

100

5 × 100101

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 36 / 67

Page 2: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Antarctic ice sheet inversion for basal sliding field:InSAR data

Left: InSAR-based Antarctica ice surface velocity observationsRight: Inferred basal sliding field

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 37 / 67

Page 3: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Antarctic ice sheet inversion for basal sliding field:InSAR data

InSAR-based Antarctica ice surface velocity observations

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 38 / 67

Page 4: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Antarctic ice sheet inversion for basal sliding field:InSAR data

Reconstructed ice surface velocity field

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 38 / 67

Page 5: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Analysis of data misfit Hessian for a (nonlinear) ellipticcoefficient inverse problem (P. Flath, 2013)

Invert for log-coefficient field γ(x) in Poisson equation from observations of stateu(x) within domain:

minγ∈M

1

2

∫ L

0

(b u(γ)− dobs)2 dx

where the map from γ to u is defined by solution of:

− d

dx

(eγdu

dx

)= 0 for x ∈ (0, L)

u(0) = u0

u(L) = uL

Two cases of observation operator:

full observations: b(x) = 1pointwise observations: b(x) = L

n

∑nj=1 δ(x− xj)

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 52 / 67

Page 6: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Analysis of Hessian for elliptic coefficient inverse problem

assume no noise, γ = γ0 is true log-medium

Fourier analysis of spectrum of data misfit Hessian, evaluated at γ0, giveseigenvalues for both cases:

full observations: λi = (uL−u0)2

π2i2

n pointwise observations: λi = (uL−u0)2

4n2 sin(iπ/2n)2

Spectrum of data misfit Hessian for both full and pointwise observationsLeft: 6 observations Right: 500 observations

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 53 / 67

Page 7: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Analysis of Hessian for elliptic coefficient inverse problem

Eigenfunctions of data misfit Hessian are cos(iπx/L) in full observationscase, and piecewise-constant interpolants of the cosines in pointwise case

Eigenfunctions 1, 2, 5, and 6 for full and pointwise (n = 6) observations

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 54 / 67

Page 8: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Spectrum of the prior-preconditioned data misfit Hessian

0 1000 2000 3000 400010

−2

100

102

104

106

108

number

eig

en

va

lue

409,545 parameters

1,190,403 parameters

Spectrum of Γ1/2pr F TΓ−1

noiseF Γ1/2pr for Antarctica inverse problem with 410K

and 1.19M basal sliding parameters (observed to decay like i−3)

4000 dominant modes, independent of parameter and data dimension

intrinsic problem dimension depends on information content of data

O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 59 / 67

Page 9: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 1 of prior-preconditioned data misfit Hessian

eigenvector 1O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 10: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 2 of prior-preconditioned data misfit Hessian

eigenvector 2O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 11: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 3 of prior-preconditioned data misfit Hessian

eigenvector 3O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 12: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 4 of prior-preconditioned data misfit Hessian

eigenvector 4O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 13: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 5 of prior-preconditioned data misfit Hessian

eigenvector 5O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 14: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 6 of prior-preconditioned data misfit Hessian

eigenvector 6O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 15: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 7 of prior-preconditioned data misfit Hessian

eigenvector 7O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 16: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 8 of prior-preconditioned data misfit Hessian

eigenvector 8O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 17: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 9 of prior-preconditioned data misfit Hessian

eigenvector 9O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 18: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 10 of prior-preconditioned data misfit Hessian

eigenvector 10O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 19: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 100 of prior-preconditioned data misfit Hessian

eigenvector 100O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 20: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 200 of prior-preconditioned data misfit Hessian

eigenvector 200O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 21: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

Eigenvector 500 of prior-preconditioned data misfit Hessian

eigenvector 500O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 22: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

E-vector 1000 of prior-preconditioned data misfit Hessian

eigenvector 1000O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 23: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

E-vector 2000 of prior-preconditioned data misfit Hessian

eigenvector 2000O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67

Page 24: L-curve-based regularization parameter selectionomar/inverse_problems/spectrum_hessian.pdf · Antarctic ice sheet inversion for basal sliding eld: InSAR data Reconstructed ice surface

E-vector 4000 of prior-preconditioned data misfit Hessian

eigenvector 4000O. Ghattas (UT-Austin) Bayesian inversion for Antarctic sheet ICES Babuska Forum 60 / 67