![Page 1: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/1.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Efficient and Robust Solution Strategies forSaddle-Point Systems
Mentor: Dimitar TrenevJeremy Chiu, Lola Davidson, Aritra Dutta, Jia Gou,
Kak Choon Loy, Mark Thom
Mathematical Modeling in Industry XVIII
University of British Columbia
August 16, 2014
![Page 2: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/2.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Overview
1 Saddle-Point Systems
2 Krylov Subspace MethodsIterative SolversPreconditioners
3 Stationary Iteration MethodsUzawa’s MethodAugmented Lagrangian Method
4 Multilevel MethodsMultigrid MethodBPX Preconditioner
![Page 3: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/3.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Definition
Saddle-point systems are linear systems of the form[A BT
1
B2 C
] [xy
]=
[fg
]satisfying
A and C square matrices, dim A ≥ dim C .
A + AT positive-semidefinite
C symmetric and negative-semidefinite
![Page 4: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/4.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
The Challenge
Saddle point systems from finite element methoddiscretizations are
sparse but very large: suggests use of iterative solvers
poorly conditioned, indefinite: hard for iterative solvers
![Page 5: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/5.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Simplified Problem of Interest
Start with a “simple” problem:
[A BT
1
B2 C
] [xy
]=
[fg
]where
A symmetric and positive definite
B1 = B2
C = 0
![Page 6: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/6.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Krylov Subspace Methods
![Page 7: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/7.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Iterative Solvers
Direct methods won’t work!
too slow and not enough memory
turn to iterative methods
Early testing identified:
l-Generalized Biconjugate Gradient Stabilized Method(BiCGstabl)
Minimal Residual Method (MinRes)
Generalized Minimal Residual Method (GMRes)
![Page 8: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/8.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Iterative Solvers
Direct methods won’t work!
too slow and not enough memory
turn to iterative methods
Early testing identified:
l-Generalized Biconjugate Gradient Stabilized Method(BiCGstabl)
Minimal Residual Method (MinRes)
Generalized Minimal Residual Method (GMRes)
![Page 9: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/9.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Preliminary Results
Computation vs mesh size:
Time per iteration can be reduced (parallel computing).
Iterating is innately serial process, so we want lessiterations!
![Page 10: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/10.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Preconditioning
Recall that matrix A’s condition number κ(A) is
κ(A) = ‖A‖ · ‖A−1‖
Problem: Solve Ax = b, where κ(A)� 1Idea:
Define P such that P ≈ A
Hope P−1 ≈ A−1 (and much easier to compute!)
Solve (P−1A)x = P−1b
Since P−1A resembles identity, we have
κ(P−1A) < κ(A)
![Page 11: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/11.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Finding P
For nonsingular A, we have LDU block-factorization[A BT
1
B2 0
]=
[I 0
B2A−1 I
] [A 00 S
] [I A−1BT
1
0 I
]where
S = B2A−1BT
1
So a great preconditioner is
P =
[A 00 S
]
![Page 12: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/12.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Use P
But finding P−1 is equivalent to solving our system!
We took
P =
[A 0
0 S
],
with the following choices for A
D = diag(A)T = tridiagonal part of ALA = lumped-mass matrix
where S = B2A−1BT
1
![Page 13: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/13.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Use P
But finding P−1 is equivalent to solving our system!
We took
P =
[A 0
0 S
],
with the following choices for A
D = diag(A)T = tridiagonal part of ALA = lumped-mass matrix
where S = B2A−1BT
1
![Page 14: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/14.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Preconditioner Comparison
Two solvers on a 10,000 by 10,000 matrix
Name Residual Iterations Runtime(sec)
bicgstabl I 10−6 2118 13.156D 10−6 15 53.3905T 10−6 16 159.968
minres I 10−6 3239 6.7009D 10−6 46 41.0382T 10−6 45 106.7194
![Page 15: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/15.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Preconditioner Comparison
MinRes on different matrix sizes
![Page 16: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/16.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Preconditioner Comparison
MinRes on different matrix sizes
![Page 17: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/17.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Preconditioner Results
GMRes on 10,000 by 10,000 matrix
No Preconditioner Preconditioner(D)
iterations 398, 620 95run time 1428 secs. 77 secs.residual 10−8 10−8
![Page 18: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/18.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Summary of Krylov Subspace Methods
Of the solvers tested, MINRES performed the best inruntime and iterations, however, it requires symmetry.
Preconditioners are necessary to keep the number ofiterations low.
Several preconditioners were tested with the diagonalpreconditioner performing the best.
These preconditioners require inner iterations which arecomputationally costly.
Need to look into speeding up application ofpreconditioner.
![Page 19: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/19.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Stationary Iteration Methods
![Page 20: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/20.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Uzawa’s Method
The constrained optimization problem associated with thesaddle point system is{
minx12〈Ax , x〉 − 〈f , x〉
subject to Bx = g .
The unconstrained version of the above problem
L(x , y) =1
2〈Ax , x〉 − 〈f , x〉+ 〈y ,Bx − g〉,
where y ∈ Rm in the Lagrange multiplier vector.
![Page 21: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/21.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Uzawa’s Method
The constrained optimization problem associated with thesaddle point system is{
minx12〈Ax , x〉 − 〈f , x〉
subject to Bx = g .
The unconstrained version of the above problem
L(x , y) =1
2〈Ax , x〉 − 〈f , x〉+ 〈y ,Bx − g〉,
where y ∈ Rm in the Lagrange multiplier vector.
![Page 22: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/22.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Algorithm
Uzawa’s Method
Starting with initial guesses x0 and y0, solveAxk+1 = f − BT yk
yk+1 = yk + ω(Bxk+1 − g)where ω > 0 is a relaxation parameter.
Substituting xk+1 in the second equation we find theRichardson’s scheme
yk+1 = yk + ω(BA−1f − g − BA−1BT yk)
and the bound for ω is 0 < ω < 2λmax
and
ωoptimal =2
λmax + λmin
![Page 23: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/23.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Results
Figure: Residual vs Iteration plot for Uzawa’s Algorithm
![Page 24: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/24.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Augmented Lagrangian Method
The augmented Lagrange function associated with the saddlepoint system is
L(x , y , γ) =1
2〈Ax , x〉 − 〈f , x〉+ 〈y ,Bx − g〉+
γ
2‖Bx − g‖22,
where γ > 0 is a balancing parameter. Using an alternatingstrategy of minimizing L(x , y , γ) with respect to eachcomponent we find
xk+1 = arg minx
L(x , yk , γ)
andyk+1 = arg min
yL(xk+1, y , γ)
![Page 25: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/25.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Algorithm
Augmented Lagrangian method
Starting with intial guess x0 and y0, solve(A + γBTB)xk+1 = f − BT yk
yk+1 = yk + γ(Bxk+1 − g)γ > 0 is a balancing parameter.
![Page 26: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/26.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Results
Figure: Residual vs Iteration plot for ALM
![Page 27: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/27.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Summary of Stationary Iteration Methods
Implementation of Uzawa’s Algorithm
The method converges very slowly.The parameter ω needs adjustment.The choice of ω can vary from system to system.
Implementation of Augmented Lagrangian Method
The method converges very fast, but iteration steps arecostly.The method depends on the adjustment of the parameterγ.The system solved in each iteration needs betterpreconditioning.
![Page 28: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/28.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Multilevel Methods
![Page 29: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/29.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Introduction to Multigrid
Find the restriction and prolongation operators IhH and IH
h
Implement the algorithm
Results
![Page 30: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/30.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Creating IhH and IH
h
Mapping the Degrees of Freedom
![Page 31: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/31.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Multigrid Algorithms
Two-grid method consists of the following steps:
Perform m pre-smoothing steps on Ahuh = bh;
Compute the fine grid residual rm = bh −Ahuh;
Apply the restriction to the fine grid residual, rH = IhH rh;
Solve the coarse grid problem AHuH = rH ;
Add the correction, uh = uh + αIHh uH ;
Perform n post-smoothing steps.
![Page 32: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/32.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Results
![Page 33: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/33.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Results
![Page 34: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/34.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
BPX Preconditioner: Definition
The Bramble-Pasciak-Xu Preconditioner (BPX) is defined:
P−1 = BBPX =J∑
j=0
IjITj
where Ij is an prolongation operator that translates the systemfrom triangulation size j to the finest triangulation size J.
![Page 35: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/35.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Results
GMRes on 2680 by 2680 matrix
No BPX with BPX
iterations 9575 1701run time 408 secs. 76 secs.residual 10−6 10−6
MinRes on 2680 by 2680 matrix
No BPX with BPX
iterations 622 289run time 0.1978 secs. 0.239 secs.residual 10−4 10−4
![Page 36: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/36.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Pros and Cons
Pros
Don’t have to compute P−1 using a solver
Only have to build BBPX one time for multiple systems
Cons
BBPX takes a long time to compute
In our testing, it converges in more iterations than whenusing the block diagonal with A =diag(A).
![Page 37: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/37.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Summary of Multilevel Methods
Implementation of Multigrid
Initial results of Multigrid are promising, but moreinvestigation is needed.Multigrid could be implemented as a preconditioner toother methods.
Implementation of Bramble-Pasciak-Xu Preconditioner(BPX)
Again, initial results are promising, but comparison testsare needed.BPX could be a highly useful preconditioner since it onlyneeds to be built once.
![Page 38: Efficient and Robust Solution Strategies for Saddle-Point ... · Saddle-Point Systems Krylov Subspace Methods Iterative Solvers Preconditioners Stationary Iteration Methods Uzawa’s](https://reader030.vdocuments.net/reader030/viewer/2022040612/5f03b8747e708231d40a70f8/html5/thumbnails/38.jpg)
Saddle-PointSystems
KrylovSubspaceMethods
Iterative Solvers
Preconditioners
StationaryIterationMethods
Uzawa’s Method
AugmentedLagrangianMethod
MultilevelMethods
MultigridMethod
BPXPreconditioner
Thank you!
Questions?