![Page 1: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/1.jpg)
QUANTIFYING RESILIENCE-BASED
IMPORTANCE MEASURES
USING BAYESIAN KERNEL METHODS
Hiba Baroud, Ph.D.
Civil and Environmental Engineering
Vanderbilt University
Thursday, May 19, 2016
![Page 2: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/2.jpg)
Photo: Marco Monetti
WHAT IS RESILIENCE?
![Page 3: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/3.jpg)
Hosseini, S., Barker, K. and Ramirez-Marquez, J.E., 2016. A review of definitions and
measures of system resilience. Reliability Engineering & System Safety, 145, pp.47-61.
HOW DID IT START?
![Page 4: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/4.jpg)
WHY IS IT IMPORTANT?
4
![Page 5: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/5.jpg)
WHY IS IT IMPORTANT?
Hosseini, S., Barker, K. and Ramirez-Marquez, J.E., 2016. A review of definitions and
measures of system resilience. Reliability Engineering & System Safety, 145, pp.47-61.
![Page 6: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/6.jpg)
A resil ient infrastructure sector would “rapidly recover and
reconstitute crit ical assets, operations, and services with minimum
damage and disruption.”
WHAT IS THE DEFINITION OF RESILIENCE?
6
In frastructure Security Par tnership
There are almost as many definitions of
resilience as there are people defining it.
Congressional Research Service Repor t for Congress
Resil ience is the abil ity of assets, networks and systems to anticipate,
absorb, adapt to and/or rapidly recover from a disruptive event .
Cabinet Of f ice , UK
Infrastructure resil ience is the abil ity to reduce the magnitude and/or
duration of disruptive eventsNational In frastructure Advisory Council
![Page 7: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/7.jpg)
HOW DO WE MEASURE IT?
Hosseini, S., Barker, K. and Ramirez-Marquez, J.E., 2016. A review of definitions and
measures of system resilience. Reliability Engineering & System Safety, 145, pp.47-61.
![Page 8: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/8.jpg)
BEFORE A DISRUPTION
8Henry, D. and J.E. Ramirez-Marquez. 2012. Generic Metrics and Quantitative Approaches for System
Resilience as a Function of Time. Reliability Engineering and System Safety, 99(1): 114-122.
Risk Management
Planning and
preparedness decision
making
Risk mitigation
![Page 9: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/9.jpg)
AFTER A DISRUPTION
9Henry, D. and J.E. Ramirez-Marquez. 2012. Generic Metrics and Quantitative Approaches for System
Resilience as a Function of Time. Reliability Engineering and System Safety, 99(1): 114-122.
Recovery management
Post-disaster strategies
Stochastic behavior of
recovery
![Page 10: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/10.jpg)
Component importance measures (CIM)
Commonly found in risk and reliability
engineering
Extended to resilience analysis
Impact of a component on the resilience of the
system
How is the recovery of the entire system impacted
by the recovery of a component?
RESILIENCE-BASED CIM
10
Barker, K., J.E. Ramirez-Marquez, and C.M. Rocco. 2013. Resilience-Based Network Component
Importance Measures. Reliability Engineering and System Safety, 117(1), 89-97.
Baroud, H., K. Barker, J.E. Ramirez-Marquez, and C.M. Rocco. 2013. Importance Measures for Inland
Waterway Network Resilience. Transportation Research Part E: Logistics and Transportation, 62(1): 55-67.
![Page 11: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/11.jpg)
RESILIENCE-BASED CIM
11
CIЯ𝜑,𝑖 𝑡r 𝑒𝑗 =
𝜑 𝐱 𝑡0 − 𝜑 𝐱 𝑡0 , 𝑥𝑖 𝑡𝑑 𝑉𝑖𝑗
max𝑖 𝜑 𝐱 𝑡0 − 𝜑 𝐱 𝑡0 , 𝑥𝑖 𝑡𝑑 𝑉𝑖𝑗𝑇𝜑 𝐱 𝑡0 𝑉𝑖
𝑗
Network
performance
loss due to
disruption of
component 𝑖
Maximum loss
among all the
components
Time to full
network
restoration
![Page 12: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/12.jpg)
RESILIENCE WORTH INDEX
12
WЯ𝜑,𝑖 𝑡𝑟 𝑒𝑗 =
𝑇𝜑 𝐱 𝑡0 𝑉𝑖
𝑗 − 𝑇𝜑 𝐱 𝑡0 𝑉𝑖
𝑗=0
𝑇𝜑 𝐱 𝑡0 𝑉𝑖
𝑗
0 < WЯ𝜑,𝑖 𝑡𝑟 𝑒𝑗 < 1
Time to total
network
recovery
Time to total
network recovery
when component 𝑖is invulnerable
![Page 13: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/13.jpg)
ASCE REPORT CARD ON AMERICA’S INFRASTRUCTURE
13
The average age of
the 84,000 dams in
the country is 52
years old
By 2020, 70% of
the total dams in
the United States
will be over 50
years old
A S C E ’ s R e p o r t C a r d f o r A m e r i c a ’ s I n f r a s t r u c t u r e [ 2 0 1 3 ]
![Page 14: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/14.jpg)
WHY INLAND WATERWAYS?
14
15-barge grain tow, hauling
approximately 22,500 tons of export
grain, exits Lock & Dam 13
Over 200 lock chambers
Over 566 million tons of freight
(~51 million truck trips)
Over $152 billion equivalence of
goods
Low-cost and fuel-efficient
freight mode
![Page 15: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/15.jpg)
“The dam safety engineering practice is moving
towards a risk-based decision-making process
for the design, rehabilitation, and operation of
dams. Risk-based decisions enable the dam
owner to better utilize limited funding, and
prioritize projects, by focusing on repairs and
operational changes that reduce risk to
acceptable levels, thus improving community
resilience.”
PLAN OF ACTION
15
ASCE’s Repor t Card for America’s In frastructure [2013]
![Page 16: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/16.jpg)
SIMULATION APPROACH
Probability distribution
for the magnitude
of disruption and speed of recovery
Simulation
Probability distribution
for the resilience –based CIM
𝑃 𝑎 < 𝑉𝑖𝑗≤ 𝑏 =
𝑎
𝑏
𝑓 𝑣𝑖𝑗𝑑𝑣𝑖𝑗
𝑃 𝑡𝑠 < 𝑈𝑖𝑗𝑉𝑖𝑗≤ 𝑡𝑟
= 𝑡𝑠
𝑡𝑟
𝑓 𝑢𝑖𝑗𝑉𝑖𝑗𝑑𝑣𝑖𝑗
𝑓 WЯ𝐹,𝑖 𝑡r 𝑒𝑗
![Page 17: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/17.jpg)
STOCHASTIC RANKING OF COMPONENTS
17
WЯ𝜑,𝑖CIЯ𝜑,𝑖
Baroud, H., K. Barker, J.E. Ramirez-Marquez, and C.M. Rocco. 2013. Importance Measures for Inland
Waterway Network Resilience. Transportation Research Part E: Logistics and Transportation, 62(1): 55-67.
![Page 18: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/18.jpg)
DATA-DRIVEN APPROACH
18
Lock &
Dam
Closure
FrequencyRiver Mile Vessels Tonnage Lockages . . .
L&D 3 0 797 9,397 6,747 4,406
L&D 13 6 523 2,810 14,545 3,155
L&D 2 0 815 4,478 6,735 2,893
L&D 20 23 343 2,508 20,828 3,582
L&D 22 40 301 2,280 22,476 3,486
L&D 8 6 679 4,333 10,277 2,620...
US Army Corps of Engineers. 2011. Interactive access to website.
http://www.ndc.iwr.usace.army.mil//lpms/lpms.htm.
![Page 19: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/19.jpg)
DATA-DRIVEN APPROACH
Prior distribution
(prior knowledge, expertise)
Bayesian kernel model
(binary historical
data, attributes)
Posterior distribution
of the resilience
worth
𝑓 WЯ𝐹,𝑖 𝑡r 𝑒𝑗
![Page 20: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/20.jpg)
BETA BAYESIAN KERNEL MODEL
Prior
Posterior
𝑚− = number of
negative labels in
training set
𝑚+ = number of
positive labels in
training set
𝑚 = size of training
set
𝑘 = kernel function
of 𝑥𝑖 and 𝑥𝑗
20MacKenzie, C.A., T.B. Trafalis, and K. Barker. 2014. A Bayesian Beta Kernel Model for Binary
Classification and Online Learning Problems Statistical Analysis and Data Mining, 7(6), 434-449.
𝜃𝑖 𝒚~beta(𝛼, 𝛽)
𝛼∗ = 𝛼 +𝑚−𝑚
{𝑗 𝑦𝑗=1}
𝑘(𝑥𝑖 , 𝑥𝑗)
𝛽∗ = 𝛽 +𝑚+
𝑚 {𝑗 𝑦𝑗=−1}𝑘(𝑥𝑖 , 𝑥𝑗)
![Page 21: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/21.jpg)
Expected value of the posterior distribution
WЯ𝜑,𝑖 𝑡𝑟 𝑒𝑗 = 𝜃𝑖 =
𝛼∗
𝛼∗ + 𝛽∗
Posterior probability distribution
𝑓 WЯ𝜑,𝑖 𝑡𝑟 𝑒𝑗 =
WЯ𝛼∗−1 1 − 𝑊Я 𝛽
∗−1
Β α∗ , β∗
RISK ANALYSIS USING THE RESILIENCE WORTH
21
![Page 22: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/22.jpg)
PREDICTION ACCURACY – UNWEIGHTED MODEL
22
TP=0.89 TN=0.48 ACC=0.55 TP=0.79 TN=0.79 ACC=0.70
TP=0.21 TN=0.96 ACC=0.26 TP=0.99 TN=0.12 ACC=0.16
![Page 23: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/23.jpg)
PREDICTION ACCURACY – WEIGHTED MODEL
23
TP=0.85 TN=0.75 ACC=0.76 TP=0.75 TN=0.86 ACC=0.68
TP=0.21 TN=0.96 ACC=0.01 TP=0.96 TN=0.27 ACC=0.35
![Page 24: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/24.jpg)
INTERPRETABILITY
24
• Rank components
based on their
resilience
• Identify critical
components for
resource allocation
of preparedness
and recovery
strategies
• Incorporate
uncertainty into the
decision
• Integrate the
decision maker’s
expertise and risk
attitude
![Page 25: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/25.jpg)
INTERPRETABILITY
25
ACC=0.80
ACC=0.68
ACC=0.65
![Page 26: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/26.jpg)
POSTERIOR CUMULATIVE DISTRIBUTION
26
Posterior cumulative distribution for the 5
most impactful locks and dams according to
the posterior expected value
![Page 27: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/27.jpg)
Copeland score method: a multi-criteria decision analysis technique
Comparing discrete objects 𝑎 and 𝑏
𝐶𝑘 𝑎, 𝑏 =
𝐶𝑘−1 𝑎, 𝑏 + 1 𝑞𝑘 𝑎 < 𝑞𝑘 𝑏
𝐶𝑘−1 𝑎, 𝑏 − 1 𝑞𝑘 𝑎 > 𝑞𝑘 𝑏
𝐶𝑘−1 𝑎, 𝑏 𝑞𝑘 𝑎 = 𝑞𝑘 𝑏
Copeland Score of object 𝑎
CS 𝑎 =
𝑏≠𝑎
𝐶Ω 𝑎, 𝑏
COPELAND SCORE METHOD
27
![Page 28: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/28.jpg)
RANKING OF COMPONENTS
28
𝑊Я rankingPosterior
expected value
Posterior
Copeland score
1 L&D 24 L&D 22
2 L&D 5 L&D 27
3 L&D 27 L&D 20
4 L&D 20 L&D 5
5 L&D 22 L&D 24
Different ranking of components when the entire
probability distribution is considered
![Page 29: QUANTIFYING RESILIENCE-BASED IMPORTANCE MEASURES … · USING BAYESIAN KERNEL METHODS Hiba Baroud, Ph.D. Civil and Environmental Engineering Vanderbilt University Thursday, May 19,](https://reader035.vdocuments.net/reader035/viewer/2022071214/604273c9aeca506b7345e9a3/html5/thumbnails/29.jpg)
Conclusions
Data-driven and Bayesian methods integrate historical information with the decision maker’s opinion
Posterior probability distributions are more flexible, comprehensive, and informative for risk-based decision making
Prediction accuracy and interpretability of results are highly sensitive to the definition of the prior distribution
A better prediction accuracy does not necessarily mean a better interpretability
Future Research
Investigate a more realistic identification of the prior based on prior knowledge and empirical estimation
Study the tradeoff between prediction accuracy and interpretability and decision making
CONCLUDING REMARKS
29