//
Benchmarking Execution Performance and Earned Value
EVM World 2012 Conference
//
//
April 9, 2023 2
Brad Arterbury, PMP
◦ About Me◦ MBA, Texas State University◦ Current member of PMI◦ Wide-ranging business expertise
◦ Role◦ Currently lead business development efforts:
◦ Information Technology◦ Aerospace and Defense◦ Government
//
//
April 9, 2023 3
About Acumen
◦ Project management software company
◦ Insight into PM challenges and use of analytics to overcome them
◦ Core concepts◦ Project success requires a sound plan◦ Forecast accuracy requires risk consideration
//
//
April 9, 2023 4
Benchmarking Defined
◦ To measure according to specified standards in order to compare with and improve one’s own product
//
//
April 9, 2023 5
Benefits of Benchmarking
◦ Context given to project analysis and scoring
◦ Internal and external starting point
◦ Portfolio tracking
//
//
April 9, 2023 6
Three Types of Benchmarking
◦ Intra-project Benchmarking◦ Compare ribbons or time phases within the same
project against one another
◦ Inter-project Benchmarking◦ Compare a single project against prior snapshots of
the same plan or similar past projects
◦ Cloud Benchmarking◦ Compare a single project against a database of
thousands of like projects
//
//
April 9, 2023 7
Metric Requirements
◦ What are metrics?◦ Measurable, actionable criteria
◦ Schedule, Cost, Risk◦ Both quality and performance
◦ Industry Standards◦ Earned Value Management◦ DCMA 14-Point Assessment◦ GAO 10 Best Practices
//
//
April 9, 2023 8
DCMA 14-Point Assessment
◦ A precursor to EVM analysis
◦ Metrics look at schedule quality primarily
◦ Provides some schedule performance feedback absent of cost data
//
//
April 9, 2023 9
Fuse Schedule Index
◦ Nine different schedule checks combined with their proven thresholds
◦ Individually calculated and weighted before compilation
◦ For example, Logic Density should be between 2 and 4
//
//
April 9, 2023 10
Tracking Execution Performance
◦ Percent Complete◦ Doesn’t account for effort or resources
◦ Baseline Compliance◦ Performance for start/finish by time phase
◦ Earned Schedule
//
//
April 9, 2023 11
Importance of Earned Value
◦ Metrics for performance analysis of cost and schedule in one system
◦ Proven predictor of project success
◦ Established methodology for government contracts
//
//
April 9, 2023 12
Benchmarking EVM
◦ In planning and execution, useful to benchmark EVM metrics
◦ Provides context‒ Validates baseline‒ Calibrates performance
◦ Benchmark against internal past and external past in parallel or vs. a rollup of thousands of projects
//
//
April 9, 2023 13
Metric Analysis for Intra-Project Benchmarking
◦ Group data into ribbons by a common attribute
◦ Group data into time phases
◦ Apply customizable metrics for true project insight
//
//
// //
April 9, 2023 14
Intra-Project Benchmarking
◦ SV◦ SPI
◦ CV◦ CPI
//
//
April 9, 2023 15
Inter-Project Benchmarking
◦ Understand variance on the same project over time
◦ Ensure integrity of baselines◦ Especially useful when applying EVM
◦ Insight into differences of similar projects
//
//
April 9, 2023 16
Forensic Analysis
◦ Differences from baseline to status updates◦ Calendar◦ Milestones◦ Critical path
◦ Find causes of delay and cost overruns that are affecting execution performance
//
//
April 9, 2023 17
Cloud Benchmarking
◦ Global Project database
◦ Access through Acumen Fuse
◦ Targeted benchmarking using standardized scoring
//
//
// //
April 9, 2023 18
Scoring
Fuse Schedule Index™ Fuse Logic Index™
//
//
April 9, 2023 19
Probability of Success
//
//
April 9, 2023 20
Planning = Execution Success
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Fuse Schedule Index™
Pro
ba
bil
ity
of
On
-Tim
e C
om
ple
tio
n
//
//
April 9, 2023 21
Benchmarking Summary
◦ Tools for comparing project quality and performance
◦ Compare EV metrics, 14-Point Assessment metrics, GAO Scheduling Best Practices, and other metrics by project
◦ Schedule and Logic Quality in Acumen Cloud Benchmarking
//
//Questions?
//
//
April 9, 2023 23
More Information
◦ White papers: www.projectacumen.com
◦ Software trial: www.projectacumen.com/trial
◦ Twitter: @projectacumen
◦ E-mail: [email protected]
