devops scorecard
TRANSCRIPT
The DORA Technology Performance Assessment
A unique, holistic, scientific tool to drive IT performance improvement
http://devops-research.com
Technology Performance and OrganizationsOur research has found that High Performing Technology Organizations
2xMore likely to exceed Profitability, Market share, Mission,Productivity goals
50%Higher market capgrowth over 3 years
High Performing Technology teams
More agile
The 2016 State of DevOps Report
@nicolefv
200x
200x more frequent deployments
2,555x
2,555x shorter lead times
High Performing Technology teams
More reliable
The 2016 State of DevOps Report
@nicolefv
24x
24x fasterrecovery from failures
3x
3x lowerchange fail rage
Consider a DORA Assessment if you have problems:• Attracting and retaining talent
• Employees in High Performance teams are 2.2 times more likely to recommend their organization as a great place to work.
• Establishing a brand as a high-performing organization• Top organizations rely on DORA’s research and assessments to
improve their work• Improving technology and organizational performance
• Our assessment only focuses on capabilities that have been shown to improve performance
• Prioritizing improvement efforts• The DORA Assessment includes customized guidance to help you
improve your technology faster
Challenge: How do you become a High Performing Technology Organization?
Organizations need to deliver software quickly and reliably to delight their customers, deliver features ahead of their competitors, accomplish mission goals, and win in the market.
Delivering software quickly and reliably often means undergoing a technology transformation. How can organizations get objective, repeatable information on how they are performing relative to the industry, make effective investment decisions when developing team strategy, and find out if those investments pay off?
Purpose
• Help organizations benchmark technology performance against their overall organization and the industry• Assess capabilities in areas shown to be predictive of
technology performance within teams• Show which capabilities will provide the greatest
impact if developed• Help teams understand how to develop these
capabilities
The DORA Technology Assessment
• Is a scientific, research-based, statistical tool that allows you to measure and benchmark your overall technology performance and the effectiveness of your capabilities against data from the industry • Based on research and data from Puppet and DORA’s State of DevOps
Reports, 20,000+ respondents, 2,000+ organizations, spanning several industry verticals
• Created by DevOps industry gurus Gene Kim, Jez Humble and Dr. Nicole Forsgren• Yields a Prioritization Matrix for a Line of Business (LoB),
based on maximum impacts to technology performance
Benchmarking against Company: LoB1, Team1
Capabilities improve outcomes. Dark black lines indicate the benchmark for each capability. The team’s performance is represented by how far out the area is shaded.
Capabilities
Dark black lines indicate the industry benchmark (50th
percentile) for each outcome. The team’s performance on each outcome is represented by how far out the area is shaded. Outcomes with a goal of minimizing (such as burnout) are shown in red.
Outcomes:(Blue outcomes: Higher is better. Red outcomes: Lower is better.)
(Higher is better)
Benchmarking against Industry: LoB1, Team1
Our capabilities chart reports how the team is doing. • Low on: Change Process, Trunk-based development, WIP
Limits and Visualization of Work• High on: Learning Culture, Failure
Notification
Capabilities
Our outcomes chart shows us that we have room for improvement compared to the Industry High Performers.
Our practitioners report burnout above industry averages, but lower than average levels of deploy pain.
Outcomes:(Blue outcomes: Higher is better. Red outcomes: Lower is better.)
(Higher is better)
Priority Analysis:LoB1This analysis is specifc to the LoB, and highlights which capabilities will impact Technology Performance the most. That is, it identifies the capabilities that are currnetconstraints and should be priorities for improvement. This can help teams prioritize initiatives and resource allocation for the coming cycle.
The goal is to identify those which Perform the lowest and have the highest Impact.
The knowledge base provides guidance and insights into which practices are most helpful in improving each capability.
Legend:Green: Process capabilityBlue: Technical capabilityOrange: Cultural capabilityYellow: Metrics/ monitoring capability
Recommended focus areas:
1. Process Control2. Monitoring3. Small batch development4. Test Data Management5. Continuous Integration
Critical Continuous Integration Capabilities: What’s Important• Developers break up large features into small, incremental
changes.• Code commits result in an automated build of the software.• Code commits result in a series of automated tests being run.• Automated builds and tests are executed successfully every day.• Current builds are available to testers for exploratory testing.• Developers get feedback from the acceptance and performance
tests every day.
How It WorksThe DORA Assessment can measure and benchmark all technology organizations, whether they are traditional (“waterfall”), Agile, DevOps, or their own unique combination of all three.
Running a DORA Assessment follows four stages:1. Decompose an Organization
• Identify the Lines of Business and teams to be assessed2. Prepare for Assessment
• Socialize the survey and prepare email distribution lists3. Take the Assessment
• Everyone takes a 15- to 20-min survey4. Generate and Deliver Reports
• Team capabilities and outcomes benchmarked against the organization• Team capabilities and outcomes benchmarked against the industry• Prioritization analysis, with capabilities arranged by impact to TechnologyPerformance
