transform test organizations for the new world of devops

DT7ConcurrentSession11/9/173:00PM

TransformTestOrganizationsfortheNewWorldofDevOps

Presentedby:

SumitKumar

Capgemini

Broughttoyouby:

350CorporateWay,Suite400,OrangePark,FL32073888---268---8770··[email protected]://www.techwell.com/

SumitKumarCapgeminiDirectoratCapgeminiSumitKumarhasmorethanseventeenyearsofexperienceintestingdelivery,leadingtestingtransformation,andassistingtestingorganizationsadoptingchanges.InrecentyearsSumithasworkedwithvariousmid-tolarge-sizetestingorganizationstomakethemDevOpsready.Sumitworksthroughorganizationalrestructuring,baseliningtestingmaturity,drawingtestingtransformationroadmaps,andimplementinginitiativesspanningacrosstestengineeringfunctions,toolsstrategy,solutionsbuild-up,workforceenablement,andestablishingcollaborations.SumithasconstantlyconceptualizedanddeliveredsolutionplatformsthatenablebetterDevOpsadoption.

1October 2017 © 2017 Capgemini. All rights reserved.

Transforming Test Organizations for the New World of DevOps

- Sumit Kumar

2© 2017 Capgemini. All rights reserved.

What To Expect In This Session


About Me…….

Designing Test Organizations For DevOps

Implementation Of DevOps Ready Test Practices and Solutions

Global Test Delivery – Distributed Agile and DevOps QA

Part Of Capgemini Team

https://www.linkedin.com/in/sumit-kumar-a5a8154/


“IN TIMES OF RAPID CHANGE, **********

COULD BE YOUR WORST ENEMY”

EXPERIENCE


IN TIMES OF RAPID CHANGE, OTHER’S

EXPERIENCE COULD BE YOUR WORST ENEMY

FRIEND


EXPERIENCE I AM LOOKING AT SHARING TODAY….

CHANGE IMPACT STRUGGLE

ACTION PLAN MAKING IT REAL WAY AHEAD


CHANGE


S&P 500 charts indicate that the average company’s tenure is shrinking. By 2030, it’s estimated that 75 percent of the companies on the S&P list will be new companies.

Source - http://electric-cloud.com/blog/2017/07/devops-trends-predictions/



Study has proven that a successful DevOps transformation introduces a disruptive effect —a new competitive environment where the traditional business model is unable to survive

Source - http://assets1.dxc.technology/cloud/downloads/DXC_Cloud_The_DevOps_Disruption_8199a-16.pdf


Change The Lens



Don’t undermine the pace of adoption

Source - Gartner

??


Current IT State Where IT Want To Be With DevOps


Are Testing Organizations Ready For DevOps?


OR Is QA Killing DevOps?

REALLY!!!


IMPACT



No Real Improvement in Quality observed between 2016 and 2017 while DevOps adoption has been much higher!

Testing Organizations are trying to be effective in DevOps models

Source – World Quality Report 2017, Capgemini


>50% of the Testing organizations have moved away from being centralized testing entity

SPEED (Test Cycle Time)


“Within Eighteen months of the introduction of Google Maps Navigation, the makers of stand-alone GPS devices had lost as much as 85 percent of their market value”

AGILITY (Requirement Stability Index)


CUSTOMER EXPERIENCE (Production Incidents, Social Media)


COMPETITION (Revenue, Market Share)


Employees in high-performing teams are 2.2 times more likely to recommend their organizations as a great place to work.

TALENT(High Performance Vs Low

Performance)Source – 2017 State of DevOps Report From Puppet


STRUGGLE


Love for code has been under scanner


IT leadership is not natural


Are there any real Super Powers?

Rest Of IT Test Organization


Change agents?


Haven’t developed enough of this….


Attention is coming late and……


ACTION PLAN


We need to own this!


Speak out


FUNCTIONAL

ENGINEERING

TECHNICAL

SPECIALIZATION


MODERNIZATION

INTEGRATION

ANALYTICS


Leadership for change


Let’s transform workforce differently


MAKING IT REAL


1. ORGANIZATIONAL CHANGES

2. PROCESSES/SOLUTIONS TRANSFORMATIONS

3. OPTIMIZING TOOLS LANDSCAPE

4. CHANGING SKILLS FABRIC

5. MAKING QA SMART


1. ORGANIZATIONAL CHANGES

Test Delivery

Large/Critical Projects & Programs

Delivery

Maintenance and Enhancements

Projects Delivery

Test Engineering

Shared Services –Delivery

Test Capability Centers

Community Of Practices – Strategy and Planning (Test

Architects)

Planning and Effectiveness

Demand and Intake Management

Financial Management

Service Performance Management

Processes & SQA

QA Head

Community of Practice - Test

Program Management

Vendor & Contract Management

Strategic Initiatives

Reporting and Change Management

Non Functional Testing

Performance Testing & Engineering

Security Testing

EI Outbound/Infra Upgrade Testing

INTRODUCED NEW

REDESIGNED


2. PROCESSES/SOLUTIONS TRANSFORMATION

DevQA Framework

BDD Component

Features(QA)

Steps Definition(Dev/QA)

API Collector

API Info(Dev)

Validator Report Generator Data Store

Expected data(QA)

Results

Quality Gate on Dev Machine & Pipeline

API layer Testing reduces UI Testing

Mandatory Maintenance of Test Code along with App

Code

Reduced Environment & Data Dependency


3. OPTIMIZING TOOLS LANDSCAPE

Requirements Architecture & Design Development Testing Release

Shi

ft L

eft Test Driven Development

Automation: 80 – 100%

Unit TestsAutomation: 80 – 100%

Behavior driven developmentAutomation: 50 – 70%

Service VirtualizationAutomation 40 – 60%

Non functional tests Automation: 80-100%

Performance TestsAutomation; 100%Regression test

Automation 60 – 80%

Test Management/Defect ManagementAutomation: 70 – 100%

Sprint Acceptance TestsAutomation 40 – 50%

Exploratory tests Automation: 30 – 40%

Functional TestsAutomation: 40 – 50%

Shift R

ight

UAT Automation40 – 60%

Continuous MonitoringAuto: 40 – 60%

Continuous Integration Auto: 80 – 100%

Continuous DeliveryAuto:10-60%

Environment virtualizationAuto: 40 – 60%

Tools enable solutions, have their limitations

Evaluate Resources

Measure Project Readiness Index

Apply Mitigation

Plan

Analyze for Execution Risks

Primary Application

Upstream/Downstream AppsInterfacesE2E Flow

Test ExecutionAgile/DevOps ExpertiseDefect Mgmt. Programming Experience

Insurance Products

Business Area

Negotiation

Facilitation

Leadership

Communication

Estimation On Time Delivery

PM Process Compliance

Project Readiness Index Framework

Test StrategyTest Creation

Automation

PlanningTeam Motivation

4. CHANGING SKILLS FABRIC PROJECT READINESS INDEX

Knowledge Index – 2015

Legend< 2>= 2 & < 4>= 4

2.7

3.3 3.5 3.2 3.5 2.8 2.9

2.8 2.6 2.5 3.1 2.5 2.9

2.2 2.6 2.2 1.9 2.1 2.1

3.1 3.0 3.1 3.4 2.2 2.9

2.0 1.2 2.6 1.0 2.6 2.4

2.9 2.5 2.3 3.5 1.7 2.6

Test Org. PRI

CCI

Surety

Claims

CPI

CSI

F&C

Domain Score[15%]

Application Score[30%]

QA Skills &Tools Score

[39%]

Soft Skills Score[9%]

Project Management Skills Score

[7%]

PROJECT READINESS INDEX4. CHANGING SKILLS FABRIC

Re-Baseline


Leveraging Robotic Process Automation

Natural Language Processing Based BOTS

BOTS with Deep Learning Capabilities

5. MAKING QA SMART

COGNITIVE ANALYTICS DRIVEN AUTOMATION

Predictive Analytics


WAY AHEAD



With more than 190,000 people, Capgemini is present in over 40 countries andcelebrates its 50th Anniversary year in 2017. A global leader in consulting, technologyand outsourcing services, the Group reported 2016 global revenues of EUR 12.5 billion.Together with its clients, Capgemini creates and delivers business, technology anddigital solutions that fit their needs, enabling them to achieve innovation andcompetitiveness. A deeply multicultural organization, Capgemini has developed its ownway of working, the Collaborative Business Experience™, and draws on Rightshore®, itsworldwide delivery model.

About Capgemini

Learn more about us at

www.capgemini.com

This message contains information that may be privileged or confidential and is the property of the Capgemini Group.Copyright © 2017 Capgemini. All rights reserved.

Rightshore® is a trademark belonging to Capgemini.

This message is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.

transform test organizations for the new world of devops

Software