cit overview presentation

7/31/2019 CIT Overview Presentation

1/34

CompuwareCorporation

Continuous Integrated TestingDelivering Reliable, High-Performing Applications

Irvin TanAutomated Software Quality


2/34

Page 2

CompuwarePowerful solutions for enterprise IT

IT

Operations

Application

Development

IT Management

IT

Operations

Application

Development

IT

Operations


3/34

Page 3

Development

XPEDITER/DevEnterprise

File-AID/CS

OptimalJ

OptimalView

DriverStudio

File-AID

QACenter

STROBE

XPEDITER

Abend-AID

DevPartnerStudio

Quality

Assurance

Abend-AID

Vantage

File-AID

STROBE

XPEDITER

Support

QACenterPerformance Edition

STROBE

Manage

TrackRecord

Reconcile

Compuware Solutions Support the ApplicationLife Cycle


4/34

CompuwareCorporation


5/34

Page 5

The IT Business Value CurveThe Typical Application Life Cycle

Development Production

Time

Benefit

Cost

Planned

Planned Outcome: Application is deployed on schedule

and within budget

Functionality meets businessexpectations and drives expectedbusiness value

Application is high quality, secureand optimized for performance


6/34

Page 6

The IT Business Value CurveITs Challenge: Delivering on the Expectations of the Business


Time

Benefit

Cost

Planned

Actual Outcome: Application is deployed behind

schedule and costs significantly more

than planned

Application fails to meet quality or

performance requirements

Ultimately, the business fails to realize

immediate or sustained value

Actual


7/34

Page 7

The IT Business Value CurveITs Challenge: Delivering on the Expectations of the Business


Time

Benefit

Cost

Planned

Actual Outcome:

Application is deployed behind

schedule and costs significantly more

than planned

Application fails to meet quality or

performance requirements

Ultimately, the business fails to realizeimmediate or sustained value

Actual

29% Succeeded

53% Challenged

18% Outright Failures

Application Delivery Success Rates

Source: Standish Group


8/34

Page 8

Application Delivery Management

A life cycle approach to quality assurance:

Builds quality into the application through clearalignment with the business needs and a focus ontesting in development

Implements an agile testing approach indevelopment that results in higher quality code

The Ideal Solution: Building Quality In to Ensure Consistent Delivery


9/34

Page 9

Quality Assurance

Defects are not found until late in the development life cycle or worse, inproduction

Code is sent back to development causing delays which reduces theavailable testing time

This cuts into new development time for further business innovation

IT Challenge: What Happens Today

Plan Develop Test Deploy

QA

End of Life Cycle Testing Approach


10/34

Page 10

Risk of failure in production is significantly increased due to insufficienttime to test.

Loss of Revenue to the Business

Cancellation of Project

Loss of faith in the ability of the project team and its management


QA

End of Life Cycle Testing Approach

Quality AssuranceIT Challenge: What Happens Today


11/34

Page 11

Quality Assurance

Errors found during testing

may be 15 to 75 times more

time consuming to fix than

those that are discovered and

fixed during the coding phase.

Software Engineering Economics,

Barry W. Boehm

There can be as many as 20

to 30 bugs per 1,000 lines of

software code.

Sustainable Computing Consortium

Problem: Finding and Fixing Bugs Late in the Life Cycle is Costly


12/34

Page 12

Quality AssuranceThere are More Cost Effective Ways to Solve These Problems

Formal design and code

inspections average about 65%

in defect removal efficiency.

Software Quality: Analysis andGuidelines for Success

Caper Jones

Peer reviews of software willcatch 60% of defects.

Institute of Electrical and Electronics

Engineers

Continuous integrated testing

improves defect removal rates in

development by 20% or more.

Compuware Corporation


13/34

Page 13

Continuous Integrated Testing

Is not a product but a methodology

Begin testing at the same

time as coding Application testing needs to

be started with development

Employ an integrated

development and testingapproach

Introduce quality with initialcoding

Increase number of test

cycles per project Test continually

Test whatever is availableeveryday


14/34

Page 14

Compuwares CIT Solution

Building quality in from dayone

An increased number of test

cycles provides more

opportunities to fix defects

Tests are fully automated and

can be run unattended,

offering minimal distraction to

developers

Defects are found shortly after

they are created

Root cause analysis reduces

the time spent on problem

diagnosis by QA and

development

Higher quality code is sent toQA

Repeatable, Consistent, Iterative Process to Improve Application Quality


Continuous Integrated Testing Integration

QA

Test Early, Test Often, Test with Confidence

Test Cases


15/34

Page 15

CIT Process


16/34

Page 16

Automated functionaltesting tool

Scripting languageVBA

Visual Basic likeeditor

SupportsClient/server, 4GL and

web application

TestExecution


17/34

Page 17

TestExecution User actions generateobject-based scripts

Record and replayfunction

Checks verify applicationfunctionalities

Events synchronization

Data-driven testing

GUI-less testing

Results log


18/34

Page 18

Comprehensive Developer Toolset

Microsoft & Java editions Integration with IDEs / App server

Automatic error detection

Memory analysis:

Memory Leaks Temporary Objects

RAM Footprint

Performance analysis

Coverage analysis Code review


19/34

Page 19

Visual Studio Integration


20/34

Page 20

Source Code Review

A teams 24x7

Mentor

Teacher

Enforcer

Automate themanual code

review process


21/34

Page 21

Memory Analysis at Runtime

Real-Timetrace ofmemory

usageSystemmemory

Your codememory

RAM usage

Over time


22/34

Page 22

Performance Analysis

Call graph detail withperformance data

Call graph overview

Useful data views,pre-filtered and sorted

Performance detailby line of code


23/34

Page 23

Quickly visualize change,positive or negative

Performance Comparisons

In-line highlights

show timing differences


24/34

Page 24

Code Coverage Analysis

Useful data views,pre-filtered and sorted

Visually assess overall

application coverage

Color-coded source code:What is or is not tested?


25/34

Page 25

Automatic Error Detection


26/34

Page 26

Java Edition

Memory Analysis:

Temporary Objects

Ram Footprint

Memory Leaks

Code Support


27/34

Page 27

Java Edition

Application performanceprofiler automaticallylocates Java performancebottlenecks

Increases Applicationusability


28/34

Page 28

Java Edition

Code coverage analysisautomatically locatesuntested code

Ensure test coverageduring unit and systemtesting

Produce reliablecomponents andapplications

Helps developers locate

runtime multi-threadingproblems


29/34

Page 29

Java Edition A set of over 200 rules in three

categories

correctness

performance

design

With severity (High, Medium,Low)

Ability to filter rules

Comprehensive explanation ofeach rule

View offending code

Generate reports


30/34

Page 30

Continuous Integrated Testing

3. Static code analysis identifiesand recommends codingimprovements

System Walkthrough

2. Run nightly build that includesexecution of the automated testscripts

1. Use the record option toautomatically generate testscripts

4. Potential memory and

performance improvementsare identified

5. Improvements can be madeand the results viewed thenext day

6. Provides simple way to validate

and improve testing coverage


31/34

Page 31

Capabilities and Benefits of CIT

Automates daily code inspections to uncover poor codingpractices and complexity metrics prior to new code beingwritten

Uncovers memory and performance issues to eliminatecatastrophic events down the road

Automates application code security inspections to detect

and remediate security vulnerabilities

Analyses for code coverage during unit testing to ensure thatall code has been thoroughly tested prior to moving to QA

Deliver Highly Reliable, High-Performing Applications


32/34

Page 32

CIT in ActionImproving Quality with Every Build

Plan

Test Deploy

QATest Cases

New codeis written

Unit testsare created

Automated build

runs and tests areexecuted

Run sessionfiles identify

coding, memory,security andperformance

issues

Problemsare corrected

New codeis written

Unit tests

are created

Automated buildruns and tests are

executed

Run session

files arecreated


New codeis written

Unit tests

are created

Automated buildruns and tests are

executed

Run session

files arecreated


Test Cases Test Cases Test Cases

Cycle 1 Cycle 2 Cycle N-1 Cycle N


33/34

Page 33

The IT Business Value CurveCIT: Building Applications with Excellence

Application DeliveryManagement

Application ServiceManagement

Time

Benefit

Cost

Planned

Actual

Short-term Results: Detect and remediate defects early in the

development cycle

Long-term Results:

Implement a process that allows you to

consistently deliver code that is high quality,

secure and optimized for performance

Stretch


34/34

cit overview presentation

Documents