How to Automate Testing for your PeopleSoft Applications

John L. Montgomery Test Tools & Automation Services, PeopleSoft

Shawn Smith Senior Systems Engineer, Mercury Interactive

Session Number 7015

Why Automate?

Page 2

Reduce test cycle time

Repeatability of testing

Parallel client OS testing

Parallel browser testing

Regression testing for upgrades/patches

Eliminate boring work

Increase return on investment

Better coverage

Internationalization & localization testing

Page 3

Automation’s Impact at PeopleSoft

Full regression test , 30 person days, completed for CRM8.4 in 8 hours

Return on investment of 15,000 resource hours for Financials 8.4

100% of automation updated prior to QA receiving a new build

95% of showstoppers found prior to QA receiving a new build

Proposed Automation Process

Page 4

Pre-BuildDBAs Populate

test floor

SQL/NT SQL/NT

Development Test Repot

Test Floor Test Repot

DB2/OS390

Oracle/Sol

Other

Test Floor DatabasesAutomation Database

~~

Within 24 hrs

Within12 hrs

The Keys to PeopleSoft’s Testing Automation Success

Page 5

Appropriate combination of testing tools, skilled resources, and process to deliver higher quality applications and reduce time to production

Automation best practices Dedicated automation teams Centralized test management Automation centric methodology

Tips maintenance and recording

How to Automate Testing for your PeopleSoft Applications

John L. Montgomery Test Tools & Automation Services, PeopleSoft

Shawn Smith Senior Systems Engineer, Mercury Interactive

Session Number 7015

Page 7

What is a Dedicated Automation Team?

Dedicated automation team Develops and executes automated scripts Has separate objectives from Dev and QA Owns automation, but not bugs Minimum of 1 automator to 3 QA engineers Never re-purposed for QA

Benefits of a dedicated automation team Increased automation coverage Specialization of labor In house support for tools Maintainable scripting Customization of tools

What is Centralized Test Management?

Page 8

The “QA Workbench” Manage creation & storage of test requirements,

test cases, test scripts, & execution results Executes manual & automated scripts Associate defects & results to requirements Integrates with internal automation tools

Benefits of centralized test management Common view for Dev and QA Central point of access for management Source control integration Common metrics for release health & planning Manage geographically distributed teams

Page 9

Mercury TestDirector Requirements Mgmt Test Mgmt Execution Mgmt

PSScript Enterprise PeopleSoft Application Testing

Mercury WinRunner-QuickTest Pro PeopleTools Automation PeopleSoft Application Testing 3rd Party Automation

Application Under Test

Source Control

Centralized Test Management - PeopleSoft’s Model

DefectTracking

Metrics Process

Page 10

Auto Team

Test Requirements

Test Management Test ResultsTest Execution

Tes

t D

irec

tor

QA Team QA Manager

DevelopmentM

anua

l Cas

es

Req

uire

men

ts

Man

ual C

ases

Aut

omat

ed C

ases

Application UnderTest

•Creates Test Requirement•Creates Manual Test Cases•All Reside in TestDirector

•Use PSScript Enterprise•Use Automation Tools•All Reside in TestDirector

QA Team

Run

Rep

ort

Exe

cute

s T

ests

•Executes Manual Cases•Executes Automated Cases•All Run Through TestDirector

Run

s T

ests

Ret

urns

Log

Tes

t Res

ults

•Track Manual Testing•Track Automated Testing•All Results in Same Report

•View Test Results Real-time

DevelopmentQA Manager

•Review Requirements•Validate Test Coverage

QA Manager

•Track Test Creation•Track Automation Creation

Man

agem

ent

Tes

t P

roce

ssCentralized Test Management - TestDirector

Page 11

Metrics Collection and Reporting - PeopleSoft’s Model

PeopleTools DB for Metrics

HCM

Fin

SCM

LS

CRM

EPM

Crystal Reports Metrics

Test Execution Test Coverage Automation

PTools

Report GenerationData StorageAutomation Tracking

What is an Automation Centric Methodology?

Automation centric methodology Pre-build regression/acceptance test process Pre-build maintenance process Post release test process Process for automating bug replication

Benefits of automation centric methodology Showstoppers found in pre-build Automation remains up to date Automation runs consistently Post release testing in less than 1 day Regression bed grows

Page 12

Page 13

Lessons Learned - Keys to Success

Centralized automation support organization

Auto team does not QA

QA team creates cases and tracks bugs

Automation used during all phases

Test cases written for automation

Automation team executes automation

Return on investment must be tracked

Automation perceived as critical by upper management

Page 14

The Tangibles

Best Practice - Managing Script Maintenance

Automation team’s responsibility

Create common functions

Record using stable properties

Data-driven testing

Maintain scripts against pre-build

Identify UI changes first

Develop Customizations to address application specific issues

Script modularization methodology

Page 15

Page 16

Tips and Tricks

Set config.properties file Testing=True

Get patch to support field validation event trigger upon field exit

Check VBS limitations in the VBScript Programmer’s Reference Appendix B

Take advantage of regular expressions in checkpoints

Page 16

Best Practices for Testing PeopleSoft Applications

Q&A

Page 18

Support Slides

Page 19

Analysis & Design

Gather Requirements

Analysis & Design

Implementation

System Platfor

mPost GA

Performance Test

Pre-System

Development of unit test cases Requirements Approvals Creation Source control

Tracking unit test development metrics

Page 20

Implementation

Gather Requirements

Analysis & Design

Implementation

System Platfor

mPost GA

Performance Test

Pre-System

Unit test execution & automation

Acceptance & system test development

Automation of acceptance tests

Performance test requirements

Regression test execution

Tracking of creation & execution metrics

Page 21

Pre-System Test and Performance Test

Gather Requirements

Analysis & Design

Implementation

System Platfor

mPost GA

Performance Test

Pre-System

Execution of acceptance tests

Automation of system tests

Automation of performance tests

Tracking of execution metrics

Page 22

System & Platform Test and Performance Test

Gather Requirements

Analysis & Design

Implementation

System Platfor

mPost GA

Performance Test

Pre-System

Execution of system tests

Execution of performance tests

Tracking of defects

Tracking of execution & coverage metrics

Page 23

Post GA

Gather Requirements

Analysis & Design

Implementation

System Platfor

mPost GA

Performance Test

Pre-System

Certification of new OS & platform combo’s

Regression test patches & upgrades

Regression test customizations

Localization & internationalization testing

Tracking ROI & execution metrics

Tracking of defects

Page 24

Navigation Utility

Build utility to query PSPRSMDEFN to build portal navigation lookup spreadsheet

Build function to: Find correct entry in spreadsheet, based on

Component name and user role Click through links of portal menu path

Re-run utility to build spreadsheet for each new build

Page 25

Navigation Utility

PeopleTools Database

URLNavigation PathComponentRole

Navigation Path Spreadsheet

Navigation Extraction Utility

Automation Scripts

Navigation information retrieved from spreadsheet