Making Software Testing Work
Making Software Testing WorkMaking Software Testing WorkQuality Assurance &
Software Testing Methodology
Presentation to JPMorganChase
Making Software Testing Work
ContentsContents
What is ATS What is PLP Methodology Our Differentiators Accomplishments Benefits Why Amtex Recap
What is ATS What is PLP Methodology Our Differentiators Accomplishments Benefits Why Amtex Recap
Making Software Testing Work
System Integration Testing
Application Integration Testing
Engineering Testing or Quality Control Phase
Business Testing or Quality Assurance Phase
Testing OverviewTesting Overview
Making Software Testing Work
ATSATS We work with & act as Business Users, while bringing a structured
approach to testing. Our testing practice includes: Test Strategy Definition, Test Plan
Creation, Test Case Writing, Test Execution and Certification that requirements have been met.
With our proven onsite/offshore delivery model, Software Testing is a cost-effective approach to reducing ROI for clients.
We work with & act as Business Users, while bringing a structured approach to testing.
Our testing practice includes: Test Strategy Definition, Test Plan Creation, Test Case Writing, Test Execution and Certification that requirements have been met.
With our proven onsite/offshore delivery model, Software Testing is a cost-effective approach to reducing ROI for clients.
Making Software Testing Work
ATSATSTesting Scope
Business Testing under ATS is focused on two major issues though very often both are confused with same objective
System Integration Testing System Integration Testing is focused on the technical
infrastructure e.g. messaging, data flow, interfaces, and tools that are critical for application’s and systems to work. Less stress on application functionality unless necessary.
Application Integration Testing Also referred as Functional Integration Testing (FIT) Focused on application flow and functionality. Typically
tested through a set of test plan / scenario each depicting a business process flow. Each plan / scenario may consist of several steps called test cases.
Business Testing under ATS is focused on two major issues though very often both are confused with same objective
System Integration Testing System Integration Testing is focused on the technical
infrastructure e.g. messaging, data flow, interfaces, and tools that are critical for application’s and systems to work. Less stress on application functionality unless necessary.
Application Integration Testing Also referred as Functional Integration Testing (FIT) Focused on application flow and functionality. Typically
tested through a set of test plan / scenario each depicting a business process flow. Each plan / scenario may consist of several steps called test cases.
Making Software Testing Work
System Integration TestingSystem Integration Testing System Integration Testing is focused on the technical infrastructure like
messaging, data flow, interfaces, and tools that are critical for application to work. Less stress on application functionality unless necessary.
For smaller applications or where such points of testing are small in number or non-critical, then SIT can be merged with AIT for effective test resource utilization.
The test strategizing involves identifying points of testing: Not every data flow is meant to be tested as application flow will
test the data flow. The stress on data flow is through utilities and tools like an extractor, uploads from spreadsheet data, etc.
Similarly in messaging, testing is done on whether formats are right, complete and message flows across modules / systems
If there are tools used, then test the tools from their utility to application.
In short, we need to identify points of testing without getting caught up with the entire application. We call this methodology ‘Dot-The-Map’.
System Integration Testing is focused on the technical infrastructure like messaging, data flow, interfaces, and tools that are critical for application to work. Less stress on application functionality unless necessary.
For smaller applications or where such points of testing are small in number or non-critical, then SIT can be merged with AIT for effective test resource utilization.
The test strategizing involves identifying points of testing: Not every data flow is meant to be tested as application flow will
test the data flow. The stress on data flow is through utilities and tools like an extractor, uploads from spreadsheet data, etc.
Similarly in messaging, testing is done on whether formats are right, complete and message flows across modules / systems
If there are tools used, then test the tools from their utility to application.
In short, we need to identify points of testing without getting caught up with the entire application. We call this methodology ‘Dot-The-Map’.
Making Software Testing Work
Dot-The-Map methodology is developed uniquely by Amtex for System Integration Testing.
Focus is emphasized on isolating the points of testing (‘Dots’) that are critical for testing.
A crucial criteria is whether such dots see the application as black box and vice versa – or else the testing must be combined with AIT
Examples, In applications that use MQ series messaging, testing message
structure, flow, message servers. In applications that use SWIFT messages (MT 101, MT103…),
testing message formats, completeness and flow rather what application does with the messages when they come right.
Testing tools – e.g., a converter that converts EBCIDIC files to ASCII
Dot-The-Map methodology is developed uniquely by Amtex for System Integration Testing.
Focus is emphasized on isolating the points of testing (‘Dots’) that are critical for testing.
A crucial criteria is whether such dots see the application as black box and vice versa – or else the testing must be combined with AIT
Examples, In applications that use MQ series messaging, testing message
structure, flow, message servers. In applications that use SWIFT messages (MT 101, MT103…),
testing message formats, completeness and flow rather what application does with the messages when they come right.
Testing tools – e.g., a converter that converts EBCIDIC files to ASCII
Dot-The-Map MethodologyDot-The-Map Methodology
‘Dot-The-Map’ Methodology – Pick the critical points that tie the application together.
Making Software Testing Work
MethodologyMethodology Check & Dig - The test plans and cases are written from a simple link
(task) flow. For each link there are many combinations of flows. From domain knowledge, choose flows for testing that are different. If defect is found, choose more permutations & combinations. A selective and pragmatic approach to find errors and explore error zones.
Each stage of testing - FIT, UAT, OAT - focuses on a select objective. Automated Testing tools like Win Runner, Load Runner and Test
Director are used when the application is ready for a multiple roll out.
Check & Dig - The test plans and cases are written from a simple link (task) flow. For each link there are many combinations of flows. From domain knowledge, choose flows for testing that are different. If defect is found, choose more permutations & combinations. A selective and pragmatic approach to find errors and explore error zones.
Each stage of testing - FIT, UAT, OAT - focuses on a select objective. Automated Testing tools like Win Runner, Load Runner and Test
Director are used when the application is ready for a multiple roll out.
Task 3Task 2Task 1
Business Process Flow
All possible flows are
identical in logic - Test one flow.
2 different logic in flows -
Check both.
Making Software Testing Work
Key DifferentiatorsKey Differentiators
Testing Methodology basics haven't changed, but applications have grown in size and technology
complexity. ATS brings in unique ‘PLP’ and ‘Dot-The-Map’ methodologies for effective use of testing efforts.
Amtex compliments technical depth with excellent domain knowledge by using Business Analysts to
provide ‘what is the right application’ perspective to testing.
Automation testing is viable and cost effective and we have technical resource pool with automation
experience on banking applications.
We act like certifier than consultant. We don’t merely execute testing services - We assure
‘fit for use’.
Amtex has a matured process and methodology to offshore significant workload & bring down costs.
Right Methodology is a critical success factor for for effective use
of efforts.
For Business applications domain
expertise of team is a necessity.
Automation is inevitable in most banking applications with multiple releases
[Mercury / Rational / Compuware]
Testing Business Applications is both about ‘Is application RIGHT for use?’ and ‘Is application working?’
We have effectively done test
planning/scripting and execution offshore
Making Software Testing Work
Engagement ModelsEngagement Models
B uilding Q uality begins here w hereunambiguous and c omplete
doc umentation is v ita l for right exec ution
R ev iew B R ,F S , D D
G ap analys is&
T rac eability M atrix
T ypic ally done by the development teamto c onfirm they have done a right c oding.S IT ens ure mes s aging c onformanc e and
data flow ac ros s units
U nit, module andS IT
B as e L evelQ uality C hec ksto move forward
E nd-to-end func tional integration tes tingto ens ure proc es s flow as env is aged in the
applic ation s oftware requirementF IT
F irs tC omprehens ive
end-to-end tes ting
B us ines s us ers (end-us ers ) mus t have afeel of the s oftware and s ure of its ability
to deliver their expec tationsU A T
B uildingbus ines s -us er
C onfidenc e
A ll T ec hnology and other as s umptionsmade during the entire c yc le mus t be
verified before the applic ation is onlineO A T
T rus t, B utV erify beforeG oing online
PLP Methodology
Engineering Testing
and
Quality Control Phase
Business Testing
and
Quality Assurance Phase
A complete 3rd party testing of all
phases post development
ensures excellent cost savings as
successive phases can leverage on
knowledge gained on application
Engagement in a any specific
phase still gives the best of
SakAssure - With Domain
knowledge in FIT or Technical depth in OAT
Making Software Testing Work
BenefitsBenefits We combine the requisite domain knowledge & technical skills
to make business testing a success
We compliment your team of business users and bring in structured & detailed testing process knowledge
Our ‘PLP’ methodology is efforts-effective
We bring down costs with proven offshore model
We have the necessary background and excellent credentials
We combine the requisite domain knowledge & technical skills to make business testing a success
We compliment your team of business users and bring in structured & detailed testing process knowledge
Our ‘PLP’ methodology is efforts-effective
We bring down costs with proven offshore model
We have the necessary background and excellent credentials
Making Software Testing Work
Deep domain skills Business Consulting Group Wide range of solutions spanning all segments of banking and retail
lending Experienced software services company
Full service provider of IT Outsourced solutions – Custom Application Development– Application Testing – Staff Augmentation
Extensive project management and technical capabilities Flexible, dependable, scalable and cost effective
Committed to provide the highest quality ISO9001:2006 certified Quality Management System
Deep domain skills Business Consulting Group Wide range of solutions spanning all segments of banking and retail
lending Experienced software services company
Full service provider of IT Outsourced solutions – Custom Application Development– Application Testing – Staff Augmentation
Extensive project management and technical capabilities Flexible, dependable, scalable and cost effective
Committed to provide the highest quality ISO9001:2006 certified Quality Management System
Why AmtexWhy AmtexFocused Resource
Making Software Testing Work
Why AmtexWhy AmtexTrusted Partners
Information BuildersTesting Methodology and AutomationFunctional Testing & Test ManagementFull testing Lifecycle
myCove.comSDLC DevelopmentTesting Best Practices
CITIGROUPComplete Testing Outsource for all Global Application Deployment
HARRISONS GROUPLegacy Systems Conversion and Automation
Making Software Testing Work
Technology Labs Test Lab: Tools expertise on Mercury (Win Runner, Quick Test Pro, Load Runner, Test
Director, Astra Load, Web Load), Rational and Compuware BI Lab: Data Warehousing & Business Intelligence products and tools expertise including
Informatica, Oracle Warehouse Builder, SQL Server DTS, Business Objects, Hyperion, Cognos, MicroStrategy, SAS
Base Technology Practice Java Practice: J2EE, JSP, EJBs, Servlets, JDBC, etc. Microsoft Practice: .NET, VB, VC++, COM/DCOM, IIS, MTS, ASP, etc. Mainframe Practice: MVS, CICS, Cobol, VSAM, DB2, CoolGen, MQ Messaging Other Skills: Cold Fusion, Power Builder, BPwin, etc.
Extended Technology Groups Database Group: Oracle (including OLAP Services), MS SQL Server (including Analysis
Services), Sybase, DB2, MySQL OS Group: Windows 2000, Unix flavors like Solaris, AIX, Linux, Mainframes & Macintosh Middleware Group: Web Sphere, Jrun, JBOSS, Oracle 9i Application Server, Web Logic,
Pramati, Apache Data Modeling Tools: ERwin, Oracle Designer, Rational
Technology Labs Test Lab: Tools expertise on Mercury (Win Runner, Quick Test Pro, Load Runner, Test
Director, Astra Load, Web Load), Rational and Compuware BI Lab: Data Warehousing & Business Intelligence products and tools expertise including
Informatica, Oracle Warehouse Builder, SQL Server DTS, Business Objects, Hyperion, Cognos, MicroStrategy, SAS
Base Technology Practice Java Practice: J2EE, JSP, EJBs, Servlets, JDBC, etc. Microsoft Practice: .NET, VB, VC++, COM/DCOM, IIS, MTS, ASP, etc. Mainframe Practice: MVS, CICS, Cobol, VSAM, DB2, CoolGen, MQ Messaging Other Skills: Cold Fusion, Power Builder, BPwin, etc.
Extended Technology Groups Database Group: Oracle (including OLAP Services), MS SQL Server (including Analysis
Services), Sybase, DB2, MySQL OS Group: Windows 2000, Unix flavors like Solaris, AIX, Linux, Mainframes & Macintosh Middleware Group: Web Sphere, Jrun, JBOSS, Oracle 9i Application Server, Web Logic,
Pramati, Apache Data Modeling Tools: ERwin, Oracle Designer, Rational
Why AmtexWhy AmtexTechnology Breadth
Making Software Testing Work
RecapRecapAmtex Systems Has:
• Domain knowledge• Technical skills• Credentials• Methodology • Cost Advantage
“To make Business Application and System Testing a Total Success.”
Glossary of Terms & Acronyms:PLP Process Link ProbeAIT Application Integration TestingATS Amtex Testing Service FIT Functional Integration TestingOAT Operations Acceptance TestSIT System Integration TestingUAT User Acceptance TestingROI Return On InvestmentBR Business RequirementFS Functional SpecificationDD Design Document