validata performance tester product presentation
TRANSCRIPT
-
7/29/2019 Validata Performance Tester Product Presentation
1/17
Validata Performance TesterDeliver flexible, scalable performance testing across platforms
-
7/29/2019 Validata Performance Tester Product Presentation
2/17
Agenda
Validata Advanced Testing Suite
Validata Testing Approach
Validata Testing Methodology
Validata Performance Tester Overview
1
2
3
4
5
Benefits6
Business Challenges
Validata Performance Tester Case Study7
-
7/29/2019 Validata Performance Tester Product Presentation
3/17
Business Challenges
Testing the performance of web-based applications can easily miss the mark. Its easy
to design unrealistic scenarios. Easy to collect and measure irrelevantperformance
data. And, even if you manage to design sound scenarios and collect the right data,
its easy to use the wrong statistical methods to summarize and present the results.
Traditional performance testing approaches, involve performance testing teams very
late in the implementation lifecycle. Furthermore, applications are tested and tuned
at the latest stages of the project, whereas business needs are not successfully met
due to the constant environment changes.
Therefore deep, flexible and efficient testing coverage can not be achieved withtraditional testing tools.
-
7/29/2019 Validata Performance Tester Product Presentation
4/17
Validata Advanced Testing Suite (ATS)
Validata Advanced Testing Suite (ATS) provides a full end-to-end automatedtesting capability that adapts easily to changes in the application under test,ensuring higher quality and reduced costs and effort.
Validata ATS is a truly integrated and business process management solution.
Validata ATS is the first model driven testautomation tool for Functional, Technical andContinuous Regression Testing.
Validata focuses on the analytics (the context
and the content) thus providing root causeanalysis linking requirements and testing. Fullreporting is on-demand from the ExecutiveDashboard Module.
20%increase
in projectsuccess
50% fastertime toMarket
80%reductionin currentspend on
testing
80%reductionin curren
ttime to
test
38% increasein assets
re-use
30% increasein productivity
Project
Success
-
7/29/2019 Validata Performance Tester Product Presentation
5/17
Validata ATS Benefits
Efficient Testing
Reduced Testing time - Less time to develop, Shortened
application life cycle and Faster time to market
Reduced QA Cost - Upfront cost of automated testing is easily
recovered over the lifetime of the product. The cost of
performing automated testing is much lower, many times
faster and with fewer errors
Effective Testing
Greater Coverage -The productivity gains delivered by
automated testing enable more and complete testing.
Greater coverage reduces the risk of malfunctioning or
non-compliant software
Improved testing productivity - Test suites can be run
earlier and more often
Improve Process
Consistent test procedures - Ensuring process repeatability,
resource independence, eliminates manual errorsReplicating Testing - Across different platforms is easier using
automation
Results Reporting - Automated testing produces convenient
reporting and analysis with standardized measures allowing
more accurate interpretations
Better Use of resources
Using Testing Effectively -Testing is a repetitive activity.
Automation of testing processes allows machines to
complete the tedious, repetitive work while resources are
diverted to perform other tasks
Test team members can focus on quality
-
7/29/2019 Validata Performance Tester Product Presentation
6/17
Validata Testing Methodology
Testing Techniques:
Model Driven
Data Driven
Key Word Driven
-
7/29/2019 Validata Performance Tester Product Presentation
7/17
Validata Performance Testerfulfills the needs of organizations for performance testing of web-
based applications. It is fully integrated with Validata ATS, incorporates SWIFT,ARC IB andother
Internet Banking applications and is designed to deliver a faster and more cost-effective
approach to test the reliability and scalability of critical IT systems. The T24 specialized
adapters and thepre-builttest scenarios libraryaccelerates the performance testing element of
the project by 75%.
Objectives of Performance Testing:
Ensure that the system provides adequate response times (verify performance requirements)
Determine maximum number of concurrent users (current system capacity) Meet end-user expectations
Determine optimal hardware and application configuration
Identify performance bottlenecks
Verify the scalability of the system
Assess the impact of any hardware or software changes on site performance, new features, or
functions
Product Overview: Test Types
User Acceptance Testing (UAT)
System Integration Testing (SIT)
Interfaces Testing
Message Testing (MSG)
Functional Testing
Unit Testing
Performance Testing
Technical Testing
Continuous Regression Testing
Validata ATS has the ability to perform Parallel Testing on multiple environments using the
unique test engine adapter
Performance Tester
-
7/29/2019 Validata Performance Tester Product Presentation
8/17
Types of Performance Testing
Load Testing
Expected number of users with average user interaction times, over shortperiod of time, and load conditions that will occur in a live production
environment.
Focuses on:
Number of users accessing the server
Combination of business transactions that are executed
Impact on different environment components
Stress Testing
Worst-case scenarios for a short period of time
Focuses on: Locating the point at which server performance breaks down
Steadily increasing the number of simulated users until a breaking
point is reached
Identifies performance issues that might not otherwise be seen
Verifies that web site/application will perform as expected under
peak conditions
-
7/29/2019 Validata Performance Tester Product Presentation
9/17
Scope of the Performance Testing
On Line
Testing
Socket Based Transactions (Interfaces)
ATM & POS & Mobile Browser Based Transactions (http)
Module Executions
Mixed Executions
IB Application Transactions (http)
Module Executions
Mixed Executions
Batch
Offline
TestingBatch File Transactions
COB
Testing(Daily, Monthly,
Quarterly)
Report Generation and Interest Accruals
Account Statements
Noise Transaction Generation (T24 Browser)
-
7/29/2019 Validata Performance Tester Product Presentation
10/17
Requirements
AnalysisTest Planning Test Design Test Execution Reporting
Indentify the
required stake
holders, business
analysts,Infrastructure
managers
Organize and
gather the business
requirements
Convert the
business requirements
into performancerequirements and
metrics
Run workshops for
knowledge transfer
Collect the business
critical transactions
Determine the
required test volumes
Prepare entry and
exit criteria
Prepare the
schedules for testing
and testing estimations
Check infrastructure
availability
Identify the pre test
and post test
procedures
Determine the test
customization
requirements and
prerequisites
Isolate monitoring
requirements and metrics
to be collated
Create and Review thetest cases
Create and review the
workload scenarios
Execute Smoke Testing
Setup the required
environment monitors
Execute the test and
collate the results
Share the test results
with the Project Team
Schedule the nextexecution cycle after the
resolutions of the issues
Correlate Test results
from different test cycles
Prepare the test
summary document
Test Summary
presentation to the stake
holders
Sign Off
Validata Performance Tester Methodology
-
7/29/2019 Validata Performance Tester Product Presentation
11/17
Validata Performance Tester Features
Mix of criticaltransactions for
performance
testingCreate cycles per
transaction or group
of transactions
Clone of cycles formultiple executions
Execution of cycles with
Validata pre-built T24
adapters
Pre-built performancetest cases
-
7/29/2019 Validata Performance Tester Product Presentation
12/17
Validata Performance Tester Metrics
Transaction Based Metrics Server Based Metrics
Metrics to be Captured Comments
Throughput (per Sec) Transactions per sec
Response Times / Elapsed
Times
Time taken to process a
transaction
Types of Errors Totals for different types of
errors for a particular test
Count of Errors Total errors for a particular
test.
Transaction Count Total transactions processed
for the time period
Metrics to be Captured Comments
CPU Usage User%
System%
Idle%
Wait%
Logical CPUMemory Usage Used%
Used in GB
Memory available
Disk I/O Disk Read KB/sec
Disk Write KB/sec
IO/sec
Network Activity MB/sec
Packets/sec
Size of packets
Bandwidth used
-
7/29/2019 Validata Performance Tester Product Presentation
13/17
Hard Disk Usage
Validata Performance Tester Reporting
Transactions per Second & Requests per Second
Errors Count Available Memory
-
7/29/2019 Validata Performance Tester Product Presentation
14/17
Validata Performance Tester Case Study
Aggressive project plan Performance testing of a
consistently changing
environment
Need of a performance testing
where the test cases could
easily be updated to reflect
the new environment.
Challenges
Developed a performance
testing strategy and planincluding all aspects of
environment testing
Designated their resources
and collaborate with those of
the bank and Temenos, to
manage the process,
development and execution ofthe tests
Deployed Validata
Performance Tester solution
to produce all management
reporting for project progress
and defect management
Delivered the full solution on
a fixed fee basis
Solution Outline
Easily manage from start to
finish all performance testingprocesses.
Identify design issues and
performance bottlenecks and
overcome them.
Effectively concentrate their
resources, by exploiting the
product and resourcesencompassed by Validata.
Efficiently manage monthly
costs for testing
Enjoy a cost efficient solution
that incorporated both
resource and product
Benefits Realized
With a network of over 40 branches and many Internet Banking customers, Mauritius Commercial
Bank(MCB) required a robust environment to continue to provide to their customers the level of
service enjoyed prior to the implementation of Temenos T24. As such they identified a need for aperformance testing tool to assist them with validation of the configuration of the environment.
-
7/29/2019 Validata Performance Tester Product Presentation
15/17
Distributions and Scalability Executions
Validata Performance Tester Case Study
Scalability from 50 to 2500 Virtual Users
1 Hour Continuation of Executions
Executions per Modules
Transaction Mixed Executions
-
7/29/2019 Validata Performance Tester Product Presentation
16/17
Achieve full test coverage
Decrease total time of performance testing up to 60-70%
Maximum reusability on the tests assets with minimum effort to
maintain them
Script less creation of scenarios, achieving 100% automation
Truly de-skilled reducing the turn around time by 50%
Less time to prepare, faster time to market by 50%
On the Cloud: Remote access & Multiple site support
The Critical Differences
-
7/29/2019 Validata Performance Tester Product Presentation
17/17
We would be happy to help.
Do You HaveAny Questions?