![Page 1: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/1.jpg)
Modernize Your Test Automation For Modern Application Delivery PARASOFT webinar: Why Testers Can't Test: Solving the Test Environment Dilemma.
May 21, 2015 Diego Lo Giudice, Vice President, Principal Analyst @dlogiudice
For: PARASOFT
![Page 2: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/2.jpg)
Businesses must continuously exploit digital technologies to both create new sources of value for customers and increase operational agility in service
of customers.
![Page 3: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/3.jpg)
Rolls Royce and GE Aviation lease hours of propulsion.
![Page 4: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/4.jpg)
“It’s Great So-ware Applica4ons That Drive Digital Businesses Success…. ….And Every Enterprise Needs To Excel At Delivering Them !”
Test Obsessed!
![Page 5: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/5.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 5
Tes<ng has never been a good companion of Speed…
![Page 6: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/6.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 6
Modern Applica;ons Are All About Delivery Speed, But At Different Levels…
Social media and search
Systems of engagement (SOE) Systems of record
(SOR)
Traditional
3rd party Cloud-based services
• Mobile, web, and smart devices • Frequent changes • Delight clients • Mobile and Web apps
• Stable requirements • Highly transac;onal • Less change • ERPs (SAP, ORACLE, JDEDWARS, etc)
Private Cloud
Months Weeks
Weeks, Days, Minutes, Seconds
Months, Weeks Days
![Page 7: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/7.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 7
Tes4ng must improve Quality@speed
Old-School thinking compromises between speed and quality
![Page 8: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/8.jpg)
Introducing quality@speed: fast frequent pit stops and con<nuous tes<ng…
![Page 9: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/9.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 9
Modern Automa<on Is 2 of the 5 Must Do’s For tes<ng quality@speed !
![Page 10: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/10.jpg)
From manual GUI testing
Automated Functional Testing (API/Non GUI Testing)
Target state
Automated GUI tests
Increase Test Automa<on and Focus it on API / Non GUI tes<ng automa<on
Manual testing
% Automation vs % Manual
Current state
10 – 20 %
60 – 80 %
Automated Testing
To manual exploratory testing 5 – 20 %
5 – 10 %
60 – 80 %
Automated API/ non GUI tests
% Automation vs % Manual
Source: Wolgang Platz – Tricen4s -‐ modified by Forrester
![Page 11: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/11.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 11
Test beyond GUI to verify and validate business and technical services
API Layer UI Layer
Backend / resource Layer (Apps, services, etc)
![Page 12: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/12.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 12
Continuous delivery Pipeline
Development Build Test environment Stage environment
Production environment
Integra<ng Tes<ng Tightly And Efficiently In Your Con<nuous SoTware Delivery Process
› Source: Forrester adapta4on of SVT for dummies
Deploy
Automated Gate checks
Automated Process Tes4ng
Automated Func4onal Tes4ng
Automated Unit Tes4ng
Release automa4on
Release candidates
Retro-‐vert
Continuous Integration / Continuous Delivery
Retro-‐vert
Automated Performance Tes4ng
![Page 13: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/13.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 13
Use Service Virtualiza;on To Deal With Teams Different Speed Levels…
Social media and search Traditional Private Cloud
Months Weeks
Weeks, Days, Minutes, Seconds
Months, Weeks Days
Tes4ng Of Simulated and Virtualized Services (Func4onal, Performance Load, Integra4on, Data)
Design Assets (WSDL, XML, ….)
Custom Developed
(Java, JavaScript, C#, etc
Run;me Non Accessible Services
(Messaging, Swi-, Tibco, etc)
Paid Third Party Services (Cloud,
Mainframe, etc)
APIs ( Mainframe, Middleware, Applica4on Services)
![Page 14: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/14.jpg)
© 2015 Forrester Research, Inc. Reproduction Prohibited 14
Conclusions
1. Digital is disrup4ng and transforming *ANY* business, and “so-ware tes4ng” with it !
2. To increase levels of automa4on you need to focus on beyond the GUI or do more API Tes4ng
3. Introduce Service Virtualiza4on to test your so-ware in a wind tunnel
![Page 16: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/16.jpg)
Alaska Airlines Plug
Flight Operations Manager Challenges + Solutions Ryan Papineau – Automated Test Engineer 2015-‐05-‐21
![Page 17: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/17.jpg)
![Page 18: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/18.jpg)
Flight Opera4ons Manager
Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
System under test
Complex cross system dependencies make tes4ng very difficult
![Page 19: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/19.jpg)
• Environment • Shared • Continual changes
• Data • Integrated, but not coordinated. • Does not exist • Inconsistent
• Services • Not available • Inconsistent
• Events • Do not exist • Lack of resources to make them happen
Challenges – “Why testers can’t test.”
![Page 20: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/20.jpg)
Flight Opera4ons Manager
Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
Isolate System Under Test
Virtualize Data Feeds – stabilizing tes4ng
![Page 21: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/21.jpg)
AirportWebService
CargoWebService
BaggageWebService
PassengerWebService
Planeside Device
Service Virtualization
![Page 22: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/22.jpg)
Events - Message Exchange Patterns Synchronous (Request/Response) Asynchronous (Event Driven)
GetCargo
GetBaggage
GetPassenger
Depart
Take Off
Land
Arrive
Book Ticket
Check In
GetFuel
Board Flight
![Page 23: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/23.jpg)
![Page 24: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/24.jpg)
Final Solution Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
Cargo WebserviceBacked by Test Data Management (TDM)
Baggage WebserviceBacked by (TDM)
Passenger Webservice Virtualized
AircraftCommunication
Virtualized
Crew WebserviceBacked by (TDM)
Flight Movement Triggered byAutomatedTest Client
Aircraft Maintenance Webservice
Backed by (TDM)
Load PlanBacked by (TDM)
![Page 25: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/25.jpg)
Event Modeling
X =
![Page 26: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/26.jpg)
Data Modeling
![Page 27: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/27.jpg)
Final Solution Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
Cargo WebserviceBacked by Test Data Management (TDM)
Baggage WebserviceBacked by (TDM)
AircraftCommunication
Virtualized
Crew WebserviceBacked by (TDM)
Aircraft Maintenance Webservice
Backed by (TDM)
Load PlanBacked by (TDM)
![Page 28: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/28.jpg)
Challenges + Solutions
Problem Solution Tool Environmental Impacts Isolated Environment + System VMWare Data Alignment Test Data Management (TDM) Custom SQL Inconsistent Web Services Service Virtualization (SV) Parasoft Virtualize Lack of Events Automated Test Clients Parasoft SOAtest
![Page 29: Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation For Modern Application Delivery PARASOFT!webinar:!Why!Testers!Can't!Test:!Solving!the!Test!Environment!Dilemma](https://reader031.vdocuments.net/reader031/viewer/2022022605/5b78f16c7f8b9a534c8c3612/html5/thumbnails/29.jpg)
Q + A