case studies test factory
TRANSCRIPT
CASE STUDIESTEST FACTORY
Client:A leading German investment bank
Product / Service:Supporting the client using highly skilled test analysts and a team of test automation engineers
Industry:Banking
Goal:To implement a new Wealth Management system and integrate it with a new Data Mart collecting data from source systems, thereby meeting MiFID II requirements and supporting investment advisors in conducting customer portfolio analyses and the creation of tailored investment strategies
Challenges and problems
¹ Analysis and testing documentation not up to date
¹ No available testing consultants within or-ganization
¹ Limited engagement of business SMEs
¹ Testing integration and solutions provid-ed by two global vendors (part of Group project) – need for 3rd party validation of delivered solutions
¹ Aggressive testing schedule required an experienced test team
¹ Need for test automation in integration area – custom solution to be built in short period of time
01.
Tasks
¹ Analysis of 3rd party documentation related to new Data Mart and interfaces between source systems, Data Warehouse and ex-porting tables
¹ Preparation of test scenarios and test cases for data integration between source sys-tems, Data Warehouse and export tables
¹ Preparation of SQL scripts and queries for test execution within data integration area
¹ Design and delivery of test automation tool – validation of Wealth Management input files generated from Data Mart, validation of Wealth Management input files provided by Investment Funds, implementation of Selenium for Wealth Management front-end tests
¹ Preparation of test scenarios and test cases for Wealth Management front end
¹ Test execution in both data integration and functional area for Wealth Management
and required interfaces – scope of tests covers Smoke Tests, System Integration Tests and User Acceptance Tests
¹ Defect management and retesting of is-sued bugs
02.
Client:A leading German bank – merger with top 3 Polish universal banks
Product / Service:Supporting client in bank merger processes by highly skilled Test Factory team
Industry:Banking
Goal:To deliver a Test Factory team for all testing activities within bank mergers
Challenges and problems
¹ Aggressive project schedule (no shift option)
¹ Legal and operational merger on the same date
¹ Cooperation with several vendors engaged in core migration processes
¹ Limited availability of business SMEs
¹ Separate project teams working in several locations on remote terminals
¹ Testing environment issues
Tasks
¹ Definition of a Test Strategy
¹ Setup and implementation of a Test Man-agement Office (TMO)
¹ Test planning and test management
¹ Test preparation and execution of both data migration and Source Architecture Landscape (SAL) – functional and accep-tance tests
¹ Test preparation and execution of Data Reconciliation
¹ Regulatory project tests
¹ Cross-check tests (validation between data migration and SAL)
¹ Left to right tests
¹ Direct engagement in Dress Rehearsals in testing and data reconciliation activities
¹ Test reporting
03.
Client:One of the oldest private banks in the US
Product / Service:Test Factory project for one of the largest private banks in the US
Industry:Banking
Goal:To plan, prepare and execute User Acceptance Tests within the client’s delivery center located in Poland: to prepare and execute a wide range of projects (e.g. e-banking platform, core banking upgrade, regulatory projects and reporting, data migration projects, machine learning, RPA)
Challenges and problems
¹ Increasing number of projects to be tested in the same period of time
¹ Lack of sufficient skilled testing resources on the client’s side
¹ Combination of deep business knowledge and strong testing capabilities required at the testing team level
¹ Very short period of time planned for knowl-edge transfer and start of operational work for the external Test Factory team
¹ Wide international project experience re-quired for the Test Factory team
Tasks
¹ Delivery of a highly skilled test team com-prised of test managers, test analysts and senior testers (with extensive experience within the financial services industry)
¹ Test planning and test management
¹ Preparation of test cases
¹ Carrying out manual UAT tests (including test execution and test evidence mainte-nance)
¹ Reporting defects through JIRA
¹ Defect management, including assigning defects to analysts / external vendors
¹ Preparation and running automated test scripts for SIT testing (Java, Cucumber, In-telliJ IDEA, Stash (code repository))
¹ Analysis of test reports and giving feedback to the Business Owners
Client:A leading global card payments processor
Product / Service:Test automation
Industry:Financial
Goal:To design, develop and implement a new test automation tool supporting manual testers in preparing test data and executing tests using the client’s licensed systems
04.
Challenges and problems
¹ Outdated and separate test automation tools which required deep programming knowledge from testing team
¹ Limited flexibility of existing test automa-tion tools – long time required to imple-ment new changes
¹ Obsolete technology used for test auto-mation tool
¹ Rapid business development of client’s business (implementation of new products, new banks and merchants) which generated new business requirements
¹ Limited documentation on existing solution
¹ Business needed to run User Acceptance Tests on diverse and mass volume of test data
Tasks
¹ Delivery of a high-level design for a new test automation tool covering end-to-end payment authorization transactions for all connected banks
¹ Definition of a test automation framework based on Python
¹ Analysis and code review of existing test automation tools
¹ Delivery of a project schedule – 6 iterations within project scope
¹ Delivery of a test automation tool – 6 mod-ules related to detailed business process steps and linked with the client’s legacy systems
¹ Unit tests and integration tests of a new test automation tool
¹ Support for User Acceptance Tests
¹ Defect management and retesting detected bugs
Client:A top-5 Polish life insurance company – part of an international Dutch life insurance, pensions and asset management company
Product / Service:A Test Factory project for a life insurance company
Industry:Insurance
Goal:To plan, validate and execute System Integration Tests for a new sales application. To plan, prepare and execute performance and security tests
05.
Challenges and problems
Tasks
¹ Lack of sufficient skilled testing resources on client’s side
¹ Combination of deep business knowledge and strong testing capabilities required at testing team level
¹ Very short period of time planned for knowl-edge transfer and start of operational work for external Test Factory team
¹ Efficient cooperation with external vendor as a key success factor
¹ Aggressive schedule in line with Polish FSA expectations
¹ Security access problems
¹ Delivery of a highly skilled test team com-prised of test manager and senior testers (with extensive experience within the insur-ance industry)
¹ Test planning and test management
¹ Delivery and verification of test cases and test scenarios
¹ Carrying out functional tests (including test execution and test evidence maintenance)
¹ Carrying out Security Tests and Performance Tests
¹ Reporting defects through JIRA
¹ Defect management, including the assign-ment of defects to client / analysts / external vendors
¹ Analyzing test reports and giving feedback to the Business Owners
Client:One of the largest media and telecommunication companies in Poland – part of a Polish capital group
Product / Service:Delivery of a Test Factory team for a large transformation in the telco industry
Industry:Telecommunications
Goal:To deliver comprehensive CRM, Billing and Customer Service systems to a telco company
Challenges and problems
¹ Analysis and testing documentation not up to date
¹ Test phases started before final development delivery
¹ Limited engagement of business on client’s side
¹ Cooperation with leading international ven-dor and several supportive subcontractors
¹ Aggressive schedule for testing required an experienced test team
06.
Tasks
¹ Delivery of a qualified testing team
¹ Analysis of technical documentation, test scenarios and test cases provided by ex-ternal vendor
¹ Test planning and test management
¹ Delivery of test scenarios and test cases
¹ Testing environment issues
¹ Test execution and test reporting
¹ Test data preparation
¹ Defect management, including assignment of defects to analysts / external vendors and retests
Client:A leading French bank with an international reach
Product / Service:A highly skilled Test Factory team supporting the client in its bank merger processes
Industry:Banking
Goal:To deliver a Test Factory team for testing activities within a bank merger
Challenges and problems
¹ Responsibility for technological aspects – environmental preparation and accessibility
¹ Aggressive project schedule (no shift option)
¹ Test environment management in the full development cycle – DEV, INT, SYS, UAT and preprod environments (from several dozen to several hundred systems for each envi-ronment)
¹ Separate project teams working in several locations
07.
Tasks
¹ Environmental preparation and accessibility for the full development cycle
¹ Test process management, test team man-agement and defect control
¹ Managing test coordinators of individual domains and substantive support
¹ Creating SQL scripts and performing data migration tests
¹ Support for general migration tests (Dress Rehearsal)
¹ Verification of test progress and test re-porting
¹ Post-merger support
Client:The largest convenience store chain in Poland
Product / Service:A Test Factory project for an FMCG company
Industry:FMCG
Goal:To improve the current testing process, to create a Test Strategy document and implement it in the quality assurance department, and implement a test management supporting tool
Challenges and problems
¹ Lack of testing documentation on client’s side
¹ High frequency of changes in system func-tionalities
¹ No test cases prepared, only exploratory tests
¹ Lack of business requirements
¹ Poor quality defect management process
08.
Tasks
¹ Delivery of Test Strategy, Test Plans and Test Scope
¹ Test management and client support in functional analysis and business workshops
¹ Delivery of a highly skilled test team com-prised of test manager & test analysts with strong requirements analysis, test cases cre-ation and manual test execution experience
¹ Design, implement and configure a test management supporting tool for the defect management process
¹ Cyclical execution of new features and re-gression tests
Client:The largest convenience store chain in Poland
Product / Service:A Test Factory project for an FMCG company
Industry:FMCG
Goal:To develop solutions dedicated to test automation, i.a. sales system, inventory, acceptance of goods, return of goods, fiscal functions
Challenges and problems
¹ Lack of experience in test automation on the client’s side
¹ Unstable environment – a lot of changes in system functionalities during the project
¹ The client changed its requirements for the test tool during the development
¹ Performance problems with the tested sys-tem
¹ Various types of data to compare in the test tool
09.
Tasks
¹ Delivery of a highly skilled Test Team com-prised of a Test Manager & test automation analysts (with extensive experience in the field of automation of mobile, web and desktop applications)
¹ Project management of and support for client’s tests
¹ Delivery of a flexible test automation tool
¹ Development of highly detailed reports from the test tool operation
¹ Development of a solution ready to handle a large amount of test data
¹ Reporting work progress in the project
¹ Bug fixing
ONWELO SA, Karolkowa 30, 01-207 Warsaw. Registration court: THE DISTRICT COURT FOR THE CAPITAL CITY OF WARSAW IN WARSAW, THE 12TH COMMERCIAL DIVISION OF THE NATIONAL COURT REGISTER, NIP: 5272739561. The amount of share capital: 1 413 751,00 zł.
Ouroffices
WARSZAWA
ul. Karolkowa 3001-207 [email protected]
KRAKÓW
ul. Mogilska 4331-545 Krakó[email protected]
KIELCE
ul. Zagnańska 4925-528 [email protected]
KATOWICE
ul. Sokolska 6540-087 [email protected]
GDAŃSK
ul. Azymutalna 980-298 Gdań[email protected]
LUBLIN
ul. Nałęczowska 1420-701 [email protected]
NEW YORK
85 Broad StreetNY [email protected]
LEIPZIG
Petersstraße 5004109 [email protected]
LUCERNE
Hirschengraben 336003 [email protected]