amadeus traffic replay framework · amadeus traffic replay framework presented by loic paquette...
TRANSCRIPT
![Page 1: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/1.jpg)
Sophia Antipolis, French Riviera20-22 October 2015
AMADEUS TRAFFIC REPLAY FRAMEWORKPresented by Loic Paquette (Amadeus)
© All rights reserved
![Page 2: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/2.jpg)
Agenda
2
• Presentation• Test Selection• Test Generation• Test Investigation• Lesson Learnt
©All rights reserved
![Page 3: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/3.jpg)
Presentation ‐ Concept
3 © All rights reserved
Web ServerRelease
N
ReleaseN
N+1N+2…
Server Under Test
![Page 4: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/4.jpg)
Presentation ‐ Concept
4 © All rights reserved
Web ServerRelease
N
ReleaseN
N+1N+2…
Server Under Test
![Page 5: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/5.jpg)
Presentation – Usage
E‐commerce products (WebApp)
3 Major Amadeus Products
2 Protocols supported (HTTP / SOAP)
~3000 Tests / mth~250 Different sites&config / mth
5 © All rights reserved
![Page 6: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/6.jpg)
Presentation – Tool overview
6 © All rights reserved
Logs Container
Test Generation Module
Test Execution Module
Test Selection Module
Traffic Replay Tool
![Page 7: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/7.jpg)
Test Selection
7 © All rights reserved
Fine selection using Basket:• Number of script• Customer • Page Reached
Raw SelectionCustomer & Flow Repartition
• Prod Alike• Equivalent• None
![Page 8: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/8.jpg)
Test Generation
8 © All rights reserved
Apply template to header corresponding to the product to be
validated
Select the group of regular expression to be applied to validate
server response
Select the parameter which have to be update at runtime
![Page 9: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/9.jpg)
Test Validation
Validators: • Parsing each server response looking for a pre‐defined RegEx• Call another tool to validate RegEx in another system (post execution)
Server Response rebuilt as html file
9 © All rights reserved
![Page 10: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/10.jpg)
Test Validation
10 © All rights reserved
• Debug Mode
![Page 11: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/11.jpg)
Test Validation
• Execution comparison:• Execute tests in 2 different environments (Reference and platform under validation)
• Compare the result to remove False Negative result
11 © All rights reserved
![Page 12: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/12.jpg)
Lesson Learnt
12 © All rights reserved
Pro To improve / Limitation
Efficient to find Regression Data preparation take a lot of time Scenario selection still high level
Scalable QA campaign Required synchro with Dev for specific parameters and put in place the SWAP.
Quick to generate and validate Validation of server response only (no UI validation)
Usable at all QA phases Not possible to action done on client side (ie. Js call..)
• Possible Evolution:• Big data/Hadoop to handle communication with server logs.• Virtualization system to improve test stability (Avoid external system dependency).• Create Selenium test from server logs• Extend it for performance validation purpose
![Page 13: AMADEUS TRAFFIC REPLAY FRAMEWORK · AMADEUS TRAFFIC REPLAY FRAMEWORK Presented by Loic Paquette (Amadeus) ... Efficient to find Regression Data preparation take a lot of time](https://reader036.vdocuments.net/reader036/viewer/2022062306/5fb6fe9df34e0a3f97144f6e/html5/thumbnails/13.jpg)
13 © All rights reserved