test automation @ bol€¦ · agile in test automation . 2015 - the evolution continues. takeaways...
TRANSCRIPT
![Page 1: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/1.jpg)
Test automation @ bol.comA Prerequisite in a Fast Growing Development Organization
Joost van Wollingen & Elise van Krevelen
![Page 2: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/2.jpg)
Agenda
• What was the problem?
• How did we fix it?
• What did it bring us?
![Page 3: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/3.jpg)
Joost van Wollingen & Elise van Krevelen
• Test Engineer
• Back office applications
• Test Engineer & information analyst
• Front –end applications
@jpjwolli
![Page 4: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/4.jpg)
> 25 million page visits per month
![Page 5: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/5.jpg)
Our (hi)story
![Page 6: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/6.jpg)
Back in 2012
![Page 7: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/7.jpg)
WebshopCatalogueProduct Content
PricesAvailability
FullfillmentDeliveryReturns
Check for fraudStock management
etc..
The shop!Add to cartCheck outPayments
PromotionsGift cards
etc..
Fulfillment
Catalogue
Our suppliers
![Page 8: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/8.jpg)
Service oriented architecture
![Page 9: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/9.jpg)
The evolution of test automation
2012- 2013 2013 - 2015 2015 -
![Page 10: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/10.jpg)
Selection process
Testers
Developers
Product Owners
“We need quick test runs with quick results”
“I’d like to use a language I’m familiar with”
“I want to do a quality check in between releases”
“I want to be notified when High priority tests are failing” Management
Operations“ A good reporting tool is very important to me”
![Page 11: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/11.jpg)
And the winner is …Fitnesse & Selenium
• Open-source
• Flexible; adaptable
• Java-based
• Easy to read
![Page 12: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/12.jpg)
Introducing a new tool
![Page 13: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/13.jpg)
Ensuring adoption
Reliable tests
Technical & functional support
Gamification
Team involvement
![Page 14: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/14.jpg)
TA support team
FixturesSolve common problemsStubs
Fitnesseslaves
Enable scrum teams
Reporting
Knowledge sharing Innovation
Mobile testing
![Page 15: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/15.jpg)
Test reporting
![Page 16: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/16.jpg)
Depth ofExpertise
Breadth of knowledge
Role of the testerShape of the ideal information worker
![Page 17: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/17.jpg)
Role of the tester
• Boundaries between roles are fading
• Creating automated checks is not solely a testers job
• Tester stays in the ‘directors chair’
![Page 18: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/18.jpg)
Results so farThe Good, The Bad & The Ugly
![Page 19: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/19.jpg)
Results so far, The Good
Ratio test engineers vs. software engineersUser stories vs. scrum team members
![Page 20: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/20.jpg)
Results so far, The Good
Incidents vs. ratio incidents per scrum teamAutomated test cases in 2014
![Page 21: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/21.jpg)
Results so far, The BadNot quite
![Page 22: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/22.jpg)
Results so far, The Ugly
• There is no single ‘right’ way to do it
• It can be hard to keep things DRY when starting out
• Check automation has to become part of the DoD
![Page 23: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/23.jpg)
Reaching the limitsSingle fitnesse repository
![Page 24: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/24.jpg)
Agile in test automation
![Page 25: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/25.jpg)
2015 -
The evolution continues
![Page 26: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/26.jpg)
Takeaways
• Allow yourself to make mistakes and dare to change course
• Involve as many different stakeholders as possible
• Trust in the expertise of your scrum teams. You will be rewarded!
![Page 27: Test automation @ bol€¦ · Agile in test automation . 2015 - The evolution continues. Takeaways • Allow yourself to make mistakes and dare to change course • Involve as many](https://reader033.vdocuments.net/reader033/viewer/2022052001/601329eaf2024f11c646f1db/html5/thumbnails/27.jpg)
Thanks!till next bol.com
Joost van Wollingen
Elise van Krevelen