“agile and performance testing?“ a contradition of...
TRANSCRIPT
![Page 1: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/1.jpg)
“AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?
Mieke Gevers
European Testing Conference 2016
![Page 2: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/2.jpg)
2
Agenda
1. Performance testing 2. Manifesto 3. Performance testing & Agile 4. Stories 5. Conclusion
![Page 3: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/3.jpg)
Performance Testing
¨ what do we do ¨ how do we do it ¨ when we do it
3
![Page 4: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/4.jpg)
Performance testing
¨ What ~ Value: ¤ assess user satisfaction? ¤ validate assumptions? ¤ estimate capacity? ¤ assist in performance tuning? ¤ generate marketing statements? ¤ Inform & assist developers? ¤ evaluate release readiness? ¤ prove readiness to stakeholders?
4
![Page 5: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/5.jpg)
Performance Testing Definition Performance testing proves that the SUT meets (or does
not meet) its performance requirements or objectives, specifically those regarding response time, throughput, and utilization under a given (usually, but not necessarily, average or normal) load.
5
IEEE, definition Performance testing
![Page 6: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/6.jpg)
¨ How ~ Tools & tools and tools…. ¤ Junit ¤ Jmeter ¤ OpenSTA ¤ Java Explorer ¤ Profiler ¤ Performance TT ¤ …
6
![Page 7: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/7.jpg)
¨ When ~
7
![Page 8: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/8.jpg)
Manifesto for Agile Software Development
We are uncovering better ways of developing software by doing it and helping others do it.
Through this work we have come to value:
¨ Individuals and interactions over processes and tools
¨ Working software over comprehensive documentation
¨ Customer collaboration over contract negotiation
¨ Responding to change over following a plan
8
![Page 9: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/9.jpg)
© 2010-2012 AQIS
9
![Page 10: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/10.jpg)
Agile ~ Performance Testing 10
![Page 11: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/11.jpg)
© 2008-2009 AQIS
Core Performance Testing activities
1. Identify Test Environment
2. Identify Performance Acceptance Criteria
3. Plan and Design Tests
4. Configure Test Environment
5. Implement Test Design
6. Execute Tests
7. Analyse, Report and Re-test
Agile Performance Testing Activities
1. Understand Project Vision and Content
2. Identify Reasons for Testing Performance
3. Identify Value of Testing Performance
4. Configure Test Environment
5. Identify and Coordinate Tests
6. Execute Task(s)
7. Analyse Results and Report
8. Revisit 1-3 Consider Performance Criteria
9 Reprioritize Tasks
Analyse
Plan & Design Test
Build/Record scenario’s
Baseline + Load Test
Reporting
5 Steps
patterns & practices: Performance Testing Guidance for Web Applications
![Page 12: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/12.jpg)
12
Rajni Singh
![Page 13: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/13.jpg)
13
¨ Performance User Stories ¤ Agile project Cloud ¤ Agile project Mobile (Citrix) ¤ Agile project Enterprise Software
![Page 14: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/14.jpg)
Agile project Cloud
14
![Page 15: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/15.jpg)
Agile project Cloud
15
![Page 16: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/16.jpg)
Agile project Cloud
16
![Page 17: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/17.jpg)
Agile project Mobile (Citrix)
17
![Page 18: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/18.jpg)
Agile project Enterprise Software
18
![Page 19: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/19.jpg)
Redefined the Definition of Done 19
Prakash Mallappa Pujar
![Page 20: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/20.jpg)
Key considerations 20
¨ Service-level objectives (SLOs) ¨ Focused performance testing
n Agile processes rely on the production availability lifecycle (PAL)
¨ Test data preparation n just-in-time (JIT) manufacturing
¨ Trending ¨ Reusable and shared testing assets ¨ Automated testing ¨ Continual analysis ¨ Component testing & stubs
![Page 21: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/21.jpg)
Three phases of Agile Performance Testing
21
¨ Unit Level ¤ Executing tests to isolate and fix bottlenecks at
code level.
¨ Component Level ¤ Executing tests to isolate and fix bottlenecks in
application components level.
¨ Application Load ¤ Testing the critical application flows for user
experience under normal and peak loads.
![Page 22: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/22.jpg)
“Effective performance testing is inherently agile.”
Scott Barber
22
![Page 23: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/23.jpg)
Conclusion
¨ Flexibility ¨ Cost reduction ¨ Team work even cross-functional teams
23
![Page 24: “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF …europeantestingconference.eu/slides16/ETC16_MiekeGevers.pdf · “AGILE AND PERFORMANCE TESTING?“ A CONTRADITION OF TERMS?](https://reader033.vdocuments.net/reader033/viewer/2022052710/5aa642767f8b9afa758e439e/html5/thumbnails/24.jpg)
24
• http://www.ministryoftesting.com/2014/02/real-agile-approach-performance-testing/
• https://www.scrumalliance.org/community/articles/2013/2013-may/agile-performance-testing-an-experimental-approach
• http://www.agileload.com/docs/whitepapers/agile-performance-testing.pdf?sfvrsn=2
• http://www7b.boulder.ibm.com/wsdd/library/techarticles/hvws/scalability.html
• Patterns & practices: Performance Testing Guidance for Web Applications by Scott Barber
• ISO 9126, 29119
Resources