load testing reloaded - inxpo · load testing reloaded why performance engineering is a must in our...
TRANSCRIPT
Load testing
reloaded Why Performance Engineering is a must in our Mobile, Cloud and DevOps driven world
Todd DeCapua and Silvia Siqueira
25 February 2016
Learning about you:
1. Online, digital applications
2. Client server apps
3. Legacy / enterprise / ERP applications
4. All the above
What types of apps that you are currently testing?
3
Are you:
Learning more about you:
1. Testing mobile apps
2. Testing applications in the Cloud
3. Using Cloud testing solutions
4. All the above
5. None of the above
4
Agility, mobility and quality
5
Performance Engineering is a must in our Mobile, Cloud and DevOps driven world
6
Importance of Performance Engineering
Do you know what Performance Engineering means?
Learning more about you:
1. End-to-End application performance management
2. Profiling the app
3. Load testing
4. Monitoring
5. All the above
8
Performance Engineering is a
cultural transformation that
builds performance in
throughout an organization.
What is Performance Engineering
Four (4) primary elements of Performance Engineering proven practices
1 Architect and design: How to engineer configuration and applications up front before starting development
2
3
Build: DevOps aspects for continuous integration, for effective and fast delivery
Deliver: Continuous deployment and operations
4 Monitoring: Predictive, growth, features, and continuous feedback
10
Consequences of not Performance Engineering
Architecture and design
12
How to engineer configuration and applications up front before starting development
Architect and design: How to
‒ Identify components
‒ Set performance budgets
‒ Acceptance criteria
‒ Plan for outliers
‒ Build-in performance
‒ Prototype (and test)
Identify key user stories
Identify / estimate workload
Define performance objectives
Breakdown processing steps
Allocate budgets
Evaluate / validate
13
Formal job responsibilities
Customer success story: building in resiliency
Build
DevOps aspects for continuous integration,
for effective and fast delivery
16
Build: Introduction
17
Build
18
Build: How to
Design
Development
Performance testing
Security testing
Functional / UX testing
Delivery
Monitoring
Automate test execution and analysis
Monitor real user experience for enhanced user engagement and insight
Virtualize services for developer efficiency
Reuse unit tests for greater time to value
Leverage virtual services and network for realistic app behavior
Predict future app behavior based on trends in test and production
Reuse test scripts for efficient pro-active monitoring
Integration of performance testing
HPE InterChange: Building in performance
Solution Overview Brochure
Lessons Learned:
1. Lack of test collateral continuity
2. Duration of scripting time
3. Formal performance testing results often not available until post release
4. Lack of compatibility between testing tools
5. Test goals were SLA driven
6. Predictive engineering was limited to hardware capacity
Deliver
Continuous deployment and operations
22
Deliver: Introduction
23
Deliver: How to
24
Performance Engineering skills
Netflix: variable bit rate & variable distribution (and formats)
Monitoring
Predictive, growth, features and continuous feedback
27
Monitoring: Introduction
28
Monitoring: How to
Improved performance scenarios
Increased production quality
29
Objectives for Performance Engineering
Gulliver Group: increases app downloads and bookings
Watch Video Here
Wrap-up
32
1. Load Testing Reloaded
2. Performance Engineering
3. Four Proven Practices
Architect & Design
Build
Deliver
Monitor
Preferred cloud-based load testing tools
Thank You and Q&A
– State of Performance Engineering 2015-16 [43-page eBook]
http://bit.ly/PE15Report
– Include Service Virtualization to reduce wait time and simulate
HPE.com/Software/SV
– Network Virtualization only from HPE to emulate network conditions
HPE.com/Software/NV
*Get your ‘application optimization’ results now with HPE.com/Software/Insights
– Monitoring, instantly from the perspective of your end-user
HPE.com/Software/AppPulseActive
– Cloud Load Testing for performance engineering / testing
HPE.com/Software/StormRunnerLoad
Todd DeCapua @AppPerfEng
Silvia Siqueira @Silvia_ITM