load testing reloaded - inxpo · load testing reloaded why performance engineering is a must in our...

Load testing

reloaded Why Performance Engineering is a must in our Mobile, Cloud and DevOps driven world

Todd DeCapua and Silvia Siqueira

25 February 2016

Speakers

Silvia Siqueira Todd DeCapua

http://bit.ly/VelocityPE15

Learning about you:

1. Online, digital applications

2. Client server apps

3. Legacy / enterprise / ERP applications

4. All the above

What types of apps that you are currently testing?

3

Are you:

Learning more about you:

1. Testing mobile apps

2. Testing applications in the Cloud

3. Using Cloud testing solutions

4. All the above

5. None of the above

4

Agility, mobility and quality

5

Performance Engineering is a must in our Mobile, Cloud and DevOps driven world

6

Importance of Performance Engineering

Do you know what Performance Engineering means?

Learning more about you:

1. End-to-End application performance management

2. Profiling the app

3. Load testing

4. Monitoring

5. All the above

8

Performance Engineering is a

cultural transformation that

builds performance in

throughout an organization.

What is Performance Engineering

Four (4) primary elements of Performance Engineering proven practices

1 Architect and design: How to engineer configuration and applications up front before starting development

2

3

Build: DevOps aspects for continuous integration, for effective and fast delivery

Deliver: Continuous deployment and operations

4 Monitoring: Predictive, growth, features, and continuous feedback

10

Consequences of not Performance Engineering

Architecture and design

12

How to engineer configuration and applications up front before starting development

Architect and design: How to

‒ Identify components

‒ Set performance budgets

‒ Acceptance criteria

‒ Plan for outliers

‒ Build-in performance

‒ Prototype (and test)

Identify key user stories

Identify / estimate workload

Define performance objectives

Breakdown processing steps

Allocate budgets

Evaluate / validate

13

Formal job responsibilities

Customer success story: building in resiliency

Build

DevOps aspects for continuous integration,

for effective and fast delivery

16

Build: Introduction

17

Build

18

Build: How to

Design

Development

Performance testing

Security testing

Functional / UX testing

Delivery

Monitoring

Automate test execution and analysis

Monitor real user experience for enhanced user engagement and insight

Virtualize services for developer efficiency

Reuse unit tests for greater time to value

Leverage virtual services and network for realistic app behavior

Predict future app behavior based on trends in test and production

Reuse test scripts for efficient pro-active monitoring

Integration of performance testing

HPE InterChange: Building in performance

Solution Overview Brochure

Lessons Learned:

1. Lack of test collateral continuity

2. Duration of scripting time

3. Formal performance testing results often not available until post release

4. Lack of compatibility between testing tools

5. Test goals were SLA driven

6. Predictive engineering was limited to hardware capacity

Deliver

Continuous deployment and operations

22

Deliver: Introduction

23

Deliver: How to

24

Performance Engineering skills

Netflix: variable bit rate & variable distribution (and formats)

Monitoring

Predictive, growth, features and continuous feedback

27

Monitoring: Introduction

28

Monitoring: How to

Improved performance scenarios

Increased production quality

29

Objectives for Performance Engineering

Gulliver Group: increases app downloads and bookings

Watch Video Here

Wrap-up

32

1. Load Testing Reloaded

2. Performance Engineering

3. Four Proven Practices

Architect & Design

Build

Deliver

Monitor

Preferred cloud-based load testing tools

Thank You and Q&A

– State of Performance Engineering 2015-16 [43-page eBook]

http://bit.ly/PE15Report

– Include Service Virtualization to reduce wait time and simulate

HPE.com/Software/SV

– Network Virtualization only from HPE to emulate network conditions

HPE.com/Software/NV

*Get your ‘application optimization’ results now with HPE.com/Software/Insights

– Monitoring, instantly from the perspective of your end-user

HPE.com/Software/AppPulseActive

– Cloud Load Testing for performance engineering / testing

HPE.com/Software/StormRunnerLoad

Todd DeCapua @AppPerfEng

Silvia Siqueira @Silvia_ITM