preparing for holiday performance, api edition

@SmartBear #HolidayAPISpeed

Preparing for Holiday Performance, API edition


This session is being recorded. We’ll send it to you via email.

Tweet questions using #HolidayAPISpeed

You can also ask questions in the right

chat panel. We’ll address them at the

end.

Answer our quick survey after the

webinar!

•

•

•

•

Housekeeping

2


Our Speakers

3

Mark TomlinsonAPI Performance Consultant

PerfBytes, STP Radio@mtomlins

Paul BruceAPI Product Manager

SmartBear Software@PaulsBruce

Michael PunskyPresident & Load Testing Guru

at FTL Metrics@mpunsky


Why you should have an API performance strategy in place before the holiday rush

Challenges simulating load and themetrics that matter most in API performance

API Performance in action!

Takeaways and Q&A

1.

2.

3.

4.

5.

What we’ll cover today

4

The effects of API performance on theuser’s experience


Webinar Attendee Statistics

0%

61%

39%

How important is API Performance to your organization?

Not important atall

Growingimportance

Very important

30%

70%

0%

How much API Load testing do you do today?

None

Some

Extensive

39% of attendees for this webinar responded that API

performance is “very important,” and yet 30% responded that they

are doing NO load testing at all.


• New & unanticipated workloads

• Unknowns will soon be known

• Data patterns change

• Preparation before, not after

API Performance during the Holiday Season


Daily volumes vs. holiday peaks


Amazon, Aug 2013, 40mins, $5m

Mins of downtime * avg. revenue / min

= downtime losses

Third party downtime affects everyone

API performance affects mobile & web apps

Case in point: the cost of downtime


What’s at risk?


Nike+ FuelBand

Fitbit

Jawbone UP24

Amazon Nest

Phillips Hue

Internet-connected TVs

The 2014 Gadget Craze

All of themuse APIs!


Hate to make you wait...but...

Back-end “latch” time on middle-tier resources

After two seconds, you’re only a swipe away

Mobile uninstall

New browser tab to competitor

Wait time allows for distraction from UX

goals

Effects of slow APIs on UX


What kind of tests do you really need?

How do real conditions differ from testing efforts?

What are your expectations?

How do you set your performance goals?

What’s your one-x load?

Which multiples of one-x impact your business?

Where & why do multiples of one-x occur?

What it looks like to simulate…


Common (web / mobile / API)

Total round-trip time on individual calls

Failures that the simulation elicited

Server metrics (effect of load on resources)

Web-specific metrics

Page, ATF (perceived user metrics)

UX and Interaction workflows

API-specific metrics

Throughput: TPS, BPS, queued (arrival)

Metrics: traditional vs. API data


Identify critical real-world workflows

Isolate the critical waypoints (API transactions)

Test parts & the whole, not just either/or

Sharing the results

API Monitoring to API development teams

Load test results with Ops

Summarizing results to management

Putting the customer experience 1st


API

Focus on API Performance

Load Testing

in

Performance Monitoring

in


Better to find out now than later

What you’re losing

Revenue

Consumers

Brand trust

Automating makes room in the schedule

Not everything is a priority; base it on data

What if we don’t have the time?


API Providers: SLA is a promise not to be broken

API Consumers: 3rd party problems are your problems too

Decision-makers: Visibility on API performance is critical

to have before the holiday rush

Developers: fast, regular performance checks help to

keep your backlog clean

Testers: Load testing makes you a rock star

Key takeaways


Thank you to our experts!

Mark Tomlinson

PerfBytes, STP Radio

Michael J. Punsky

FTL Metrics, SmartBear


Q & A

Try API Load Testing For Free

FREE TRIAL

http://smartbear.com/product/alertsite-uxm-enterprise/free-trial/

preparing for holiday performance, api edition

Technology