eli stull stpcon spring 2017 keynote
TRANSCRIPT
Performance Testing in the Evolving API Economy
02
Audience Poll:
Who ‘s API’s?
Who really ‘s API’s?API’s have become the cornerstone of modern
innovation
03
04
Change in the landscape
API
APIAPI
AppApp
AppAPI
PublicSpace
PublicSpace
PublicSpace
Publ
icSp
ace
PublicSpace
Public
Space PublicSpace
NowThen
App
AppAppApp
App
AppApp
05
Application Programming Interface
- Protocols and tools for building software applications
- Allow applications to talk to one another
API Overview
{A}
06
”Without change there is no innovation, creativity, or
incentive for improvement. Those who initiate change will have a better opportunity to manage the change that is
inevitable. - William Pollard, Physicist
• Platform based business model• Creates new product services and categories• Allows for user / customer production contribution – opening the
doors for any developer to develop and build on an API
07
API Economy Overview
08
Organizations that are thriving in the new economy are built specifically to innovate and build on the platform
• Structured to innovate and disrupt• Openly shares and distributes information and ideas • Chain of command structured on platform vs. products
API Economy Organizational Characteristics
Examples of industry disruptors and newly created categories
• Home Automation • P2P Asset Rental (home, car, tools)• Exercise Tracking• Ride Sharing• Navigation• Authentication
09
What is it?
• Everyday devices that are connected to the internet and are sending / receiving data to perform a task
10
Internet of Things (IoT)
IoT adoption / implementation shows no signs of slowing down….
• 6.65 Billion devices in 2016• Increase by ~16 Billion in 5 years (2021)• Translates to a ~$4.8 Trillion investment in technology in 5 year
span
11
IoT 5 year trend
http://www.businessinsider.com/the-internet-of-things-2017-report-2017-1
Where does this go?12
13
42
Customer experience
1Unit Test
QuickAutomation
2 4
53
15
Essential to platform release success
Integrate“Real World”
Stress Test
ReleaseProductionize
Code
MonitorEnvironment
User Experience
IteratePrioritize defects
and enhancements
Testing during development
Automation reduces operational cost while increasing speed to market
• Dev Ops• Load Testing• Deployment
16
Automate, automate, and automate some more
17
Don’t
Test the end-to-end experience based on target product audience
• Devices• Networks• Full experience (including 3rd party interactions)
18
Performance test simulating the users environment
Baseline performance and monitor the experience with all methods available
• Synthetic Monitoring• RUM (Real User Monitoring)• Infrastructure (Backend)
19
On-going platform monitoring
Capital One Examples20
21
22
23
Thanks