accelerate web and mobile testing for continuous integration and delivery
DESCRIPTION
Accelerating Web and Mobile Testing for Continuous Delivery Automated load and performance testing of your web and mobile apps can ensure quality throughout the application lifecycle. Automated and continuous testing can increase the speed and accuracy of application readiness, and eliminate time-consuming, error-prone manual processes. In this webinar, led by SOASTA experts, you will learn: • How to create a continuous load and performance testing framework • How to trigger testing every time code changes are delivered • How to use TouchTest for mobile apps functional testing • How to use CloudTest for load testingTRANSCRIPT
© 2014 SOASTA. All rights reserved. 1
© 2014 SOASTA. All rights reserved. 2
© 2014 SOASTA. All rights reserved. 3
Agenda:
• The need for “Continuous”
• CI with mobile and performance testing
• SOASTA CloudTest and TouchTest with Jenkins (demo)
Questions:
Submit in chat box during event
© 2014 SOASTA. All rights reserved. 4
User Experience
Unpredictability Continuous
Mobile
100’s to millions
Local to global
100% availability
Agile development
Continuous delivery
DevOps principles
Fast
Seamless
Disposable
Online everything
Mobile commerce
Legacy modernization
© 2014 SOASTA. All rights reserved. 5
Does it work as
designed?
Does it perform
under extreme
circumstances?
Approve materials Real Drivers
What happens
in actual
conditions?
Assembly Line
© 2014 SOASTA. All rights reserved. 6
Functional validation
Performance,
reliability,
scalability tests
Real Users
Build
What happens
in actual
conditions?
Unit-tested code
© 2014 SOASTA. All rights reserved. 7
o Small Batch Sizes
o Comprehensive Version Control
o Simple Branch Strategies
o Automation
o Continuous Feedback
o Emphasis on working builds
o Consistent environments
o Developer – Tester Collaboration
© 2014 SOASTA. All rights reserved. 8CONFIDENTIAL – Not for Distribution
© 2014 SOASTA. All rights reserved. 9
© 2014 SOASTA. All rights reserved. 10CONFIDENTIAL – Not for Distribution
Ut
Unit Testing
Pe
Performance
Testing
Fu
Functional
Testing
Development Testing Operations
TIME
Traditional Linear Approach
© 2014 SOASTA. All rights reserved. 11CONFIDENTIAL – Not for Distribution
Ut
Unit Testing
Pe
Performance
Testing
Fu
Functional
Testing
Development Testing Operations
TIME
Test
Dev Ops
Traditional Linear Approach
Continuous Testing Approach
© 2014 SOASTA. All rights reserved. 12
Mobile Test
Automation
Performanc
e Testing
Real Test
Devices
Solid
Integration
© 2014 SOASTA. All rights reserved. 13
o Fully managed private device cloud
installed behind the firewall
o Real-time device inventory, status and
availability
o Online access for all your teams
o 24x7, secure, remote access to devices
o Mobile functional test automation
software
o Remotely access to selected mobile
device and any mobile app
• Use devices for manual testing and monitoring
• Remote screen-share devices for collaboration on
design or issues
© 2014 SOASTA. All rights reserved. 14
o Dedicated Public Device Cloud
o Access to the latest market leading
devices (iOS/Android)
o Automatic installation,
maintenance and upgrade
o Hosted devices in a secure data
center
o Stock devices, not jail
broken/rooted
o Seamless integration with
TouchTest and CI environments
o API available to install apps,
reboot/wake-up devices, launch
testsPerfect for 24x7 Automated Mobile Regression Testing
© 2014 SOASTA. All rights reserved. 15
s
Memory leaks
Test Scale
Sta
ge
/ T
ea
m
Dev
& Test
Release
& Deploy
Network
& OpsCDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Load Testing at All StagesPerformance validation from development to production
Continuous tuning for full-scale…and well beyond
© 2014 SOASTA. All rights reserved. 16
Use real user data to
iterate dev & test plans
Run iterative load
tests via Jenkins
Daily (or more frequent) updates
keep teams quality focused
Embedded failure
details & bottleneck
data isolate issues
Manage to a
performance
baseline
Mobile? Run functional
automation on real devices
for functional & performance
validation
Spin up suitable, consistent
test environments in the
cloud or the lab
Jenkins runs any
unit tests as usual
© 2014 SOASTA. All rights reserved. 17
© 2014 SOASTA. All rights reserved. 18
Expertise
Thanks
Contact SOASTA:
www.soasta.com/cloudtest/
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Next Webinar: November 5, 2014
“How to Measure the Business Impact of Web Performance”
Register:
Webinars future and past: http://www.soasta.com/knowledge-
center/webinars/
Want to evaluate any SOASTA product or service?
- email [email protected]
- You’ll hear from us tomorrow (maybe today)
www.SOASTA.com