maturity of mobile test automation: approaches and future trends- impetus webcast
TRANSCRIPT
-
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
1/51
Maturity of Mobile TestAutomation: Approaches &
Future Trends
1
-
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
2/51
Mobile Application Testing
Generic challenges
Technical challenges
Business challenges
Evolution of Test AutomationApproaches
Current and future trends
mAutomate
Outline
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
3/51
It is the use of strategies, tools, andartifacts that reduce the need for human
involvement on repetitive testing tasks
Unit, UI, and Functional testing
Test Automation
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
4/51
Application specific test case writing
Conversion of test cases into scripts
(Code / Record)
Execution of test scripts on devices
Unattended test cycles
How Test Automation Works?
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
5/51
Programmable
Repeatable and reusable
Reliable and comprehensive
Increased productivity
Cost reduction Superior application quality
Benefits
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
6/51
Diversity of device / platforms
Hardware complexity
Application complexity
Carrier network issues
Compressed software Development schedules
Generic Challenges
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
7/51
Large number of test cases
API level test execution
Verification of UI control
Handset specific features
Technical Challenges
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
8/51
Reduced time to market
First impression is the last
Increasing cost of QA cycles
High cost of onsite testing in targetnetworks
Procurement of large number of devicesat multiple locations
Business Challenges
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
9/51
Evolution of Test Automation
Approaches
9 Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
10/51
Unit Testing Automation Frameworks
XUnit family of tools
JM Unit
B Unit
OC Unit
CI integrations
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
11/51
UI Testing Automation using ImageComparison / OCR based tools
Started with VnC based tools Basic Record and Playback support
Scripting with manual creation ofImage Object mapping repos
Hardware wired device docks
Remote testing enabled
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
12/51
Functional Testing Automation Tools
Combination of unit test type scripts
with instruments
Android - Robotium
iOS instruments
Code test scriptsno recording
Test on USB or Wifi connected devices only
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
13/51
Object Comparison based test tools
Automated script generationRecord
Once, Play on multiple devices
Test Library instrumented with testbuild
Execution on remote device for testing
Generates desired environmentalconditions for recording
Evolution of Test Automation
13 Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
14/51
Object Comparison based test tools
Simulates required sensor data in
playback
Provides ways to add assertions andregressions
Facilities mobile device cloud forremote testing
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
15/51
Approach Comparison
15
Attribute Unit Test Image/OCR Instruments Object
Automatic Script Generation
Automatic code instrumentation N/R
Integration with CI
Record once execute on any device
No impact of UI position changes on
the test script
Test Scripts are independent of device
resolution/screen size
Asynchronous test execution on
multiple remote devices
Automatic UI verification withfunctional test execution
Total Points 3/8 3.5/8 3/8 7/8
Not Supported
Partially
SupportedDependency
No-dependency
LEGEND
S:
Supported
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
16/51
Combination of Object and ImageComparison based tools
Automatic UI verification along withfunctional test execution
Moving Towards Hybrid
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
17/51
Enhanced hybrid approach
Automatic system / UI object mapping
Automatic transversal of app
What Next?
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
18/51
Enhanced hybrid approach
Execution of functional test cases will
provide following without extrascripting
Seamless UI verification
Automatic Security testing
Automatic Random Interrupt testing
Automatic app store compliance certification
What Next?
Recorded version available at http://lf1.me/Pxb/
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
19/51
mAutomateFeature Set and UI
19
Recorded version available at http://lf1.me/Pxb/
D hb d
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
20/51
Dashboard
Recorded version available at http://lf1.me/Pxb/
D i
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
21/51
Devices
Recorded version available at http://lf1.me/Pxb/
D i
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
22/51
Devices
Recorded version available at http://lf1.me/Pxb/
P j t
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
23/51
Projects
Recorded version available at http://lf1.me/Pxb/
P j t
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
24/51
Projects
Recorded version available at http://lf1.me/Pxb/
R l V i
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
25/51
Releases - Versions
Recorded version available at http://lf1.me/Pxb/
Releases Versions
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
26/51
Releases - Versions
Recorded version available at http://lf1.me/Pxb/
Project Overview
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
27/51
Project Overview
Recorded version available at http://lf1.me/Pxb/
Project Overview
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
28/51
Project Overview
Recorded version available at http://lf1.me/Pxb/
TestCases
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
29/51
TestCases
Recorded version available at http://lf1.me/Pxb/
TestCases
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
30/51
TestCases
Recorded version available at http://lf1.me/Pxb/
Assertions
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
31/51
Assertions
Recorded version available at http://lf1.me/Pxb/
Assertions
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
32/51
Assertions
Recorded version available at http://lf1.me/Pxb/
Regressions
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
33/51
Regressions
Recorded version available at http://lf1.me/Pxb/
Regressions
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
34/51
Regressions
Recorded version available at http://lf1.me/Pxb/
Script-Editing
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
35/51
Script-Editing
Recorded version available at http://lf1.me/Pxb/
Script-Editing
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
36/51
Script Editing
Recorded version available at http://lf1.me/Pxb/
Conditions
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
37/51
Conditions
Recorded version available at http://lf1.me/Pxb/
Conditions
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
38/51
Conditions
Recorded version available at http://lf1.me/Pxb/
Version-Dashboard
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
39/51
Version Dashboard
Recorded version available at http://lf1.me/Pxb/
Version-Dashboard
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
40/51
Version Dashboard
Recorded version available at http://lf1.me/Pxb/
Build Matrix
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
41/51
Build Matrix
Recorded version available at http://lf1.me/Pxb/
Build Matrix
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
42/51
u d at
Recorded version available at http://lf1.me/Pxb/
Label Your Iteration
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
43/51
Recorded version available at http://lf1.me/Pxb/
Label Your Iteration
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
44/51
Recorded version available at http://lf1.me/Pxb/
Result-Pass
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
45/51
Recorded version available at http://lf1.me/Pxb/
Result-Fail
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
46/51
Recorded version available at http://lf1.me/Pxb/
Result-Fail
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
47/51
Recorded version available at http://lf1.me/Pxb/
Performance
http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
48/51
-
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
49/51
mAutomate Differentiators
Build your own private device cloud for
testing across geographies
Record once, execute on multiple devices
Web based infrastructure for test case &
device suite management
Push based mechanism to execute test
cases on remote devices
Complete test execution reports, along with
resource usage numbers are made
available on the web
-
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
50/51
Visitwww.mAutomate.com
Request access to free hosted versionOR
Buy license for in-premise deployment
Get Started with mAutomate
Recorded version available at http://lf1.me/Pxb/
http://www.mautomate.com/http://lf1.me/Pxb/http://lf1.me/Pxb/http://lf1.me/Pxb/http://www.mautomate.com/ -
8/12/2019 Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Webcast
51/51
Q & AThank You!