7 keys for unattended test automation webinar deck
TRANSCRIPT
5/13/2016 1© 2016, Perfecto Mobile Ltd. All Rights Reserved.
7 key recommendations for building a solid test automation suiteMay 2016
Eran KinsbrunerDirector, Tech. Evangelist
PerfectoUzi Eilon
Technology DirectorPerfecto
Daniel KnottMobile Senior Test Engineer
Xing AG
Some housekeeping before we start
5/13/2016 2© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Submit questions using the Q&A panel. Participate in the polls.
Watch your email for a copy of the recording and slides. Complete the survey following the presentation.
Webinar Agenda
5/13/2016 3© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Automation Challenges Strategy for defining the right digital test coverage
Practices For Robust Test AutomationThe 7 Keys for Unattended Mobile Test Automation
Live Demo!Q & A
5/13/2016 4© 2015, Perfecto Mobile Ltd. All Rights Reserved.
I SAIDI WAS FINE.
I LIED.
Poll – Mobile Test Automation Challenges
5/13/2016 5© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Code / Test – Common Challenges
1) Execution of One script across platforms2) Automating build/deploy and acceptance testing during CI3) Test results analysis4) Object id Identification5) Does it work over time ?6) Maintenance of scripts and Objects7) Matching Dev/Testers skill set
DevOps – challenges
Tools
Reports
Flows
Time Stability
False negatives
Collaboration
The Test Coverage Conversation – What To Answer?Which Devices?Which OS Versions? How Many platforms are Enough?When Should I refresh my test lab?Who is in charge of coverage?
5/13/2016 8© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Coverage Method
Recommended OS – Usage & Quality Rationale
Usage & Quality Issues
Wi-Fi IssuesBattery Drain
Latest REF Android OS
WHY AUTOMATE?
UIIntegrationUnit Testing
Performance Security
Digital Transformation Requires Changes Around Test Automation
Target Devices TargetEnv.OSOS versionsForm factorsCPU & MemoryManufacturersWearablesIOT
NetworksOrientationLocationNotificationsEventsDevice events
Object Identification Is Key For Robust Automation
5/13/2016 13© 2016, Perfecto Mobile Ltd. All Rights Reserved.
• Selenium• Appium• XCTest• UIAutomation• Perfecto
• Abby OCR• Applitools• Perfecto
Device/System Level Control is Critical
14
Assure Proper Error Handling
15
System level control Application control
Device control
3 Layers Involved In Test Automation Optimization
5/13/2016 16© 2016, Perfecto Mobile Ltd. All Rights Reserved.
App• Info.Plist (iOS)• Manifest.MF (Android)
Test Cases• Define Desired Capabilities
Device• Supports Feature• Doesn’t Support
Facebook App Testing Diversity
5/13/2016 17© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Test Scenario iPhone 6/iPhone 5S iPhone 6S/6S Plus iPad Tablets
Login YES YES YESWrite Post (FB UI) YES YES YESWrite Post (FB Force Touch) NO YES NOUpload Photo/Video(FB UI) YES YES YESUpload Photo/Video(FB Force Touch) NO YES NOTake Photo/Video(FB UI) YES YES YESTake Photo/Video(FB Force Touch) NO YES NO
More Examples: Android Doze & Multi Window
5/13/2016 18© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Android 6 and AboveAndroid N and Above
Validate Feature Compliance & Test Accordingly
5/13/2016 19© 2016, Perfecto Mobile Ltd. All Rights Reserved.
IOS Developer LibraryINFO.PLIST
7 Keys for Successful Unattended Automation and CI
5/13/2016 20© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Start small & Grow Accept that not every test enters CI Debug & Debug Again across few platforms Make your script reusable
Validate within and between the tests Plan for unexpected events Keep channel between Engineering, Ops and Biz opened
Zero Effort Automation Demo
More Example
5/13/2016 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Smart Monkey Automation
5/13/2016 23© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Smart Monkey Automation
5/13/2016 24© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Webinar Agenda
5/13/2016 25© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Automation Challenges Strategy for defining the right digital test coverage
Practices For Robust Test AutomationThe 7 Keys for Unattended Mobile Test Automation
Live Demo!Q & A
Q & A
5/13/2016 26© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Special Offers to Webinar Attendees
5/13/2016 27© 2015, Perfecto Mobile Ltd. All Rights Reserved.
New Whitepaper – Early Release!The Ultimate Digital Test Coverage GuideContact Eran [email protected] to get your free copy!
Thank You