cloud based testing mobile apps
DESCRIPTION
Session Presented at 2nd IndicThreads.com Conference On Software Quality held on 25-26 March 2011 in Pune, India. WEB: http://Q11.IndicThreads.comTRANSCRIPT
Cloud based Testing for Mobile Apps
Dada MoteXORIANT Solutions Pvt. Ltd.
Agenda
• Testing Mobile Apps• Limitations• Emerging Trends • Cloud Based Testing for Mobile Apps• Clouds types for Mobile Apps Testing• Features of Cloud based Testing• Test Planning and Best Practices• Future Scope –Cloud Automation Engagement
Mobile-Smart Phones Requests
Introduction
• Growth of Mobile Platforms
• Growth of Vendors
• Types of Mobile Apps
• Biggest challenge:o ‘How to Test?’
Testing Pre-Installed Mobile Apps
• Core data activities • Functionality & Usability• Automatic upgrades • Cannot be Un-installed • Testing on ‘Prototype device’
Testing Installable Mobile Apps
• Downloading & Upgrading• Download through Wired /
Wireless Mediao AppStore, Online-URL, Transfer
via USB, BlueTooth, InfraRed• Installation and Un-Installation• Platform Specific
Testing Browser Based Mobile Apps
• Supported Mobile Browserso Opera, Skyfire, Teashark, bolt,
Blazer
• Accessibility and security• Availability scenarios• Real Location
Testing Performance/Functionality
• Various Network Strengths
• Various Network Speeds
• Various Network Types 2G, 3G & Wi-Fi
Testing Performance/Functionality
• Availability of Free Memory
• Memory Usage Patterno Launched, Run, Exit, Run for long timeo Memory Consumption Pattern (RAM)
• Multi-applications run while AUT is Run
Testing Performance/Functionality
• Continually Upgrading Devices & Apps
• Backward Compatibility
• MSP and Vendor Impact
• Battery Consumption Patterno Various Battery Strengths
Testing Compatibility/Functionality
• Various Input Modes
• Different screen sizes and Resolutions
• Various Interruptions while AUT iso Launched, Run, Exit, Installed, Upgraded
Traditional Apps Testing- Simulators
• Advantageso Finding issues in early stage, o Non-availability of device
• Disadvantageso Resemblance of the deviceo Test environment & i/o related issueso Actual end user scenarios o Network, location related scenarios
Mobile Apps Testing - Challenges
• Testing is not straight forward• Simulators are not Reliable• Real Test Bed
o Real Devices Availability, Devices w/ limited resources, Versions
o Real Network Operators, Infrastructure, Location
Requirement of Ideal Testing Platform
• Easy access & Full control to many phones• Enable all types of Testing • Integrate with existing MDLC/MDF • Generate Reports Easily• Enhance Collaboration among distributed
teams
Emerging Trends
• Advanced Testing Process• Automation Testing
o Mobinium, Robotium, QTP w/ M-Eux
• Out-Sourcing to Real Test Bedo Beta Testing, Crowd-Sourced Testing
• Remote Real Devices• Cloud based Testing Approach
General Cloud based Services
• Featureso Pay as you use o Any service any timeo Use of Virtualizationo Resources Availabilityo Scale-up and Scale-down o Adopt changing conditions
General Cloud based Services- Types
• Cloud Serviceso SaaS, PaaS, IaaS, Taas
• Cloud Types o Private Cloud
Owned, Hosted, Dedicated o Public Cloud
Hosted, Shared
Why Cloud based Approach for Mobile?
• Real Test Bed• Dynamic mobile landscape• Comprehensive Testing • Efficient Testing • Compatibility• Service Quality across devices
Cloud based Testing for Mobile Apps
• Web based secure access • Control to Many Real/Actual
Devices• Testing in Live Networks• Different Geo-locations
globally
Cloud based Testing for Mobile Apps
• Control on Testing process
• Agile Enterprises can control the Cloud to keep the Apps and services up-to-date with Newest Handsets
• Huge Revenue opportunities w/ gain in the market value
Mobile Cloud Overview
• 100% Web based S-a-a-S Platform• Holding the handset• Install Application from PC to Device• Send numbers to the device using keyboard• Simulate handset events in single click• Capture screenshots and videos
M-Cloud Infra Elements
• Sync Engine• Web2.0 Portal• Device Management• Data Adapters• Push Notifications• Aggregation
M-Cloud Infra Elements
• Rapid Development• Conflict Resolution• Core Apps• Privacy and Access• Scalability
M-Cloud Connectivity
Specific Types of M-Cloud
• Private M-Cloud o Owned, Dedicated, Hosted
• Public M-Cloudo Hosted, Shared
• Single Platform Cloud• Full Mobile Cloud
o Devices from All platforms
M-Cloud -Public Shared Devices
• Book time slot for Specific Devices• Specify Mobile Networks, Geo-locations• Keep Updated the Test Plan• Complete testing activity within time• Security and Performance testing is crucial
M-Cloud -Private Dedicated Devices
• Secured Devices• Change/upgrade of devices within cloud• Pool of Devices is part of Test strategy• Network should be part of test strategy• Choose betn hosted and on-premise devices
Services by M-Cloud Owner
• Lab with Versions of devices
• Setup Frameworks• Mobile Cloud Switch• Connection Utilities • Generate the Reports
Features of M-Cloud
• Highest level of Reliability• Device with Active Mobile plans
o Call, SMS, install apps, browse facility• Availability of Latest & upcoming Devices • 24x7 applications and performance monitoring• Reserve Devices whenever you need
M-Cloud Future Scope
Best Practices - Test Planning
o Setup the Test Bed Identify the Resources on M-Cloud
o Identify Test Cases for M-Cloudo Identify Test Data Regulations in advanceo Simulate the End User Experienceo Consider the Response Timeso Follow International Requirementso Identify Risk based scenarios
Best Practices – Test Execution
• Select proper/specific M-Cloudo Location, platform, Device dependent
• Connect to Device on M-Cloud and • Port the Apps on the Device• Identify applicable Testing types• Test across Multiple devices• Testing skills for Test engineers• Execute specific Tests related to
o Performance, Security, Accessibility, Availability
M-Cloud Implementation Challenges
• Firewall Exceptions & Remote configurations• Application Tuning• Storage and Bandwidth cost• Cross Cloud Alignment bottlenecks• Failover Testing for disaster recovery• Elasticity and scalability- False positives• Security and performance issues
Xoriant Services For Mobile Apps• Multiplatform Mobile Apps Development
• Testing Framework for various platforms w/ M-Cloud services
• Trained M-Cloud Mobile Apps Test Experts
• Continuous Testing Improvement in M-Cloud Services
THANK YOU!DADA MOTE
www.xoriant.com
VISIT www.xoriant.com/mobile-applications.html TO RECEIVE A PROMOTIONADVERTISING
CREDIT