ENABLING SUCCESSFUL MOBILE AUTOMATION TESTING

INTRODUCTION

• Michael Pollino – Technical Test Consultant with Planit

• 8 years Automated and general Testing experience

• Planit provide Software Testing solutions. We are based in Melbourne, Sydney, Perth and NZ with a team of over 500 Testing Consultants

UNSUCCESSFUL MOBILE TESTING

OVERVIEW

Proliferation of Mobile Devices

The Mobile Difference

Mobile Landscape

Technology Targeting

Tools

Defining Success?

1

2

3

4

5

6

THE PROLIFERATION OF MOBILE

Smartphones are becoming indispensable to Australian daily life

• Australian Smartphone ownership:

- 52% in 2012

- 64.6% in 2013

• 7.5 million Australians used the Internet on a Mobile in June 2013.

• Increase of 33% from to June 2012 and 510% since June 2008.

Source: http://www.theaustralian.com.au/

http://www.ourmobileplanet.com/en/http://www.acma.gov.au

THE PROLIFERATION OF MOBILE

The bottom line:

• $8.5 Billion generated revenue from Apps in 2012 in the US

• iTunes experienced 81% growth in revenue in the US in 2013

• Overall spending on apps set to grow to $46 Billion by 2016

Source: http://www.streetinsider.com/

http://www.news.cnet.com/http://www.acma.gov.au

THE MOBILE DIFFERENCE

Question: What is the difference between a Mobile Development project and any other project?

Answer: Time. The rate at which things change on a Mobile App Project is far faster than your usual projects

THE MOBILE DIFFERENCE

Everything is faster:

• Changes in operating systems

• Changes in technology – Platforms and Standards

• Changes in devices

• Changes in user expectation

• Changes in business requirements

Nothing stands still – first to market is critical

THE MOBILE LANDSCAPE

Source: http://developer.android.com/

WHERE DOES AUTOMATION FIT?

• Why do we need it?

• What will it give us?

• When do we start?

• What do we Automate?

• How do we do it?

• User experience absolutely critical

• User expectations high

• Feedback is very visible

• Would you want to explain this:

ARE YOUR CUSTOMERS TRYING TO TELL YOU SOMETHING?

Source: https://play.google.com/store

• Test the technology your customers are using

• Analytics

• Create a Technology Cross section that represents your client base

• Get the most from your Test Effort - break down your traffic.

- Know what to support, more crucially – when to support it

- Map the user experience

• Standardised devices? Hero handsets? Tablets?

TECHNOLOGY TARGETING

• Emerging new technology

• Lower cost of ownership of actual physical devices

• Increased Handset diversity

• Easily shared resources for manual testing

• Geographical considerations

• Performance

• Security

• Object Recognition?

THE CLOUD ENVIRONMENT

• Free!

• Poor representation of real world

• iOS only simulates Software

EMULATORS AND SIMULATORS

Use for Development and Maintenance

• Real world hardware

• Real world provider

• Robust Object Recognition

• Concurrent Test Execution

• Emulators and Simulators used for development

• Cost and Maintenance

• Physical Security

PHYSICAL DEVICES

Mobile Automation is comparatively immature –Careful tool choice is critical

• Application under test is crucial for Tool selection

• Object Recognition – We must move past capture replay

• Device independent test cases

• Compiling third party code with your application

WHICH TOOL DO I CHOOSE?

• Mobile only functionality; camera, GPS, tactile buttons.

• Will I get support?

• Integration with existing Automation Suite

• Open Source

WHICH TOOL DO I CHOOSE?

• Higher quality

• Shorter Test cycles

• Defects Found Quicker

• Money Saved

• Happier Testers

SUCCESS!

• Improve

• Maintain

• Refactor

• Document

The mobile space changes rapidly – Adapting with to these changes is critical

NOW WHAT?

QUESTIONS?

How to Contact Us

Planit Sydney Michael Pollino Technical Test Consultant

Tel: 02 9464 0600

Email: info@planit.net.au Mobile: 0408 574 226

Email: mpollino@planit.net.auPlanit Melbourne

Tel: 03 9099 1313

Email: info@planit.net.au