5 capabilities you should have in your digital app testing ... · mobile app testing tools...

5 capabilities you should have in your digital app testing infrastructure*September, 2018

*According to Forrester and Gartner

Speakers

2

Tal BarmeirCEOExperitest

Ruth ZamirDirector of MarketingExperitest

Agenda

3

Analyst research and recommendations –Forrester and Gartner

5 capabilities you should have in your digital app testing infrastructure

Summary & Q&A

01

02

03

10 min

5 min

10 min

4

~75% of global services decision makers are

investigating or implementing digital

transformation

The Forrester Wave™: Omnichannel Functional Test Automation Tools, Q3 2018

Download the Forrester Wave: experitest.com/forrester-download

5

Source: The Forrester Wave™: Omnichannel Functional Test Automation Tools, Q3 2018

A successful digital Agile-plus-DevOps shop means:

Image source: Forrester

• Design, build, and test quickly and iterativelyTesting can’t be manual

• Differentiate with user experience Testing an app’s functionality requires dealing with a new dimension

• Technical quality is a primary objective38% of global developers measure success and status by quality


6

Inclusion criteria

The Forrester Wave™


Forrester WaveTM: Omnichannel Functional Test Automation Tools, Q3 2018

7

▪ Largest market presence

▪ Largest installed base

▪ Blue chip enterprise customers

▪ Best current offering for digital quality

▪ “Offers a complete testing environment for both web and mobile, a robust mobile device cloud, and extensive cross-browser testing”

▪ “One of the few players to offer a unified platform for both mobile and web”

▪ Visual testing to ensure user experience


Vendor market Presence


Gartner: Hype Cycle for Mobile Apps and Multi-experience Development

9

10

Gartner: Hype Cycle for Application Development and Delivery

11

Gartner User Advice

Mobile DevOps Tools

• Embrace mobile app development as a part of core application development using commonDevOps collaboration and continuous integration tools

• Employ mobile test automation and live device testing to enable continuous delivery

• Implement mobile app instrumentation to foster continuous monitoring and analysis.

• Align with business objectives and identify bottlenecks using Gartner's DevOps toolchainmethod and theory of constraints

Mobile App Testing Tools

• Create a portfolio of testing tools to manage the costs and risks associated with testing increasingly sophisticated and contextual mobile apps.

• This will include in the-field testing

• Mobile testing will generally require access to actual devices and should not rely on emulators beyond early developer validation.

• We find most organizations also have needs for access to both local and cloud-managed devices

Cloud-Testing Tools

• Primary consideration should be based on lab scalability and the ability to match production use scenarios in a realistic way

• Integrate cloud-based testing tools into an agile delivery pipeline to further accelerate development and testing of applications

• Consider cloud-delivered, scalable and automated on-demand test labs as part of a DevOps strategy

Agenda

12



Summary & Q&A

01

02

03

10 min

5 min

10 min


1. Omnichannel testing at scale -making mobile and web testing part of your CI/CD pipeline

2. Customer experience as a key differentiator and using visual testing to ensure it

3. Enabling shift left - early developer testing and rapid feedback

4. Simple test authoring and maintenance with graphic UI and test recording

5. Driving agility and scale with a cloud-based device and browser lab

13


SeeTest Continuous Testing Platform for web and mobile applications

14

Digital

Lab

Emulators &

simulators

Desktop

browsers

Mobile

devices

Integrations:

IOT

APIs

Safari test #1

Available on premise or hosted by Experitest

Remotely access a centralized hub of browsers and mobile devices

(physical/emulated) to develop or test your digital apps, from anywhere

Hybrid

SaaS

A private lab hosted at Experitest’s data centers

On-premise

Easily setup a lab on your enterprise’s

premises with a SW only solution.

Optional: fully deployed and

managed by Experitest

15

Global Datacenters – your global device lab

Thousands of devices and desktop browsers hosted in ISO-certified data centers

1616

Existing

Expected, Q4 2018

Fremont, CA

Bracknell, UK

Tel Aviv, Israel

Frankfurt, Germany

New Delhi, India

NYC, NY

Toronto, Canada

Sydney, Australia

Case Study: Barclays

Higher velocity with higher quality

Easy and robust test automation

200 users (both Dev and testing teams)

continuously adding new tests into the

pipeline process

Test multiple web and mobile apps

simultaneously

15 B2B apps and 5 B2C apps

3000 test cases

Reduce release time

Overall application release time was

reduced from 5 months to 2 weeks

“For the past 5 years we've been using

SeeTest tools. They have always met

our testing requirements, supported our

existing frameworks, and enabled us to

scale beyond what we have imagined.” Ramesh Appusamy

SVP, Barclays

17

The Forrester Banking Wave™: European Mobile Apps, Q2 2018 report. The report evaluated Barclays as providing one of the strongest user experiences in its mobile applications. Read More

http://newsroom.barclays.com/r/3605/barclays_mobile_banking_app_comes_top_in_the_uk

Case Study: VodafoneTest any device in 23 different countries

Testing under real network conditions – device, network

and SIM • Non-functional testing including different network conditions

• Monitoring the device battery usage to prevent release of

overconsuming devices

Distributed web and mobile lab

Digital Assurance Lab hosting 400 devices, web browsers,

distributed in 23 different countries. Used by Dev and QA teams in

US and India

“SeeTest tools’ deployment returned its

investment in 2 months through travel cost

reduction alone.”

Guido Lubinsky

Principal QA Manager

Vodafone

Unified environment for testing and Dev teams

Developers reproduced issues using shared live sessions with testers

and visual test reports and then debugged issues on cloud devices

18

Agenda

19



Summary & Q&A

01

02

03

10 min

5 min

10 min

Questions?

22


5 capabilities you should have in your digital app testing ... · mobile app testing tools...

Documents