deliver successful apps with 360° assurance

Predicting Application Behavior and Market Acceptance

Qualitrix360° Assurance

Index

• About Us• Qualitrix Assurance Services • Test Delivery Models• Your Benefits• Key Enablers• How it Works• Why Qualitrix• Management Team• Case Studies

Fastest Growing On-demand Assurance Firm.

Contact: [email protected] 3© Qualitrix Technologies

About Us

Delivery Centers:SwitzerlandGermanyIndia

Sales Representations:AustriaUnited KingdomU.S.A.Australia

HQ

• Leading provider of next-gen assurance solutions for

mobility, web, cloud, IoT and enterprise applications

• Global presence serving clients across US, EU, Australia

and Asia, headquartered in Bangalore, India

• Ready-to-use solutions: Test management on cloud, Mobile

test framework, Test automation tools &frameworks, Best

practices

• Thought leaders in crowdsourced QA solutions -specialized

in building public and private crowd communities of testers

and user groups to derive digital product innovation and

continuous quality improvement

80+ Active Clients

Across US,

Europe, Asia &

Australia

300 + Projects

DeliveredYour Partner for Success!

Strategic Partners:


Industries and App Types• WEB & DESKTOP

• MOBILE

• CLOUD APPS

• ENTERPRISE APPS

• MOBILE HANDSETS

• OPERATOR SERVICES

• HEALTHCARE DEVICES

• WEARABLES

• SET TOP BOXES

• SMART DEVICES

• OTHER IOT

Travel & Hospitality

Retail & E-Commerce

Healthcare & Life Sciences

Telecom & Hi-Tech

Media & Entertainment

Education & E-Learning

Financial Services

Industry Coverage


Insert Image

• Applications deployed in a complex

multi-platform, multi-geographic,

multi-lingual environment

• Diverse user demographic with low

tolerance and quick word- of-mouth

impact

• Companies have to keep up with

quality, cost, and speed altogether

• “Testing has never been more

critical to reputation/operations.”

- Computer Weekly

IT Industry Challenges


Qualitrix Assurance Across App Life Cycle

VERIFICATION & VALIDATION

• Functional Testing• Non-Functional Testing• Content Validation• User Experience Testing

LAUNCH & IMPROVE• End User Experience• Touch Point Analysis• Business Process es• Support Inquiries

Services offered in various

phases of Application life

cycle.

Qualitrix Assurance empowered by

Crowdsourcing helps in improving your

Application throughout the entire

Application development lifecycle by

performing functional, non-functional

testing, real-world assurance and various

assessments that gets you early feedback

from your target end users.

DESIGN• Prototype Evaluation• Usability Studies• A/B Tests

RESEARCH

• Insights• Ideation• Benchmarking


360°Assurance ServicesComplete Assurance services

for your Mobile, Web, Desktop,

Enterprise Applications and

Smart Devices.

• Testing Services: 360°Functional and

non- functional test coverage of your app

through on-demand professional test

specialists ensuring accuracy and

robustness of your application.

• Real-World Crowdtesting: 360°coverage

on devices, operating systems, browsers and

networks in a localized environment through

crowdtesters.

• Market Acceptance: 360°feedback from

target users across different stages of app

development ensures that your app is always

aligned with the market needs.

REAL-WORLDCROWDTEST-

ING

MARKET ACCEPTANCETESTING

SERVICES

• Functional• Test Automation• Performance• Security

• Real-world Scenarios• OS / Devices /

Browser Compatibility

• Localization• User Experience• Beta Testing• User Acceptance• Production Audits


Testing ServicesFUNC-TIONAL

COMPAT-IBILITY

USABIL-ITY

LOCAL-IZATION

SECU-RITY

PER-FOR-

MANCE

ACCES-SIBILITY

Complete spectrum of testing

services for your Mobile, Web,

Desktop, Enterprise Applications

and Smart Devices.

Testing-as-a-Service :

Gain 100% assurance through

specialized professional testers in labs

combined with scalability and coverage

through part-time testers

On-demand Test Specialists:

Test Specialists available on-demand:

• Part-time and full-time basis

• Employees, Contractors, Freelancers


MANAGED BETA TEST-

ING• STRUCTURED BETA WITH REAL USERS

GOOD TO

GREAT

Crowdtesting: On demand engagement with TESTERS IN THE FIELD to assess

your application behavior in real-world conditions on a multitude of device models,

OS versions, browsers, data networks etc.

Market Acceptance: On-demand engagement with your TARGET END USERS

to assess the relevance and usability of your application features and identify if

your application is aligned with the target user needs.

Crowdtesting & Market Acceptance

EARLY ADOPTORS

USER EXPE-RIENCE

TESTING• USER EXPERIENCE EVALUATION

• DESIGN / CONCEPT VALIDATION

• COMPETITOR ANALYSIS & BENCHMARKING GUIDELINES /

ACCEPTANCE TESTING• COMPLIANCE CHECKS

• APP STORE GUIDELINES CHECK

REAL-WORLD

CROWDTESTING

• REAL-WORLD SCENARIOS• OS/DEVICE COMPATIBILITY• LOCATION BASED TESTING• LANGUAGE TESTING

.

AUDITS IN PRODUC-

TION• PRODUCT AND SERVICE EXCELLENCE

• BUILD EARLY ADOPTORS FOR YOUR APPS IN TARGET MARKET

Go Beyond Testing in Labs to Gain Complete Assurance


Test Delivery Models

TAILOR-MADE

FOR YOUR NEEDS

TESTING-AS-A-SER-

VICEFunctional / non-functional testing services delivered on fixed price for agreed scope

.

ON-DEMAND-TESTER

STAFFINGQA Specialists

available on-demand on hourly, daily, monthly rates

.

CROWDTESTING

SERVICESTest cycle subscriptions to assess your app behavior in real-world

conditions

SOFTWARE-AS-A-

SERVICETest mgmt. platform on cloud available for your needs incl. white-label

instance

”“

360° ASSURANCEYour partner for complete assurance of your app at

an agreed fixed price

On-demand test delivery

to help you deliver the

best quality applications

in the market at an

optimized cost.

.


Insert Image Insert Image Insert Image Insert Image

Your Benefits

RELIABLE APP BEHAVIOR AFTER

GO-LIVE

FASTER LAUNCH ITERATIONS

LOWER COST OF APP QUALITY

PREDICTABLE MAR-KET ACCEPTANCE

• Maximized Test Coverage

• Functional, Non-functional through Test Specialists

• Crowdtesters Covering Multiple Devices / OS / Configurations / Languages

• Real World Scenarios Tested On-location

• User Experience Testing through Target End Users

• User Assessments Done Across Diffe-rent Stages of App Development

• Structured Beta Testing

• User Acceptance, Closed User Group, Friends & Family Testing

• Testers On-boarded within Hours

• Test Cycle Duration Reduced to

One Third

• All Issues Detected within Days

• On-Demand Test Delivery

• 30-50% Lower Testing Cost Compared to Traditional QA Models

• Cost Savings Due to Early Issue Detection and Lower Defect Leakage


NEXT-GEN TOOLS /

FRAMEWORKS

BEST PRACTICES

Key EnablersTECHNO-

LOGYPROCESS

• 1000 TEST SPECIALISTS• 25000 CROWDTESTERS• 90 COUNTRIES• ALL MAJOR LANGUAGES• FUNCTIONAL TESTERS• AUTOMATION ENGINEERS• MOBILITY EXPERTS• SECURITY TESTERS• LOAD TESTERS• END USER GROUPS

BEST-FIT TESTERS

PEOPLE

• KNOWLEDGE MANAGEMENT

• HIRING & ONBOARDING• OFFSHORE SET UP• CROWDTEST PROCESS• TEST DELIVERY

• TEST MGMT. ON CLOUD• MOBILE TEST FRAMEWORK• SELENIUM AUTOMATION • TECHNOLOGY PARTNERS• SECURE OFFSHORE SETUP• TEST DEVICE LAB

Our three key enablers

ensure top-notch assur-

ance to your applications

and help you deliver best

apps in the market.


CONTINUOUS IMPROVE-MENT OF

YOUR AP-PLICATION

How it Works

What kind of Testing team you would prefer in terms of technical skills, language skills, demographic etc..

Whether you want to engage in managed services, staf-fing or 360 assurance mode..

There is always last minute change in plan, pause the testing whenver you want and re-engage when you are ready to start again, without any cost impact..

Real-time bugs reported to you through online test ma-nagement system with integrated defect management and review work flows..

Fully on-demand delivery

with complete control of

every testing activity in

your hands.

Step. 04PAUSE AND RE-

ENGAGE TESTING ON-DEMAND

Step. 01CHOOSE YOUR TEST DELIVERY MODEL

Step. 02GET HANDPICKED

TESTERS MATCHING YOUR REQUIREMENT

Step. 03START RECEIVING TEST RESULTS WITHIN HOURS THROUGH OUR ONLINE TEST MGMT. TOOL

SHARE YOUR REQUIREMENTS

TESTING TYPE ¦ COVERAGE REQUIRED ¦ SERVICES REQUIRED


Why Qualitrix

DELIVER BEST QUALITY APPLICATIONS AT MAR-KET SPEED AND LOW COST GET HIGH LEVEL OF

TEST MATURITY: TOOLS, FRAMEWORKS & PROCESSESGET ON-DEMAND AC-

CESS TO THE BEST TESTERS IN THE IN-DUSTRY

GO BEYOND TESTING: REAL-WORLD ASSURANCE, END USER ACCEPTANCE

ON-DEMAND TEST DELIVERY CUSTOMIZED FOR YOUR

NEEDS: ONSITE, OFFSHORE, CROWDSOURCE

One-Stop-Shop Providing

Complete Assurance To

Your Applications.


Management Team

(MANAGING DIRECTOR)MAYANK MITTAL

Formerly a core member of the EU leadership team and Testing Practice at Cognizant Tech-nology Solutions, a U.S.-based IT Service Provider with 20,000+ employees. Created one of largest testing engagements for the company, establishing a 5-year long partner-ship with a large financial enterprise worth $25 M in annual revenue with a 120+ person global delivery team working across 5 geographies.

(ADVISORY BOARD – MAR-KETING)

VISHAL SHRIVAS-TAVA

Vishal is a Senior Digital Marketing Consultant with close to 20 years of industry experience. He has helped several technology startups in US and India leverage digital marketing chan-nels and tools to build brand, generate leads and increase sales. He has worked as a Man-agement Consultant with the Big Four as well as with technology firms..

DIETER SPEIDEL(ADVISORY BOARD – STRAT-EGY)Founder & CEO of PASS Group AG. Board member of Crowdsourcing Asia. Serial in-vestor in various IT startups. 25+ years of ex-perience in software product development and system verification & validation. Former Co-Founder and Board Member of international industry associations such as Toolpoint,SiLA.


1. Case Study: Offshore Test Center Set Up

• Duration: 24 Months

• Peak Team Size: 15

• Average ramp up time: 2-4 weeks

• 3 Healthcare Software Products

• 450 High Complexity Test cases

(~80 Test Steps Each)

20% Test cases Automated

Testing Type: Functional, Automation,

Compatibility.

24 8 850

MONTHS OF

ENGAGEMENT

MAJOR RELEASES

DEFECTS REPORTE

D

TEAM COMPOSITION

Client is one of the largest suppliers of healthcare IT solutions in US. They wanted a testing partner for their eHealth

and mHealth Apps division that can provide them professional services with on-demand scalability at an optimum cost.

• Set up an offshore test center at Bangalore, India

• Core-flex capacity based engagement with possibility to ramp up/ down on short notice

• Leveraged offshore testing pool to build the testing team with following skillset:

• Manual testers, automation engineers, business analysts, and test managers

• Approved security concept for offshore setup

• Excellent client feedback for improving overall product quality and test maturity of the

testing division

OUR SOLUTION

KEY HIGHLIGHTSCLIENT

CONTEXT

ON-DEMAND TESTING SERVICES FOR A US HEALTHCARE IT SOLUTION PROVIDER


1. Case Study: Offshore Test Center Set Up

0.5 Million Direct Savings through On-demand

Ramp Up / Down First 10 resources ramped up in 3

weeks

SCALABILITY AND COST REDUCTION

TEST COVERAGE

KEY METRICS

20% Lower Offshore Rates against industry standard

45% less tester on-boarding time against industry standard

Qualitrix

Industry Average


2. Case Study: Enterprise Crowdtesting


• Average ramp up time: 2 Days

• 9 Android Apps

• 13 iOS Apps

• 5 Web Apps

• 26 Test Cycles

• 800 Test Scenarios Designed and

Executed

• Testing Mode: Guided Exploratory

(Test Scenario Based)

• Testing Types: Functional,

Compatibility, Usability, Accessibility,

SEO Testing, Security

• Special Test Cycles for All Apps:

iOS 9 Compatibility, Android

Marshmallow Compatibility

30 26 1050

CROWDTESTERS

PER CYCLE

TEST CYCLES

EXECUTED

DEFECTS REPORTE

D

Client is one of the largest broadcasting media firms in Australia. They were looking for a crowdtesting partner to asse-

ss their consumer web and mobile apps in real-world conditions on multiple PC and mobile handet models, OS

version, browser versions, network conditions. The partner also had to support non-functional testing for some apps.

• Engaged a testing team of 30 crowdtesters distributed across differnt cities in Australia

• Crowdtesters picked for each test cycle from a profiled Qualitrix testing community of 25,000 size

• Crowdtesters picked to cover the target device models, system configurations, and locations

• Picked non-functional test specialists for specific test cycles - Accessibility, SEO and Security

• App distribution or website access provided only through secure channel

• Thorough background verification conducted for each participating crowdtester

OUR SOLUTION

KEY HIGHLIGHTSCLIENT

CONTEXT

ENTERPRISE CROWDTESTING ENGAGEMENT FOR AN AUSTRALIAN MEDIA FIRM


2. Case Study: Enterprise Crowdtesting

COST COMPARISON PER CYCLEOUTSOURCED VS. CROWDSORCED

AVERAGE TEST COVERAGE PER CYCLE

KEY METRICS

24 16

ANDROID DEVICES COVERED

iOS DEVICES COVERED 8

COUNTRIES

COVERED

30 CROWD TESTERS

1 OFFSHORE RESOURCES

33% less than conventional testing

5X higher test coverage

TEST CYCLE TIME

Qualitrix

Industry Average

5-10 days test cycle execution time


3. Case Study: Field Assessment


• 30+ services tested per month

• 450 assessments per month

• Team size: 40 field testers,

4 regional coordinators,

1 test program manager

• 26 cities covered

• 12 Indian languages covered

95690

5400

IMPROVEMENTS

SUGGESTED

PRODUCTION

ISSUES REPORTED

ASSESSMENTS

CONDUCTED

The client was looking for a Field assessment partner to cover the following activities:

• Pan India Operational audits to verify the performance of all key VAS services

• VAS performance under different network conditions – 2G / 3G/ LTE,

• VAS performance across different cities covering Metropolitan, Urban and Semi-Urban areas

• Content audit to be collated at 4 hubs (North, South, East, West) for all major regional languages

• Hub wise Competition tracking for other network operators for similar VAS

• Voice of Customer – National level

• Team deployed with test program manager at client location, regional auditors and testers distributed across India

• List of services to be assessed prioritized each month

• Assessment scenarios defined for each service

• Test program manager assigns services and test surveys to all field testers through passbrains platform

• Testers & test manager activate the services and execute all the assigned surveys

• Testers report issues found while performing the audits in addition to submitting a summarized weekly and monthly

report to client and partners

SCOPE OF SERVICES

KEY HIGHLIGHTS

CLIENT CONTEXT

END USER ASSESSMENT OF VAS SERVICES IN PRODUCTION FOR AN INDIAN TELECOM OPERATOR


3. Case Study: Field AssessmentKEY METRICS

Qualitrix

Industry Average

26 CITIES MONTHLY

12 LANGUAGES

MONTHLY

32% Reduction in Production Issues

Observed

5X Times Higher ROI

AVERAGE TEST COVERAGE PER CYCLE

QUALITY IMPROVEMENT ACHIEVED

VALUE DELIVERED - ROI

Qualitrix Technologies#48, Vaishnavi Badri Towers, Jayamahal Extension, Bangalore, India – 560046+91 [email protected]

Thank You