compatibility testing a must do of the web apps 2012
TRANSCRIPT
INDIUM SOFTWAREAn Independent Software Testing Firm
Compatibility Testing - A Must Do of the Web Apps
“Business Assurance through Quality Assurance”
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
2
Agenda
The Need The Impact The Challenges The Strategy The Checklist Metrics Inferences The Road Ahead
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
3
The Need
Operating Systems
Windows XP, Vista, Win7, MAC, Unix, Linux, etc.,
Browsers IE, Firefox, Chrome, Safari, Opera, etc.,
Databases Oracle, Sybase, DB2, Mysql, SqlServer, etc.,
System Software
Web server, networking, messaging tool
Platforms PC, PDA, Laptop, Mobile, PAD
Choices are in abundance for users
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
4
The Impact
Impact:-
• High cost of customer support• Decrease in user willingness to
recommend• Negative client feedback• Increase channel cost• Tarnish company’s reputation• Lost sales
That was a bad choice
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
5
The Challenges
Many different browsers Many different versions New versions released
frequently User preferences changes Standard follows, still there’s always variation
Business
Setting up test environment Huge resource allocation Test coverage in multiple
browser Quality deliverable in short time
Testing
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
6
The Strategy
Resource Management
Targeting
PlanningTesting
Communication
Reporting
• Browsers, Platforms and Plugins Tracking
• Systems & contact maintenance
• Platform Identification
• Current deployment core list
• Scope, Objectives• Define & Schedule• Virtualization
• Record test results• Dashboard with
compatibility data
• Configurations and goals
• Schedule & status
• Testing platforms of top priority
• Pilot deployments
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
7
The Checklist
Compatibility testing should ensure that Users have the same visual experience irrespective of the browsers In terms of functionality, the application must behave & respond the same way across
browsers
UI Validations Functionality Validations
CSS Rendering JavaScript
Copyrights Applets
Dropdown controls Check-in / Checkout
Tabs Export / Import
Clipboard Links
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
8
Metrics
IE FF Safari Chrome0
5
10
15
20
25
30
35
40
13
20
30
37
CSS Rendering Issues (%)
Def
ects
IE FF Safari Chrome0
5
10
15
20
25
30
35
40
23
14
37
26
Add-on Errors (%)
Def
ects
IE FF Safari Chrome05
1015202530354045 42
33
13 12
3rd Party Entities (%)
Def
ects
IE FF Safari Chrome05
1015202530354045
15
32
13
40
Browser Performance (%)
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
9
Inferences
Inferences (based on the test results of our case study) Application is faster in Firefox compared to other browsers Testing in Windows 8 developer edition/ IE 10 Beta brought out more bugs as in IE6 Application is more stable in Firefox versions, IE latest versions and Safari Java applets are not supported in Chrome. Some features of the application throws UI
issues. The following browsers are suggested for inclusion in the test matrix :
Browser Reason for inclusion in test matrix
Chrome Most common browser in use today & has significant rising market share of 29%
IE 8, IE 9 Top browser with the highest market share of 22%
Firefox Fastest browser next to Chrome in use with 19% share
iPhone & iPad Uses webkit, the largest single mobile browser
Safari 5.x, Safari 6.x Default browser on OS X
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
10
The Road Ahead
Our compatibility testing is based on proven testing methodologies and experience, powered with
Framework comes with the following features: Automated, Re-usable Framework to reduce Compatibility Testing overheads Seamless updates to compatibility matrix to ensure high quality End User experience
Key LeversWith Compatibility
Framework Value Additions Before After Value
Delivery Cycle Reduced by 30% Streamlined process cycle timeEnsures high quality service delivery
* 8 – 10 days
5–7 days
~USD100,000
Test Execution Phase
Faster by 20% Automated, Re-usable Framework Execute Automated tests
* 5 – 7 days
4–6 days
Reporting Faster by 40% Proactive monitoring of end-user device configurations
* 2 days 1 day
Defect Detection
Increased by 25% Jump Start Kits-Known failure patterns across different OS/Browser combinations
100 defects /
Qtr
125 defects /
Qtr
~USD50,000
Testing ROI 50-60% Savings Reduces compatibility Testing overheads ~USD 200,000
USD 100,000
~USD100,000
-> Total cost saving ~ USD 300,000
© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
11
Thank You
USA: [email protected]
EMEA & APAC: [email protected]@indiumsoft.com
INDIA: [email protected]
SunnyvaleSuite 210, 1250 Oakmead ParkwaySunnyvale, CA – 94085.Phone: +1(408) 501-8844Fax: +1(408) 501-8808
Atlanta Crown Office Suites1870 The Exchange, Suite 100 Atlanta, GA 30339Phone: +1 (678) 608-0809, +1(770) 989-7302
New DelhiF-1/5 Okhla Industrial Area Phase-I, New Delhi – 110 020.Phone: +91-11-6613 0400
BengaluruSRS Plaza, No. 246, 2nd & 3rd Floor13th Cross, Indira Nagar 2nd StageBengaluru – 560 038.Phone: +91-80-4914 7777
ChennaiVDS House41, 2nd Floor, Cathedral RoadChennai – 600 086.Phone: +91-44-2811 6330Fax: +91-44-4210 4033