getting ready for tomorrow's testing

20
Next Gen Testing Conference Singapore Keynote Address: Getting Ready for Tomorrow’s Testing Brynley Scully , Head of Testing, Singapore Hewlett - Packard Oct - 2014 www.unicomlearning.com

Upload: brynley-scully

Post on 21-Jun-2015

219 views

Category:

Technology


1 download

DESCRIPTION

Keynote Address at Next Generation Testing Conference 2014 in Singapore on 30-Oct-2014. This presentation gives a view on what the future holds for software testing, what should software testers focus on; what customers' expectations are.

TRANSCRIPT

Page 1: Getting Ready for Tomorrow's Testing

Next Gen Testing Conference Singapore

Keynote Address:Getting Ready forTomorrow’s Testing

Brynley Scully, Head of Testing, Singapore

Hewlett-Packard

Oct-2014

www.unicomlearning.com

Page 2: Getting Ready for Tomorrow's Testing

The Need for Testing

Page 3: Getting Ready for Tomorrow's Testing

"Build it, test it, and fix the things that go wrong.

Repeat the process until the desired reliability is achieved.

It is a feedback process and there is no other way."

David Packard

July 1972

Page 4: Getting Ready for Tomorrow's Testing

4

Higher Visibility of Software DefectsNews

Page 5: Getting Ready for Tomorrow's Testing

5

Higher Visibility of Software DefectsSocial Media

Page 6: Getting Ready for Tomorrow's Testing

6

A tipping point for application delivery

2010 4 per app

201536 per app

2020120 per app

“New application projects surge in 2013 and beyond.”

“Social, mobile, analytics, cloud have reached the tipping point in 2013.”

2013

Surging application numbers

Number of releases per app per year

• Apps everywhere

• Accessed through multiple devices

• 30x increase in application releases

• Closed feedback loop with customers

• Focus on time-to-value and ROI

What we expect:

Page 7: Getting Ready for Tomorrow's Testing

7

Delivering change continuously and fast is risky

Test and QAthroughout the Application Lifecycle will address these risks

The Risks:

Changeis constant

• New implementations• Support packs• Customizations

Speed impacts bottom line• Time to revenue• Cost of implementation

Interdependenceincreases business risk

• Apps are interdependent• Each change adds to risk

Composite Application

Page 8: Getting Ready for Tomorrow's Testing

Testing for Tomorrow

Page 9: Getting Ready for Tomorrow's Testing

9

Testing TypesWhat to Chose? When to Use? How to Apply?

System Integration User AcceptancePerformance

Benchmark

Load

Mobile Application

Au

tom

ati

on

ManualFunctional

RegressionNon-Functional

Reliability

Str

ess

Service Virtualisation

System

Dat

a

Compatibility

Loca

lisat

ion

Test

Dri

ven

Un

it

Test

Keyword Driven

Sec

uri

ty

Accessibility

Agile

User Interface

Operations Acceptance

Soak

Value Inspired

PenetrationBet

a Alpha

Sm

oke

Installation

Usability

Page 10: Getting Ready for Tomorrow's Testing

10

Testing TechniquesLearn. Apply.

Static Testing

Dynamic Testing

White Box

Black Box

Equivalence Partitioning

State Transition

Boundary Value Analysis

Pair Wise Testing

Agile Testing

Exploratory Testing

Page 11: Getting Ready for Tomorrow's Testing

11

Testing CertificationsGet Trained. Get Certified. Apply the Knowledge.

ISTQB Foundation

ISTQB Advanced

CSTE

CSQA

PMP

ITIL

Scrum Master

Page 12: Getting Ready for Tomorrow's Testing

12

Deep Domain KnowledgeBetter Test Cases. Better Communication.

Business Workflows

Industry Specific

Many Interfaces to Other Systems

Page 13: Getting Ready for Tomorrow's Testing

13

New AreasLearn. Understand How to Test.

Big Data

Mobile Payments

Cloud

Wearable Technology

Page 14: Getting Ready for Tomorrow's Testing

14

Managing Different TestersProfessionals. Amateurs. Everyone.

Test analyst

QA engineers

Test specialists

Business analysts

Business users

Non Technical

Developers

Page 15: Getting Ready for Tomorrow's Testing

15

Expectations from Customers

Better testing quality

Shorter testing cycles

More testing coverage

Cheaper

Testers with business domain knowledge

Be better informed on testing activities, issues, progress

Testing for new areas – big data, cloud, mobile app, wearable tech, mobile payment

Page 16: Getting Ready for Tomorrow's Testing

16

Expectations from Customers

Better testing quality

Shorter testing cycles

More testing coverage

Cheaper

Testers with business domain knowledge

Be better informed on testing activities, issues, progress

Testing for new areas – big data, cloud, mobile app, wearable tech, mobile payment

Implement Automation Testing

Example: Time taken to run 1000 test cases

70 hrs -

Manual test execution by 5 testers

89% effort savings

Automated test execution by 5 machines

8 hrs -

Page 17: Getting Ready for Tomorrow's Testing

17

Expectations from Customers

Better testing quality

Shorter testing cycles

More testing coverage

Cheaper

Testers with business domain knowledge

Be better informed on testing activities, issues, progress

Testing for new areas – big data, cloud, mobile app, wearable tech, mobile payment

• Outsource

• Leave it to Experts - Engage with Testing Services vendors

• Offshore

• Lower cost centers

• Value

• Staff Augmentation

• Managed Service

• Testing-as-a-Service

• Tools

• Software-as-a-Service

• Concurrent / Term licenses

Page 18: Getting Ready for Tomorrow's Testing

Summary

Page 19: Getting Ready for Tomorrow's Testing

19

Getting Ready for Tomorrow’s TestingSummary

Learn & apply testing techniques for better test coverage

Leverage on technology and tools for short test cycles

Leverage on technology and tools for more accurate test execution

Use advanced features of tools for better ROI

Develop in-depth business domain knowledge

Invest people, for new areas

Leave it to testing experts

Participate in the international community of testers

Page 20: Getting Ready for Tomorrow's Testing

Next Gen Testing Conference Singapore

Keynote Address:Getting Ready forTomorrow’s Testing

Brynley Scully, Head of Testing, Singapore

Hewlett-Packard

Oct-2014

www.unicomlearning.com