Ewald Roodenrijs

Testing the Future of Testing

Remarkable things

Program

Crowdtesting—What is crowdtesting?—What are the benefits of crowdtesting?—What are the conditions for crowdtesting?

Augmented Reality—What is Augmented Reality?—What is the Augmented Reality test approach?

Crowdsourcing + testing = crowdtesting

Crowdsourcing an option of sourcing—Design—Developing—Testing—Marketing

What is crowdtesting?

—Use of crowdsourcing on testing—New phenomenon—Substitute to traditional testing—Focus on acceptance—Inspiration from Open Source movement

The use of an unknown crowd of

people and knowledge when

testing software applications or

systems

What can crowdtesting do?

—Crowdtesting can help when testing applications—Crowdtesting can complement in-house resources at a practical, tactical level—Crowdtesting enables to tap into the creativity and diversity of a global community of skilled professionals

Systemtests

Development

tests

Acceptance

tests

Realisation

Functional design

Operation &

Management

wish, legislation, policy, opportunity, problem

Technical design

Requirements Crowdtesting

Key benefits for the customer

Cost containmen

t Dealing with

Increased complexit

y

Faster time to market

Meeting expectatio

ns

Keeping your

customers

Empowering the user

Conditions for crowdtesting

Crowd

Crowd build-up—Experts—Novice—Specialists—(Potential) users

Testing environment

Control—Portion software—Questionnaire—The crowd

Sensitivity

Con

trol

Open Confidential Classified

High

Low

Mortage calculation

National security system

Usability check

3rd party update

Game

Webshop

Conclusion

•Crowd consisting of diverse and talented people

•Pay-per-view performance basis

•Applications reach market faster

•Higher levels of quality

•Lower cost

Program

Crowdtesting—What is crowdtesting?—What are the benefits of crowdtesting?—What are the conditions for crowdtesting?

Augmented Reality—What is Augmented Reality?—What is the Augmented Reality test approach?

17 augustus 2009

Examples of Augmented Reality

Advertising

Product enrichment

Home design

Business cards

E-learning

Gaming

Travel

Legislation

Product enrichment

Travel

E-learning

What is Augmented Reality?

Augmented Reality is software that deals with the

combination of real-world and computer-generated

data (virtual reality)

AR blends computer graphics with the real world

Live video imagery ‘augmented’ with computer generated graphics

Software for:—3D reconstruction—Fiduciary markers or GPS/compass—Image registration—Structure from motion—Video tracking

in real time

Hardware testing

An embedded system for Augmented Reality—Interfaces between software within the system of other systems

Embedded components of AR—Camera—Microphone—Mobile phone (optional)—Glasses—Contact lenses

Standard components

Standard software

Software

Hardware

Custom made

software

Functional testing

Testing AR according to normal testing techniques

Checklist is needed—Connectivity—Reliability—Flexibility—Security—Usability—Testability

Functional testing the integrated components because of the highest risk of failure.

Standard components

Standard software

Software

Hardware

Custom made

software

Task-Based Testing

Test the integration of the system in tasks —Install—User interface check—Import/export—Help—Reports—Functional—error handling

Functional example: Is it possible to turn car 180o?

Function 1

Function 2

Function 3

Function 4

Function 5

Function 6

Function 7

Function COMPARE CARS

Standard components

Standard software

Software

Hardware

Custom made

software

Conclusion

•Normal test life cycle (like TMap NEXT®)

•The hardware testing is done as an embedded system

•Augmented Reality needs a Task-Based Testing approach to test the functionality and usability of the software