1

Standard glossary of terms used in Software Testing

Version 2.2 (dd. October 19th, 2012)

Produced by the Glossary Working Party International Software Testing Qualifications Board

Editor : Erik van Veenendaal (The Netherlands)

Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged. Copyright 2012, International Software Testing Qualifications Board (hereinafter called ISTQB).

2

Contributors Rex Black (USA) Josie Crawford (Australia) Enst Dring (Norway) Sigrid Eldh (Sweden) Isabel Evans (UK) Simon Frankish (UK) David Fuller (Australia) Annu George (India) Dorothy Graham (UK) Mats Grindal (Sweden) Matthias Hamburg (Germany) Julian Harty (UK) David Hayman (UK) Bernard Homes (France) Ian Howles (UK) Juha Itkonen (Finland) Paul Jorgensen (USA) Vipul Kocher (India) Gerard Kruijff (The Netherlands) Fernando Lamas de Oliveira (Portugal) Tilo Linz (Germany) Gustavo Marquez Sosa (Spain) Judy McKay (US) Don Mills (UK) Peter Morgan (UK) Thomas Mller (Switzerland) Avi Ofer (Israel)

Ana Paiva (Portugal) Dale Perry (USA) Ander Pettersson (Sweden) Horst Pohlmann (Germany) Juha Pomppu (Finland) Meile Posthuma (The Netherlands) Erkki Pyhnen (Finland) Maaret Pyhjrvi (Finland) Andy Redwood (UK) Stuart Reid (UK) Piet de Roo (The Netherlands) Steve Sampson (UK) Shane Saunders (UK) Hans Schaefer (Norway) Jurrin Seubers (The Netherlands) Dave Sherratt (UK) Mike Smith (UK) Andreas Spillner (Germany) Lucjan Stapp (Poland) Richard Taylor (UK) Geoff Thompson (UK) Stephanie Ulrich (Germany) Matti Vuori (Finland) Gearrel Welvaart (The Netherlands) Paul Weymouth (UK) Pete Williams (UK)

3

Change History Version 2.2 d.d. MM-DD-2012 This new version has been developed to support the Advanced level syllabi (Version 2012) and the Expert level syllabus Test Management (Version 2011). In addition a new of change request have been implemented in version 2.2 of the ISTQB Glossary. New terms added:

- actor - analytical testing - anti-pattern - API (Application Programming

Interface) testing - atomic condition - attack-based testing - combinatorial testing - CMMI - confidence interval - consultative testing - control chart - control flow testing - convergence metric - custom tool - data quality - defect category - defect management committee - defect triage committee - defect type - domain analysis - effectiveness - embedded iterative development

model - experience-based testing - factory acceptance testing - failover testing - fault injection - feature-driven development - hardware-software integration testing - insourced testing - man in the middle attack - methodical testing - model-based testing - Myers-Briggs Type Indicator (MBTI) - neighborhood integration testing - open source tool - operational profiling - outsourced testing - pairwise integration testing - phase containment - planning poker

Terms changed; - action word driven testing - accuracy - agile testing - big-bang testing - Capability Maturity Model (CMM) - Capability Maturity Model

Integration (CMMI) - classification tree method - Commercial Off-The-Shelft software - condition - condition determination coverage - condition determination testing - critical success factor - Critical Testing Processes - cyclomatic complexity - daily build - data-driven testing - data flow testing - dd-path - defect-based technique - defect-based test design technique - definition-use pair - efficiency - elementary comparison testing - extreme programming - fault seeding - heuristic evaluation - keyword-driven testing - lead assessor - load testing tool - maturity - mind map - modified condition decision coverage - modified condition decision testing - modified multiple condition coverage - modified multiple condition testing - multiple condition coverage - performance profiling - resumption criteria - root cause - software quality - SPI

4

- predicate - process-compliant testing - quality control - quality risk - RACI matrix - reactive testing - regression-averse testing - resumption requirements - review plan - risk assessment - risk impact - risk likelihood - Shewhart chart - short-circuiting - S.M.A.R.T. goal methodology - software integrity level - standard-compliant testing - structure-based technique - SUMI - test architect - test data management - test director - test mission - three point estimation - TMMi - TPI Next - user story - user story testing - WAMMI - Website Analysis and MeasureMent

Inventory (WAMMI)

- static analysis - static testing - stress testing - technical review - test case specification - test design specification - test execution schedule - Test Process Improvement (TPI) - Test Maturity Model (TMM) - Test Maturity Model integration - test procedure specification - testable requirement - thread testing - Total Quality Management

5

Table of Contents

Foreword ................................................................................................................................................................ 6 1. Introduction ....................................................................................................................................................... 6 2. Scope .................................................................................................................................................................. 6 3. Glossary structure ............................................................................................................................................. 6 4. Trademarks ....................................................................................................................................................... 7 5. Definitions .......................................................................................................................................................... 7 A.............................................................................................................................................................................. 7 B ............................................................................................................................................................................ 10 C............................................................................................................................................................................ 11 D............................................................................................................................................................................ 16 E ............................................................................................................................................................................ 19 F ............................................................................................................................................................................ 21 G ........................................................................................................................................................................... 24 H ........................................................................................................................................................................... 24 I ............................................................................................................................................................................. 24 K ........................................................................................................................................................................... 26 L ............................................................................................................................................................................ 26 M ........................................................................................................................................................................... 27 N............................................................................................................................................................................ 30 O ........................................................................................................................................................................... 30 P ............................................................................................................................................................................ 31 R............................................................................................................................................................................ 34 S ............................................................................................................................................................................ 37 T ............................................................................................................................................................................ 42 U............................................................................................................................................................................ 48 V............................................................................................................................................................................ 49 W .......................................................................................................................................................................... 50 Annex A References ............................................................................................................................................ 51

6

Fo