1. iso/iec 29119 2. iso/iec 33063 (testing assessment...

Software testing standards ISO/IEC

29119 and 33063

1. ISO/IEC 29119

2. ISO/IEC 33063 (testing assessment, testing Spice)

Ossi Taipale, Heikki Uusitalo

FISMA r.y, ISO/IEC SC7

Software testing standards ISO/IEC

29119

Contents of the ISO/IEC 29119 testing standard

Part 1 Concepts and Definitions

Part 2 Testing Process

Part 3 Test Documentation

Part 4 Test Techniques

ISO/IEC 29119 Part 1: Concepts

and Definitions

Scope

This standard covers definitions and concepts in systems and software

testing.

Example, testing: set of activities conducted to facilitate discovery and/or

evaluation of properties of one or more test items

Generic process

Testing can be described as a process. A process is a set of interrelated or

interacting activities that transforms inputs into outputs. The objective of

this standard is to present and describe a generic testing process.

Life cycle models

Agile

Evolutionary

Sequential (i.e. the waterfall model)


and Definitions

Static testing

Testing can be carried out on a product without executing the product on a

computer. This is called static testing in this standard and in many areas of

the industry, although other standards (e.g. IEEE1028, Standard for

Software Reviews and Audits) may more specifically call this reviews,

walkthroughs or inspections.

For static testing this standard acknowledges and identifies the role of the

tester in these activities even though they may be “owned” by other groups

or standards within a project. This is because the static testing activities

are considered highly important for complete lifecycle testing and test

involvement has been shown to be critical for early defect detection,

reduced overall project costs and an improved ability to meet schedule

demands.


and Definitions

The Role of Testing in Verification and Validation

This standard addresses only parts of the verification and validation

activities. Other standards, e.g. ISO/IEC 12207, Software life cycle

processes, address other verification or validation activities. Testing, as

described in this standard, addresses both dynamic and static testing as

well as associated sub processes and activities. This standard does not

address, except in passing, demonstration activities or validation and

verification. To provide complete validation and verification of a product an

organization will need to use this standard in conjunction with other

standards as part of a comprehensive engineering program. See Annex A

for a diagram of verification and validation activities. (IEEE 1012, Standard

for Software Verification and Validation)

ISO/IEC 29119 Part 2: Test Process

The multi-layer test process

Three levels, the approach is risk-based


The multi-layer model showing all test processes


Example test management process relationships

Dynamic test processes


ISO/IEC 29119 Part 3: Test

Documentation

Test Documentation, includes templates and examples of test

documentation that are produced during the test process.

The test documentation in this International Standard describes

the output of the processes specified in part two of this standard.


Techniques

The test techniques in this

International Standard are used to

derive the test cases executed as

part of the dynamic testing

process specified in part two of

this standard.


Techniques

Test Coverage Measurement

The coverage measures defined in this part of the standard are based

on test design technique coverage.

Coverage levels can range from 0% to 100%.

Quality Characteristics

Software testing can be carried out to collect evidence that required

quality criteria have been satisfied by a test item. Required quality

characteristics should be specified in the test basis. Definitions of quality

characteristics could be derived from ISO/IEC 25010 System and

Software Product Quality Requirements and

Evaluation (SQuaRE) – System and Software Quality Models.

Mapping Quality Characteristics (ISO/IEC 25010) to Test Design Techniques

and Types of Testing


Techniques

ISO/IEC 33063 Testing assessment

1. iso/iec 29119 2. iso/iec 33063 (testing assessment...

Documents