"iso 29119 - the new set of international standards on software testing" with stuart reid
DESCRIPTION
view webinar: http://www.eurostarconferences.com/community/member/webinar-archive/webinar-75-iso-29119---the-new-set-of-international-standards-on-software-testing In May 2007 ISO formed a working group to develop new standards on software testing - a new area for ISO - the first three of these standards were published in September 2013. This initiative is closely-supported by IEEE and BSI, both of which have donated existing standards as source documents to the project (these standards will be retired as the new standards are published). There are currently six new software testing standards either published or in development: Concepts and Terminology (ISO/IEC/IEEE 29119-1) Test Processes (ISO/IEC/IEEE 29119-2 Test Documentation (ISO/IEC/IEEE 29119-3) Test Techniques (ISO/IEC/IEEE 29119-4) Keyword-Driven Testing (ISO/IEC/IEEE 29119-5) Test Assessment (ISO/IEC 33063) This webinar will initially introduce the purpose of standards in general as there are quite a few widely-held misconceptions on standards. Next we will look at why there is a need for internationally-recognized software testing standards, followed by a brief look at how they have been developed. The main part of the webinar will cover what standards are included in ISO 29119, their content, and how they are related. How these standards apply to your work, the current status of each of the standards, and details of how you can get involved, will be explained at the end. ISO 29119 has already been released in draft form for review (and subsequently been updated based on literally thousands of comments) and is already being used within a number of multi-national organizations. These organizations are already seeing the benefits of reusing the well-defined processes and documentation provided by a standard reflecting current industry best practices.TRANSCRIPT
![Page 1: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/1.jpg)
www.eurostarconferences.com
Welcome to the 2013
This webinar is presented by Stuart Reid and he will discuss:
‘ISO 29119 - the new international software testing standards’
Join us on Twitter! @esconfs #esconfs
![Page 2: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/2.jpg)
www.eurostarconferences.com
Scope
• The purpose of standards• Motivation for software testing standards• Development of standards• Overview of ISO 29119• Applicability• Timeline• Future involvement
@esconfs#esconfs
![Page 3: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/3.jpg)
What are standards?
• Guidelines documents as they are not compulsory unless mandated by an individual or an organization
• Agreements because they should reflect a certain level of consensus
“Guideline documentation that reflects agreements on products, practices, or operations by nationally or internationally recognized industrial, professional, trade associations or governmental bodies”
- ISO
www.eurostarconferences.com@esconfs#esconfs
![Page 4: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/4.jpg)
www.eurostarconferences.com
Why use standards?
• Consumers• Confidence in compliant products• Authors provide expertise in standards
• Manufacturers• Conformance and Marketing• ‘Safety’ from liability• Guidelines on production
• But not ‘Best Practice’…
@esconfs#esconfs
![Page 5: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/5.jpg)
Quality and Standards
www.eurostarconferences.com@esconfs#esconfs
![Page 6: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/6.jpg)
What use are standards?
• Basis for:• Communication – common terminology• Professional qualifications• Certification/compliance schemes• Benchmark of ‘good industry practice’• Contracts• Interoperability and consistency……
Standards describe a current ‘body of knowledge’ that provides the basis for a professional discipline
www.eurostarconferences.com@esconfs#esconfs
![Page 7: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/7.jpg)
A Case in Point
www.eurostarconferences.com@esconfs#esconfs
![Page 8: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/8.jpg)
www.eurostarconferences.com
Motivation for ISO 29119
• Demand for existing 'standards’• Conflicts in current definitions and processes• Gaps in the current standards provision• A Baseline for the Testing Discipline• Current industry practice is lacking• Buyers unclear on what is 'good test practice'
@esconfs#esconfs
![Page 9: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/9.jpg)
www.eurostarconferences.com
Standardization Bodies
@esconfs#esconfs
![Page 10: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/10.jpg)
www.eurostarconferences.com
ISO/IEC Software Standards
19871988
19891990
19911992
19931994
19951996
19971998
19992000
20012002
20032004
20052006
20072008
20092010
20112012
0
20
40
60
80
100
120
140
160PublishedMaintained
@esconfs#esconfs
![Page 11: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/11.jpg)
www.eurostarconferences.com
ISO/IEC JTC1 SC7 – WG26
ISO
TC176Quality
JTC1Information Technology
SC7Software &
Systems Engineering
WG2 ..................
WG26Software Testing
Representatives of National Standards
Bodies
SC22Programming
Languages
SC27IT Security
SC32Data
Management & Interchange
IEC
TC56Dependability
@esconfs#esconfs
![Page 12: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/12.jpg)
ISO/IEC 29119 – Structure
www.eurostarconferences.com@esconfs#esconfs
![Page 13: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/13.jpg)
Part 1: Concepts & Vocabulary
www.eurostarconferences.com@esconfs#esconfs
![Page 14: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/14.jpg)
Part 2: Testing Processes
TEST MANAGEMENT PROCESSES
ORGANIZATIONAL TEST PROCESS
DYNAMIC TEST PROCESSES
www.eurostarconferences.com@esconfs#esconfs
![Page 15: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/15.jpg)
www.eurostarconferences.com
TEST MANAGEMENT PROCESSES
ORGANIZATIONAL TEST PROCESS
DYNAMIC TEST PROCESSES
Instantiating Testing Processes
@esconfs#esconfs
![Page 16: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/16.jpg)
ISO 29119 Test Processes
www.eurostarconferences.com@esconfs#esconfs
![Page 17: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/17.jpg)
Organizational Test Process
www.eurostarconferences.com@esconfs#esconfs
![Page 18: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/18.jpg)
Test Management Processes
www.eurostarconferences.com@esconfs#esconfs
![Page 19: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/19.jpg)
Test Planning Process
www.eurostarconferences.com@esconfs#esconfs
![Page 20: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/20.jpg)
www.eurostarconferences.com
Test Monitoring & Control Process
@esconfs#esconfs
![Page 21: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/21.jpg)
Dynamic Test Processes
www.eurostarconferences.com@esconfs#esconfs
![Page 22: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/22.jpg)
www.eurostarconferences.com
Test Process Description - Organizational Test Process • Each testing process is described using a standard template (following ISO 24774), for example:
• Purpose• The purpose of the Organizational Test Process is to develop and maintain organizational test specifications, such as the Test Policy and Organizational Test
Strategy.• Outcomes
• As a result of the successful implementation of the Organizational Test Process:• The organizational test specification is developed based on stakeholder requirements;• The organizational test specification is agreed by stakeholders;• The organizational test specification is published and accessible to stakeholders;• Conformance of stakeholders with the organizational test specification is managed;• The organizational test specification is reviewed on a periodic basis;• Minor updates to the organizational test specification are made as necessary.
• Activities and tasks• The tester shall implement the following activities and tasks in accordance with applicable organization policies and procedures with respect to the
Organizational Test Process.• Develop Test Specification
• This activity consists of the following tasks:• Analyze any relevant source documents and the current testing practices within the organization to identify requirements for the
organizational test specification.• etc.
• Gain Consensus on Test Specification• etc.
• Information items• The output of the Organizational Test Process is the organizational test specification. The Organizational Test Policy and Organizational Test Strategy are
typical examples of organizational test specifications.
@esconfs#esconfs
![Page 23: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/23.jpg)
www.eurostarconferences.com
Part 3 – Test Documentation
TEST DOCUMENTATION
ANNEXES - EXAMPLES
Scope, Conformance, Normative References
@esconfs#esconfs
![Page 24: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/24.jpg)
www.eurostarconferences.com
Part 3: Test Documentation
• Organizational test documentation• Test policy• Test strategy
• Project test documentation • Project test plan• Test project completion report
• Test level documentation• Test plan• Test specification • Test results• Anomaly reports• Level test status report• Test environment report • Test level completion report
@esconfs#esconfs
![Page 25: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/25.jpg)
www.eurostarconferences.com
Part 4 – Test Techniques
@esconfs#esconfs
![Page 26: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/26.jpg)
www.eurostarconferences.com
Are they applicable to you?
• Intended to be a generic standards• Full vs. tailored conformance• Small and large organizations• Agile and Traditional• Financial, Safety-Critical, Games...• Following Regulatory Standards?
• Can you afford not to?
@esconfs#esconfs
![Page 27: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/27.jpg)
www.eurostarconferences.com
Current Status
@esconfs#esconfs
![Page 28: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/28.jpg)
www.eurostarconferences.com
Conclusions
• Parts 1, 2 & 3 published September 2013• International standard will provide practitioners with guidelines for
testing that cover all aspects of the life cycle• Provides a consistent set of definitions, processes, procedures & techniques
for software testing
• Will be adopted by IEEE, BSI, ISO and other national standards bodies• Get involved – through your national standards body
@esconfs#esconfs
![Page 29: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/29.jpg)
www.eurostarconferences.com
Finally…
• [email protected]• if you have any questions on the standards• if you are interested in trialling the standard on a project, reviewing drafts or
writing examples
• http://softwaretestingstandard.org/• WG26 website
• http://www.jtc1-sc7.org/• access to official documents released by WG 26
@esconfs#esconfs
![Page 30: "ISO 29119 - The New Set of International Standards on Software Testing" with Stuart Reid](https://reader036.vdocuments.net/reader036/viewer/2022062319/554f3818b4c905471e8b47d9/html5/thumbnails/30.jpg)
Thanks for listening!
@esconfs#esconfs www.eurostarconferences.com
Go to www.eurostarconferences.com for more information