proposal
DESCRIPTION
Bringing Softtek’s Software Testing Organization from Good to World- Class Software Testing Organization. Proposal. Agenda. Mission Statement Vision Statement Goals Assessing Software Testing Capabilities – Your current processes - PowerPoint PPT PresentationTRANSCRIPT
Bringing Softtek’s Software Testing Organization from Good to World-
Class Software Testing Organization
Proposal
Agenda
Mission Statement Vision Statement Goals Assessing Software Testing Capabilities – Your current
processes Process to achieve a world-class software testing
organization Deployment Process Assessing Software Testing Competencies - The quality of
your testers Q&A
Mission Statement
Mission Statement
To bring Softtek’s Software Testing Organization from Good to World-Class Software Testing Organization implementing the Quality Assurance Institute’s (QAI) World-Class Software Testing Model.
Vision Statement
Vision Statement
To be an outsourcing Software Testing Organization leader in providing Quality Control services for our customers.
Goals
Goals
To implement the Quality Assurance Institute’s World-Class Software Testing Organization Model in the organization, to improve Software Testing Capabilities.
To implement the Quality Assurance Institute’s developed Common Body Of Knowledge (CBOK) for a Certified Software Tester (CSTE) in the organization, to improve tester’s competencies.
To have Software Tester’s certified as CSTE within 1 year.
Assessing Software Testing Capabilities- Your Current Processes
Assessing Software Testing Capabilities
Most testing organizations, as well as testers, believe they are doing a good job. However, there is no basis for making that determination.
In order to make that determination, an assessment must be made against a “model” of a world-class testing organization.
During the past 20 years the Quality Assurance Institute has studied many organizations and has developed a model of a world-class testing organization.
Assessing Software Testing Capabilities
The Nine components needed to achieve World-Class Software Testing are:
– Management Support– Processes– Training– Planning– Quality Control– Tools– Efficiency– Test Execution, analysis and Reporting– User Satisfaction
Assessing Software Testing Capabilities – QAI’s Model
UserSatisfacti
on
QualityControl
Executionand
Reporting
Planning Efficiency
Tools/Techniques
Processes Training
Management Support(Testing Environment)
Assessing Software Testing Capabilities
World-Class
Testing
ToolsManagement
Support
Efficiency Training
Planning
Usersatisfaction
Processes
QualityControl
Test ExecutionAnalysis and
Reporting
Drivers of World-Class Testing Desired Result
Cause-Effect-Diagram
Assessing Software Testing Capabilities
User Satisfaction: – To involve the user at key points in the
software testing process: Test Strategy Test Objectives Test Plan Acceptance Testing Reporting the status and results of testing
Assessing Software Testing Capabilities
Quality Control– It raises the question, “Who tests the testers?”
The answer is quality control within the test process evaluates whether the process has been performed correctly.– Assessment to evaluate software testing
organization’s competencies. The following test processes incorporate
quality control as part of the process:
Assessing Software Testing Capabilities
– Eleven-step software testing process– Assess Project Management
Development Estimate and status– Develop Test Plan– Requirements Phase testing– Design Phase Testing– Program Phase Testing– Execute Test and Record Results
Assessing Software Testing Capabilities
– Acceptance Test– Report Test Results– Testing Software Installation– Test Software Changes– Evaluate Test Effectiveness
Assessing Software Testing Capabilities
Testing Specialized Systems and Applications– Testing the Adequacy of System
Documentation– Testing Web-based Systems– Testing Off-the-Shelf Software– Testing Security– Creating Test Documentation
Assessing Software Testing Capabilities
Execution and Reporting– Provides the opportunity to evaluate
executable programs as a system Build Test Data Execute Test Record Test Results Test Report
Assessing Software Testing Capabilities
Planning– If you fail to plan, plan to fail– To plan a test together with the components of
a test plan Develop Test Plan
Assessing Software Testing Capabilities
Efficiency– Involves planning and performing software
testing in a manner that provides the greatest coverage and the maximum assessment of business risks for the resources allocated Establishing a Software Testing Methodology Determining Software Testing Techniques Selecting and Installing Software Testing Tools Evaluate Test Effectiveness
Assessing Software Testing Capabilities
Tools Techniques– Tools are necessary to provide effective and
efficient software testing Processes for selecting and installing
testing tools
Assessing Software Testing Capabilities
Processes– Without processing, testing is an art that is
subject to significant variation in execution Processes bring stability and consistency to
software testing– Building a Software Testing strategy– Eleven –Step Software Testing Process
Assessing Software Testing Capabilities
Training– Effective software testing begins and ends with
education Define the test strategy that must include
training 11 step testing process in which software
testers must be trained
Assessing Software Testing Capabilities
Management Support (Test Environment)– Effective testing requires strong management
support Support is needed so that the test strategy
meets the needs of the business, and appropriate time and resources are available to accomplish that strategy
Establish the need for management’s support by providing a baseline of the current software testing capabilities and competencies
Process to achieve a world-class software testing organization
Process to achieve a World-Class Software Testing Organization
A Four step process to achieve a World-Class Software Testing Organization:
1. Use QAI’s model for setting a strategic quality goal2. Develop a baseline by assessing your current
processes3. Based on the results of the assessment, a long-
range strategy will be developed to maximize the efficiency of the organization
4. Define a quick-payback approach to implement the strategy
Process to achieve a World-Class Software Testing Organization
1. Use QAI’s model for setting a strategic quality goal
UserSatisfacti
on
QualityControl
Executionand
Reporting
Planning Efficiency
Tools/Techniques
Processes Training
Management Support(Testing Environment)
Process to achieve a World-Class Software Testing Organization
2. Develop a baseline by assessing your current processes
1. Build Assessment Team2. Complete Assessment Questionnaires3. Build Kiviatt Chart4. Assess Results
Assessing Current Process- Workbench
AssessmentTesting
performedcorrectly?
Software testing assessment workbench
Knowledge ofSoftware Testing
Activities
Your Statusversus a
World-ClasTesting
Organization
Task 1Build
AssessmentTeam
Task 2Complete
AssessmentQuestionnaires
Task 3Build Kiviatt
Chart
REWORK
DO CHECK
Task 4Assess Results
Process to achieve a World-Class Software Testing Organization
Task 1: Build Assessment Team The assessment team needs to combine people
who in totality possess the knowledge on how software testing is performed in your organization
Task 2: Complete Assessment Questionnaires It is composed of eight categories (Drivers of
World- Class Testing)Task 3: Build Kiviatt Chart
This chart is implemented to transcribe the results of completing Questionnaire
Process to achieve a World-Class Software Testing Organization
Task 4: Assess Results Asses status of each category versus what the
category should be in a world-class testing organization
Interpret your software testing assessment Kiviatt Chart
Task 1: Build Assessment Team
Softtek Testing Services
CompleteAssessment
CompleteAssessment
CompleteAssessment Complete Assessment Complete Assessment
Team Member 1Team Member 2Team Member 3
Team Member 1Team Member 2Team Member 3
Team Member 1Team Member 2Team Member 3
Team Member 1Team Member 2Team Member 3
TestingProject 1
Lead
TestingProject 2
Lead
TestingProject 3
Lead
TestingProject 4
Lead
TestingProject 5
Lead
Team Member 1Team Member 2Team Member 3
Task 2: Assessment Questionnaires
Task 3: Kiviat ChartManagement Support for
Test
Use of Test Processes
Test Tools
Test Traiining
TestEfficiency
Usersatisfactionwith testg
TestQualityControl
TestPlanning
5
4
3
2
1
Task 3: Kiviat Chart
For each category the number of Yes responses should be totaled
A dot should be placed on the kiviat chart on the line representing the number of Yes responses
For example:– If there were three Yes responses for test
planning a dot would be placed on the test planning line at the intersection of the line representing three Yes responses.
Task 3: Kiviat Chart
– A dot should be put on the line representing all eight categories for the number of Yes responses.
– The dots are then connected by a line resulting in what is called a “footprint” of the status of your software testing organization versus a world-class testing organization.
Task 4: Assess Results
Softtek can use the results of this assessment in any of these three ways:
1. Determine Softtek’s current software testing status versus a world-class testing organization. The responses in the area to address will indicate Softtek’s strengths and weaknesses compared to a world-class testing organization
2. Develop a software testing goal to become a world-class testing organization
3. Develop an improvement plan
Deployment Process
Deployment Process
Assessment questionnaires are sent to Test leads Test Leads answer questionnaires Total number of “Yes” are dumped into
Capabilities Assess Results Matrix Kiviat Chart is built Based on Results develop testing goals Develop improvement plan
Deployment Process
Deployment Process
1
Management Supportfor Test
Test Processes
Test Tools
Test Training
TestEfficiency
Usersatisfaction
TestQualityControl
TestPlanning
1
2
3
4
5
Deployment Process
Interpreting Kiviat Results:– The areas that need improvement are:
Test Training Test Efficiency Test Quality Control
Assessing The Quality Of Your Testers
Assessing the quality of your testers
Assessing the Quality of Your Testers– This practice will enable you to assess your
individual testing competencies against the five skill categories in QAI’s Common Body of Knowledge (CBOK) General Skills Test Skills/Approaches Test Planning Executing the Test Plan Test Analysis and Reporting
Assessing the quality of your testers
Test Competency Cause-Effect-Diagram
FullyCompetent
Tester
Test Analysis/Reporting Skills
ManagementSupport
Test Skills/TestApproaches
Test PlanningSkills
Test ExecutionSkills
Drivers of Testing Competency Desired Result
Test Competency Workbench
AssessmentTesting
performedcorrectly?
Test Competency assessment workbench
CSTE CommonBody of
Knowledge
YourCompetencyversus CSTE
CBOK
Task 1Understand
CSTE CBOK
Task 2Complete
AssessmentQuestionnaires
Task 3Build Kiviatt
Chart
REWORK
DO CHECK
Task 4Assess Chart
Assessing the quality of your testers
Task 1: Understand CSTE CBOK Before you can effectively evaluate your software
test competencies, you need to understand the Common Body Of Knowledge (CBOK) for software testing
Task 2: Complete Assessment Questionnaires It is composed of 5 categories (Drivers of Testing
Competency)Task 3: Build Kiviat Chart
This chart is implemented to transcribe the results of completing Questionnaire
World-Class Software Testing Organization Model
Task 4: Assess Chart Assess status of each category versus what
the category should be as indicated in the CSTE CBOK
Interpret your software testing competencies against your current job responsibilities
Task 1: Understand CSTE CBOK
Task 2: Complete Assessment
Task 3: Kiviat Chart
Test Skill/ Approaches
Test Planing
Test Execution
TestAnalysis,Reporting
andIvement
GeneralSkills
100%
80%
60%
40%
20%
Task 3: Kiviat Chart
For each of the five questionnaires, total the number of Yes responses.
Convert the number of Yes responses to a percentage by multiplying the number of Yes responses by 10 (e.g., 3 Yes responses x 10= 30%)
Transcribe the percentage for each of the five questionnaires.
For the lines corresponding to the questionnaire name, put a dot on the kiviat chart for the percentage of Yes responses for that assessment competency category.
Task 4: Assess Chart
Any rating less than 100 percent indicates a potential area of improvement in that skill category
Interpret your software testing competencies against your current job responsibilities
Q&A
Any Questions….