pittsburgh, pa 15213-3890 software design-for-six...

Pittsburgh, PA 15213-3890

ASQ Webinar

March 2, 2007

Software Design-for-Six Sigma (SDFSS) is Emerging!

By Robert W. StoddardMotorola Six Sigma Master Black BeltSenior Member of Technical StaffSoftware Engineering Institute

This material is approved for public release.

Sponsored by the U.S. Department of Defense© 2005 by Carnegie Mellon University

© 2005 by Carnegie Mellon University page 2

ASQ Webinar

March 2, 2007

CMU Service MarksThe following are service marks of Carnegie MellonUniversity:• Personal Software ProcessSM

• PSPSM

• Team Software ProcessSM

• TSPSM

The following are registered in the U.S. Patent & Trademark Office by Carnegie Mellon University:• Capability Maturity Model®• CMM®• Capability Maturity Model Integration®• CMMI®• SEI’s Architecture Tradeoff Analysis Method®• ATAM®


ASQ Webinar

March 2, 2007

Product Experience


ASQ Webinar

March 2, 2007

SDFSS OpportunitiesImpacts without SDFSS

• Multi-year development projects failed to deliver a working product (min cost=$7M)

• Failure 1: Did not model performance of new chipset, processor or language

• Failure 2: Did not adequately characterize the market and business case

• Failure 3: Did not adequately test the product

Benefits with SDFSS

• Business cases modeling all reasonable uncertainties in market and customer segments

• Schedules with uncertainties modeled

• Req’ts identified, with KJ analysis, to delight customers

• Design of Experiments used to: optimize and patent fuel efficiency; test object-oriented software; test robustness with fault insertion testing; reduce flight test by 10x


ASQ Webinar

March 2, 2007

Purpose of this Talk

• To proclaim that software DFSS, within a holistic DFSS approach to product development, is coming of age,

• To demonstrate that many gaps, in translating traditional DFSS concepts to software engineering, may be solved by the adoption of a number of Software Engineering Institute (SEI) technologies.

Thus, DFSS does not have to be re-invented for Software Engineering!


ASQ Webinar

March 2, 2007

Target Audience

• Executives and Directors contemplating investing in Software DFSS

• Deployment champions who may be tasked with the training and roll-out of Software DFSS

• DFSS and Software Engineering Leaders who need to understand both disciplines, and who can lead in translating and interpreting key concepts and tools between the two disciplines.


ASQ Webinar

March 2, 2007

Holistic View of Software DFSS

Portfolio for Six Sigma

Product Commercialization for Six Sigma

Technology Platform R&D for Six Sigma

Marketing for Six Sigma

Sales & Distribution for Six Sigma

Supply Chain for Six Sigma


ASQ Webinar

March 2, 2007







The SEI Capability Maturity Model

Integrated (CMMI)has a product development

perspective that overlaps

significantly with all of the DFSS

methodologies!

SEI Technologies Boost DFSS!


ASQ Webinar

March 2, 2007

The CMMI, TSP and PSP

Reference: “The Great

Myths About TSP

SMand

CMMI®” by McHale, 2006


ASQ Webinar

March 2, 2007

CMMI Models

• Systems Engineering

• Software Engineering

• Integrated Product and Process Development

• Supplier Sourcing

CMMI-SE/SW/IPPD/SS(Continuous)

CMMI-SE/SW/IPPD/SS(Staged)

CMMI-SE/SW/IPPD(Continuous) CMMI-SE/SW/IPPD

(Staged)

CMMI-SE/SW(Continuous) CMMI-SE/SW

(Staged)

CMMI-SW(Continuous)

CMMI-SW(Staged)

Bodies of Knowledge

Model Framework


ASQ Webinar

March 2, 2007

The Maturity Levels

1

2

3

4

5

Process unpredictable, poorly controlled, and reactive

Process characterized for projects and is often reactive

Process characterized for the organization and is proactive

Process measuredand controlled

Focus on continuous process improvement

Optimizing

QuantitativelyManaged

Defined

Initial

Managed

Optimizing

Defined


ASQ Webinar

March 2, 2007

5

4

3

2

Quantitative Project Management

Organizational Process Focus

Organizational Process Definition

Organizational Training

Project Planning

Project Monitoring and Control

Supplier Agreement Management

MaturityLevel

Project ManagementProcess Management Engineering Support

Organizational Innovation and Deployment

Organizational Process Performance

Requirements Development

Technical Solution

Product Integration

Verification

Validation

Decision Analysis and Resolution

Organizational Environment for Integration

Integrated Project Management for IPPD

Risk Management

Integrated Teaming

Integrated Supplier Management

Requirements Management

Measurement and Analysis

Process and Product Quality Assurance

Configuration Management

Causal Analysis and Resolution

PAs by Both Representations


ASQ Webinar

March 2, 2007

Performance Results Summary

Improvements Median# of data

points Low High

Cost 34% 29 3% 87%

Schedule 50% 22 2% 95%

Productivity 61% 20 11% 329%

Quality 48% 34 2% 132%

Customer Satisfaction 14% 8 -4% 55%

Return on Investment 4.0 : 1 22 1.7 : 1 27.7 : 1

● N = 30 organizations, as of June 2006● Results expressed as change over varying periods of time

Reference: “Benefits of CMMI”, European SEPG, Goldenson, 2006


ASQ Webinar

March 2, 2007

The CMMI Performance Results Web SiteResults by:• Performance category & organization• Brief statements & graphical examples• Full source documents

http://www.sei.cmu.edu/cmmi/results.html

http://www.sei.cmu.edu/cmmi/results.html


ASQ Webinar

March 2, 2007








The SEI Team Software Process (TSP) and Personal Software Process (PSP) significantly

enhance the software development teaming within Product Commercialization and

Technology Platform R&D for Six Sigma!


ASQ Webinar

March 2, 2007

The Personal Software Process

Reference: “The TSP and PSP Tutorial” by the SEI (Burton, Davis, McHale), 2000


ASQ Webinar

March 2, 2007

PSP vs non-PSP ResultsProject A: • Disciplined team design process used to create sound

developer work packets• Personal Software Process used consistently by developers

SEI developed course for software developers which provides process at an individual level for producing software components and documentation (user & technical)

• Peer Reviews conducted on the most critical 20% of the software

Project B:• We decided that this project was “too far along” to benefit

from process insertion

Reference: 3rd Annual CMMI Technology Conference and User Group, Kent Schneider, 2003


ASQ Webinar

March 2, 2007

PSP vs non-PSP Test Time & Cost

Project A Project B

Integration / Acceptance Test Cost

$78.K $612K

Normalized (per KLOC) $0.95K $4.05K

Time to Accept (months) 3.7 14.6

Normalized (months per 100 KLOC)

4.5 9.7



ASQ Webinar

March 2, 2007

PSP vs non-PSP Quality

Project A Project B

Duration (months) 31.8 43.0

Size (KLOC) 82 151

Developer Defect Density 9.4 17.3

Peer Review Exit Density 4.78 17.3

Delivered Defect Density 1.55 5.27



ASQ Webinar

March 2, 2007

TSP Builds Software Teams



ASQ Webinar

March 2, 2007

The TSP Launch Process



ASQ Webinar

March 2, 2007

Benefits Seen from TSP

Reference: Keynote at European SEPG, John Vu, 2001


ASQ Webinar

March 2, 2007

Additional Benefits from TSP


ASQ Webinar

March 2, 2007








The SEI Product Line Practice work overlaps significantly with both

Portfolio for Six Sigma, and Technology Platform R&D

for Six Sigma!


ASQ Webinar

March 2, 2007Reference: “Software Product Lines”, Paul Clements, Linda Northrop, 2003.


ASQ Webinar

March 2, 2007

Product Line Practice Framework

Reference: “Software Product Lines”, Paul

Clements, Linda Northrop, 2003.


ASQ Webinar



ASQ Webinar

March 2, 2007








The SEI Software Architecture work overlaps significantly with both Portfolio for Six Sigma, Product Commercialization for Six Sigma, and Technology Platform R&D

for Six Sigma!


ASQ Webinar

March 2, 2007

Reference: “Future Directions of the Software Architecture Technology Initiative”, Second Annual SATURN Workshop, Mark Klein, 2006


ASQ Webinar

March 2, 2007Reference: “Future Directions of the Software Architecture Technology Initiative”, SATURN Workshop, Mark Klein, 2006


ASQ Webinar

March 2, 2007

Reference: “Future Directions of the Software Architecture Technology

Initiative”, Second Annual SATURN Workshop, Mark Klein, 2006


ASQ Webinar

March 2, 2007

ATAM Benefits Observed by Bosch

Reference: “Architecture Reviews @ Bosch”, 1st SEI SATURN, Ferber, 2005


ASQ Webinar

March 2, 2007


ASQ Webinar

March 2, 2007

In SummarySoftware DFSS, within a holistic DFSS approach to product development, is coming of age,

Many gaps, in translating traditional DFSS concepts to software engineering, may be solved by the adoption of a number of Software Engineering Institute (SEI) technologies.

Thus, DFSS does not have to be re-invented for Software Engineering!


ASQ Webinar

March 2, 2007

Referenceshttp://www.sei.cmu.edu/tsp/The Team Software Process (TSP) in Practice: A Summary of Recent ResultsCMU/SEI-2003-TR-014 (see also CMU/SEI-2000-TR-015)Noopur Davis, Julia MullaneyRelating the Team Software Process (TSP) to the Capability Maturity Model for Software (SW-CMM)CMU/SEI-2002-TR-008Noopur Davis, Jim McHale, with Strategy & Overview by Watts HumphreyThe Personal Software Process (PSP)CMU/SEI-2000-TR-022The Team Software Process (TSP)CMU/SEI-2000-TR-023Watts Humphrey


ASQ Webinar

March 2, 2007

Information SourcesThere are several sources of information and many types of information available to you about CMMI.Sources include• The CMMI Web site (www.sei.cmu.edu/cmmi/)• SEI Partner organizations

(www.sei.cmu.edu/collaborating/ partners/partners-tech.html)• Online forums of CMMI users (www.sei.cmu.edu/cmmi/

adoption/knowledge-exchange.html)• Conferences and other events (www.sei.cmu.edu/cmmi/

adoption/cmmi-events.html)• Written publications (www.sei.cmu.edu/cmmi/adoption

/adoption.html• CMMI-related courses (www.sei.cmu.edu/cmmi/training

/training.html)


ASQ Webinar

March 2, 2007

Contact InformationRobert StoddardSoftware Engineering Institute (Office 3110)4500 Fifth AvenuePittsburgh, PA [email protected]

Or, contact SEI Customer Relations:Customer RelationsSoftware Engineering InstituteCarnegie Mellon UniversityPittsburgh, PA 15213-3890FAX: (412) [email protected]

mailto:[email protected]


ASQ Webinar

March 2, 2007

Questions?

pittsburgh, pa 15213-3890 software design-for-six...

Documents