advanced quality auditing - asqrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · advanced...
TRANSCRIPT
![Page 1: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/1.jpg)
Advanced Quality AuditingAn Auditor’s Review of Risk Based Thinking,
Lean Improvement and Data Analysis
Lance B. Coleman, ASQ Senior Member, CQE, CSSGB, CQA, CBA
Principal ConsultantFull Moon Consulting
Tempe, AZ [email protected]
(C) 480-907-8587
FULL MOON CONSULTING
Catalysts for transformative change ♦ Catalysts for transformative change ♦ Catalysts for transformative change
![Page 2: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/2.jpg)
q ASQ Lean Enterprise Division Education Chair
q ASQ Senior Member, CQE, CSSGB, CQA, CBA
q ASQ CQA Exam Preparatory Course Instructor
q AAS EET, Southern Polytechnical University
q Author, The Customer Driven Organization:Using the Kano Model (Productivity Press, 2014.)
q Author, Advanced Quality Auditing: An Auditor’s Review of Risk Management, Lean Improvement and Data Analysis (Quality Press, 2015)
Lance B. Coleman
![Page 3: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/3.jpg)
(C) 2015 Lance B. Coleman
![Page 4: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/4.jpg)
(C) 2015 Lance B. Coleman
Audit Program
The audit program can be thought of as a performance platform that rests on the three pillars ofq Complianceq Improvementq Risk Management
![Page 5: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/5.jpg)
(C) 2015 Lance B. Coleman
Quality Management System
There are 4 phases through which a quality management system may evolve:
q Precertification
q Newly Certified
q Beyond Certification
q World Class
![Page 6: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/6.jpg)
(C) 2015 Lance B. Coleman
Audit Program EvolutionPhase 3 – Beyond Certification Phase 4 – World Class
•Starting to talk to other systems•Beginning to shift focus from compliance based to integrated system•Action planning based on data analysis•Higher visibility of audit results
•Fully integrated with other systems•All three pillars of auditing clearly evident•Clearly defined and appropriate reporting strategy
Phase 1 – Precertification Phase 2 – Certified
•Seeking structure and control•Backward facing•Reactive
•Compliance and correction driven•“Fleshing out” the system•Data collection and reporting
![Page 7: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/7.jpg)
(C) 2015 Lance B. Coleman
Defining RiskRisk – combination of the probability of occurrence of harm and the severity of that harm.
ISO 14971:2007Risk – the effect of uncertainty on objectives
ISO 31000:2009Risk – the effect of uncertainty on desired results
ISO 9001:2015 DIS
![Page 8: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/8.jpg)
(C) 2015 Lance B. Coleman
Where does risk lie in our process?
1. Complexity of the process2. Complexity of the product3. Criticality of the product4. Process location of the product5. Newness of the product6. Newness of employees7. History of the process
![Page 9: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/9.jpg)
(C) 2015 Lance B. Coleman
How do audits help manage risk?
1. Audit frequency2. Sample size3. Complexity of audit plan4. Containment5. Corrective action plans6. Effectiveness verification7. Special training
![Page 10: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/10.jpg)
(C) 2015 Lance B. Coleman
Applying Risk Based Thinking
Minor Major CriticalViolation of internal procedure or work instruction; Current practice that meets requirement is not accurately documented. Could lead to failure of part attributes
Violation of customer requirement or internal requirement. Systemic or chronic failure of QMS requirement. Multiple related minor violations. Issue that could lead to failure of either part function or part variables. . Ethical violations. Or issue that could cause great harm to other operations.
Noncompliance that is itself a hazard or may lead to hazardous condition. Direct violation of ISO standards or cGMP. Issue that could directly lead to field failure of finished good. Legal violations. Lost required record or procedure. Zero documented evidence of compliance.
![Page 11: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/11.jpg)
(C) 2015 Lance B. Coleman
Risk Based Quality Auditing
q Level 1 – plan and report based on QMS process
q Level 2 - Evaluate degree to which RM is used within each QMS process
q Level 3 - Determine enterprise-level risks related to QMS processes
![Page 12: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/12.jpg)
(C) 2015 Lance B. Coleman
RBQA Types
q Directly audit the risk management (RM) program itself (Level 3)
q Conduct RBQA of aspects of the QMS or of the QMS as a wholeo Standalone risk management audit of QMS
elements (Level 2)o Incorporate risk management into existing
audits (Level 1)
![Page 13: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/13.jpg)
(C) 2015 Lance B. Coleman
Risk Management Program Auditing
1. Confirm that results from the risk management program are reported as necessary to appropriate levels of management.
2. Confirm that existing risk management procedures and work instructions are followed.
3. Ensure that organizational training supports the risk management program
4. Confirm that adequate resources are supplied to meet the goals of the risk management program
5. Confirm that risk models are periodically reviewed and assessed to determine the need for update.
![Page 14: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/14.jpg)
(C) 2015 Lance B. Coleman
Scenario
An auditor visits a machine shop and witnesses a welding operation where sparks are flying in the immediate vicinity. The operator is following their instructions and wearing the appropriate PPE, but the auditor notices a small puddle of oil on the floor nearby.
Discuss potential findings from both a compliance and risk based perspective.
![Page 15: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/15.jpg)
(C) 2015 Lance B. Coleman
Risk is the CompassTM Model1
q Enablers – Activities or controls such as clear work instructions, operator training program, calibrated/maintained equipment instituted in order to insure that a process is carried out properly.
q Risks – those hazards or conditions such as newness of the product, complexity of the process, and poor lighting that work against successful implementation of a process
1 – Developed by Denis Devos of Devos & Associates
![Page 16: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/16.jpg)
(C) 2015 Lance B. Coleman
Risk is the CompassTM Model1
PROCESS STEP RISKS ENABLERS ADEQUACYStep 1 Step 1 Risks Step 1 Enablers Are the process step 1 enablers
adequate to overcome associated risks
Step 2 Step 2 Risks Step 2 Enablers Are the process step 2 enablers adequate to overcome associated risks
![Page 17: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/17.jpg)
(C) 2015 Lance B. Coleman
Risk Management
How do we formally integrate risk management into the audit program?
• By tying finding classification to risk assessment
• Let finding risk dictate actions taken• Let finding risk dictate report distribution• Establish feedback loop to risk management
program
![Page 18: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/18.jpg)
(C) 2015 Lance B. Coleman
RBQA Review
q Risk based thinking evaluates and responds to occurrences based on risk using risk management tools
q RBQA can be incorporated into existing audits or conducted as standalone audits
q It is important that once process risks are identified that enablers are developed as countermeasures
![Page 19: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/19.jpg)
(C) 2015 Lance B. Coleman
Auditing for Improvement
Lean and Six Sigma tools can be integrated into current audit methodology in order to develop a more robust, value added, and continuous improvement driving internal audit program.
![Page 20: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/20.jpg)
Lean vs. Six Sigma
Lean drives improvement by reducing process waste and production cycle time
Six Sigma drives improvement by reducing overall process variation and eliminating special cause variation
![Page 21: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/21.jpg)
(C) 2015 Lance B. Coleman
Tool Deployment
Three opportunities to incorporate Lean and Six Sigma tools into auditingq SIPOC Diagramsq Value Stream Mappingq Control Charts
![Page 22: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/22.jpg)
(C) 2015 Lance B. Coleman
Tool DeploymentValue Stream Mapping
• Value add vs non-value add activities• Potential process bottlenecks• Opportunities to match cycle to takt time
SIPOC Diagrams• Identify implicit needs• Identify input value streams
Control Charts• Trending• Training • Equipment Discrimination
![Page 23: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/23.jpg)
(C) 2015 Lance B. Coleman
SIPOC DIAGRAMProcess Name: SIPOC Date:
Process Owner: SIPOC Rev.:
Facilitated By: Notes:Input Provided By:
Suppliers Inputs Outputs(Providers of the required resources)
(Resources required by the process)
(Deliverables from the process)
Requirements Requirements
SIPOC
Process Customers(Top level description of the activity) (Stakeholders who place the requirements on the
outputs)
Inputs
Process
Output
![Page 24: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/24.jpg)
(C) 2015 Lance B. Coleman
Page 24
Suppliers Inputs Outputs(Providers of the required resources)
(Resources required by the process)
(Deliverables from the process)
Requirements Requirements
Process Customers(Top level description of the activity) (Stakeholders who place the requirements on
the outputs)
Inputs
Process
Output
2. Identify
the outputs
3. Identify the
customers for each output
4. List the requirements for each
output
5. List the
inputs
6. Identify
the supplier for each
input
7. List the requirements
for each input
Start Boundary
1. Identify the process
and it’s boundaries
EndBoundary8. Analyze SIPOC
(Scope, Team, Data & Gaps)
![Page 25: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/25.jpg)
(C) 2015 Lance B. Coleman
Traditional Receiving Audit
![Page 26: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/26.jpg)
(C) 2015 Lance B. Coleman
Receiving Audit VSM
![Page 27: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/27.jpg)
(C) 2015 Lance B. Coleman
Control Charts
• Monitor a process• Assess process control• Assess process capability
Why do we use control charts?
![Page 28: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/28.jpg)
(C) 2015 Lance B. Coleman
Special Cause Variation
![Page 29: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/29.jpg)
(C) 2015 Lance B. Coleman
Trending
$20,000+ scrap
![Page 30: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/30.jpg)
(C) 2015 Lance B. Coleman
SPC Questions to Ask
q Auditors seeing similar trends in data that they are reviewing should inquire as to if the trend was investigated?
q Also, under what circumstances would process data cause an investigation to be launched?
q How do you respond to an out of control condition?
q Tell me about your SPC training
![Page 31: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/31.jpg)
(C) 2015 Lance B. Coleman
Audit Program Model
![Page 32: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/32.jpg)
(C) 2015 Lance B. Coleman
Recap of Key Thoughts
q Risk based thinking is the review, evaluation and response to audit findings from the perspective of risk
q The three tiers of a robust audit program are compliance, continuous improvement and risk management
q Audit program goals should be aligned with the site/company goals
q Lean six sigma tools as well as data and trend analysis are important skills to master
![Page 33: Advanced Quality Auditing - ASQrube.asq.org/audit/2015/07/advanced-quality-auditing.pdf · Advanced Quality Auditing An Auditor ˇs Review of Risk Based Thinking, Lean Improvement](https://reader030.vdocuments.net/reader030/viewer/2022040401/5e754e5b2e9b37231c4b0b11/html5/thumbnails/33.jpg)
(C) 2015 Lance B. Coleman
Reference
http://asq.org/quality-press/display-item/?item=H1487
Promo Code – 10% off: QPKGC25