lessons learned from accreditation assessments - anab perspective
DESCRIPTION
Lessons Learned from Accreditation Assessments - ANAB Perspective. July 17, 2014 Bob Cruse ANAB, Aerospace Program Manager. Objective. Provide a summary of the NCR’s identified from CB Witness Audits & CB Office Assessments conducted in the past 12 months. Goal. - PowerPoint PPT PresentationTRANSCRIPT
Company Confidential
Registration Management Committee
1
Lessons Learned from Accreditation Assessments -
ANAB Perspective
July 17, 2014
Bob CruseANAB, Aerospace Program Manager
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
Objective
• Provide a summary of the NCR’s identified from CB Witness Audits & CB Office Assessments conducted in the past 12 months.
2
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
Goal
• Provide knowledge/information to the AQMS auditor pool – Improve auditor/CB awareness & performance
– Reduce repeat NCR’s
– Increase value to the assessment process and the industry as a whole.
3
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
4
Overall
July 2013-July 2014 (12 Months)
• 114 NCR’s raised in 105 Witnessed Audits (WA)
– 1.08 Average per WA
– 98 Minor NCR’s
– 16 Major NCR’s
• 101 NCR’s in 35 Office Assessments (OA)
– 2.88 Average per OA
– 19 Major NCR’s
– 82 Minor NCR’s
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
5
NCR Totals by StandardJuly 2013-July 2014
• ISO/IEC 17021:2011
• Office-31
• Witness-42
• AS9104/1
• Office-43
• Witness-46
• AS9101D
• Office-16
• Witness-15
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
Witness Audits (12 Months)
6
9.1.9.5.1 9.1.2.3 9.1.9.2 9.1.9.8.2 9.1.2.2.2 9.1.4.1 9.3.2.1.b0
1
2
3
4
5
6
7
8
9
10
ISO/IEC 17021:2011Witness Audit NCR’s July 2013-July 2014
No. of NCR's
Col
lect
ing/
Ver
ifyi
ng I
nfor
mat
ion
Prep
arin
g th
e A
udit
Plan
Ope
ning
Mtg
.
Clo
sing
Mtg
.
*1 *2 *3
*1-Determining Audit Objectives, Scope, Criteria
*2-Determining Audit Time
*3-Review of NCR’s from Previous Audit
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
Office CB Assessment (12 Months)
7
9.1.10.2 9.1.11 9.1.12 9.1.9.6.1 9.1.150
1
2
3
4
ISO/IEC 17021:2011Office Assessment NCR's July 2013-July 2014
No. of NCR's
Aud
it R
epor
t
Cau
se A
naly
sis
of N
CR
’s
Eff
ectiv
enes
s of
CA
’s
Iden
tifyi
ng/R
ecor
ding
Fin
ding
s
Act
ions
pri
or to
C
ert D
ecis
ion
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
Witness Audits (12 Months)
8
12.5 8.2 8.1.1 8.4.a 8.5.a 5.3.b 8.10 8.2.2 8.5.c0
1
2
3
4
5
6
7
8
9
10
AS9104/1Witness NCR Qty July 2013-July 2014
No. of NCR's
Acc
urac
y of
OA
SIS
Dat
a
Aud
it D
urat
ion
Stru
ctur
e
NC
R G
en.
NC
R G
en.
*1 *2 *3 *4
*1-CB Single Office Location
*2-CAAT
*3-Audit Duration Requirements
*4-CB Report OASIS Upload Timeframes
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
8.5.c 12.5 6.11 5.3 8.6 8.1.10
0.5
1
1.5
2
2.5
3
3.5
4
4.5
5
AS9104/1Office Assessment NCR's July 2013-July 2014
No. of NCR's
Acc
ura
cy o
f O
AS
IS D
ata
Office CB Assessment (12 Months)
9
CB
Report
OA
SIS
Uplo
ad T
imefr
am
es
Export
Ctr
l. D
iscl
osu
re
*1-QMS Flowdown Req’s to CB’s
*2-Issuance of Certficates
*3-Certification Structure Requirements
*1 *2 *3
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
Witness Audits (12 Months)
10
4.2.1 4.2.2.5 4.2.20
1
2
3
4
5
AS9101DWitness NCR Qty July 2013-July 2014
No. of NCR's
Audit
Pla
nnin
g
ID/R
eco
rdin
g o
f Fi
ndin
gs
Onsi
te A
udit
s
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
Office CB Assessment (12 Months)
11
4.2.2.5 4.2.3 Appendix C0
1
2
3
4
AS9101DOffice Assessment NCR's July 2013-July 2014
No. of NCR's
ID/R
eco
rdin
g o
f Fi
ndin
gs
Audit
Report
ing
PEA
R C
onte
nt
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
“Heavy Hitters”
12
July 2013-July 2014
• Office Assessments
• AS9104/1 8.5.c = 5 NCR’s (CB Report Upload Timeframe)
• AS9101D 4.2.2.5 = 4 NCR’s (ID/Recording Findings)
• ISO/IEC 17021:2011 9.1.10.2 = 4 NCR’s (Audit Report)
• Witness Audits
• 17021:2011 9.1.9.5.1 = 11 NCR’s (Collecting/Verifying Info.)
• AS9104/1 12.5 = 10 NCR’s (OASIS Data Accuracy)
• 17021:2011 9.1.2.3 = 8 NCR’s (Preparing Audit Plan)
• AS9104/1 8.2 = 6 NCR’s (Audit Duration)
RMC Auditor Workshop Long Beach, CA 17 July 2014
Registration Management Committee
13
Questions