NMC METRICS COMMITTEEFEBRUARY 2019

UNCONFIRMED

UNCONFIRMED MINUTESFEBRUARY 19, 2019

NEW ORLEANS, LA, USA

These minutes are not final until confirmed by the Committee in writing or by vote at a subsequent meeting. Information herein does not constitute a communication or recommendation from the Committee and shall not be considered as such by any agency.

TUESDAY, FEBRUARY 19, 2019

1.0 OPENING COMMENTS

1.1 Call to Order / Quorum Check

The Nadcap Management Council (NMC) Metrics Committee was called to order at 10:30 a.m., 19-Feb-2019.

The meeting was restricted to Committee members as well as NMC members and invited guests. Delton Carter, Gina Fuzzell, and Francois-Simon Gauthier were recognized as guests.

A quorum was established with the following representatives in attendance:

Subscriber Members/Participants Present (* Indicates Voting Member)

NAME COMPANY NAME

* Latch Anguelov SAFRAN* Tomohiko Ashikaga Mitsubishi Heavy Industries* David Bale Pratt & Whitney Canada* Pascal Blondet Airbus Commercial Aircraft* Richard Blyth Rolls Royce Chairperson* Craig Bowden BAE Systems – Air

Delton Carter BAE Systems Inc.* Jeff Cerre Textron Aviation* David Cianfrini BAE Systems Inc.* Russ Cole Northrop Grumman* Rusty Freelen Lockheed Martin Corp.

Gina Fuzzell Lockheed Martin Corp.* Francois-Simon Gauthier Pratt & Whitney Canada* Frederic Grenon Bombardier* Dave Hansen 309th Maintenance Wing* Emily Hoiles Eaton, Aerospace Group* Dave Isenberg Parker Aerospace Group* Bob Koukol Honeywell Aerospace* Ralph Kropp MTU Aero Engines AG* Jeff Lott The Boeing Company* Scott Maitland Collins Aerospace (Goodrich)* Roger Merriman Textron Aviation* Steven Meyer Spirit AeroSystems* Daniel Muenter Liebherr-Aerospace* John Pfeiffer GE Aviation* Per Rehndell GKN Aerospace Sweden AB * Michael B. Roberts Gulfstream* Davide Salerno Leonardo S.p.A Divisione Velivoli* Victor Schonberger Israel Aerospace Industries* Lindsey Shaw Raytheon Vice Chairperson* David Soong Pratt & Whitney* Scott Wheatley Collins Aerospace (Rockwell Collins)

NMC METRICS COMMITTEEFEBRUARY 2019

UNCONFIRMED

Other Members/Participants Present (* Indicates Voting Member)

* Jim Cummings Metal Finishing Company Inc.* Elizabeth Herman Kaman Composites* Johanna Lisa Continental Heat Treating/Quality Heat

Treating* Vern Talmadge Howmet Thermatech Coatings* Wilfried Weber PFW Aerospace GmbH* Gary White Orbit Industries, Inc.

PRI Staff Present

Mark AubeleMike HaywardConnie HessScott KlavonJim LewisBob LizewskiCynthia NixonGlenn ShultzJon Steffey

1.2 Safety Information was reviewed.

1.3 Code of Ethics, Anti-Trust & Conflict of Interest was reviewed by Richard Blyth.

1.4 The NMC Metrics Meeting Agenda was reviewed.

1.5 Approval of Previous Meeting Minutes

The previous meeting minutes were approved. Motion made by John Pfeiffer and seconded by Jeff Cerre to approve the minutes from 23-Oct-2018 as written. Motion passed unanimously.

2.0 REVIEW METRICS COMMITTEE CHARTER, CURRENT MEMBERSHIP STATUS

The attached NMC Metrics Committee Charter was reviewed. As is done at every February meeting, the Committee reviewed the eAuditNet training slides.

3.0 RAIL

The attached Rolling Action Item List (RAIL) was reviewed. There were five open action items: MCA-81, MCA-91, MCA-96, MCA-98, and MCA-99. MCA-81, MCA-91, MCA-96, MCA-98, and MCA-99 (all five) were closed during this meeting.

4.0 TASK GROUP METRICS SUMMARY REVIEW [MCA-64]

Richard Blyth reported that he and Glenn Shultz have been continually reviewing the monthly task group metrics.

NMC METRICS COMMITTEEFEBRUARY 2019

UNCONFIRMED

There were no major or repeated issues detected in the last four months. Richard and Glenn will continue to review the task group metrics monthly and request explanations for any red metrics. Metrics and summaries are located in eAuditNet under the Metrics application and in the NMC Work Area.

5.0 REVIEW SUBSCRIBER ACCREDITATION METRICS

The attached Subscriber Accreditation Committee (SAC) Metrics were reviewed. The SAC metrics were mostly green with one yellow. It was due to difficulty achieving quorum on a Metallic Material Manufacturing (MMM) audit.

6.0 REVIEW NMC/BOARD OF DIRECTOR’S (BOD) METRICS

The attached BoD Metrics were reviewed. All metrics are “green”.

7.0 POTENTIAL EQUITABLE PARTICIPATION METRIC UPDATE [MCA-81, MCA-96]

The Equitable Participation metrics were reviewed. The Letter/Approval Ballot Participation metric is being revised. Observation Audit Participation and Auditor Interview Participation are red. Company participation data was redacted from the attached presentation. The unredacted version can be found in the Equitable Participation section of the NMC Forums section of eAuditNet.

The committee discussed ideas to improve auditor interview participation. Several actions were raised including:

Alert NMC members when any of their task group members agree to participate on an interview and do not attend.

Provide a list to the NMC members of those that participate in auditor interviews and those that do not.

Investigate a report of task group members that are not being invited to participate in auditor interviews. This has been investigated and it was found that the auditor interview scheduler uses the task group roster to invite participants. The task group members in question had not yet gained voter status.

Bob Lizewski’s Auditor Staffing Team will investigate ways to improve auditor interview scheduling so that interviews are not scheduled until there are at least four task group member volunteers.

The committee discussed ideas to improve observation audit participation. It was agreed that a sub team should be created to work this issue. Lindsey Shaw will lead the team of: David Cianfrini, Russ Cole, Steven Meyer, Michael Roberts, Victor Schonberger, Davide Salerno, and Dave Soong.

NMC METRICS COMMITTEEFEBRUARY 2019

UNCONFIRMED

Jon Steffey presented a proposal for a method to measure Letter/Approval Ballot Participation.

Motion made by Bob Koukol and seconded by Roger Merriman to proceed with the proposal. Motion passed.

The key points of the proposal are: To calculate equitable contribution (but not approvals on individual ballots), corporate

subscriptions will be used

If a subscriber mandates for a given task group, they should participate by balloting documents

If a subscriber accepts for a given task group, they should participate by balloting documents

Subscribing alone (without mandating or accepting) does not require participation

For this to work correctly, the Subscriber Matrix will need to be updated at least annually as part of annual subscription agreement renewals to accurately reflect each subscriber’s mandate/accept position.

ACTION ITEM: Glenn Shultz will inform the Auditor Interview Scheduling Team that NMC members need to be alerted when any of their task group members agree to participate on an interview and do not attend (Due Date: 31-Mar-2019)

ACTION ITEM: Glenn Shultz will provide a list to the NMC members of those that participate in auditor interviews and those that do not. (Due Date: 31-Mar-2019)

ACTION ITEM: Bob Lizewski will work with his team to investigate ways to improve auditor interview scheduling so that interviews are not scheduled until there are at least four task group member volunteers (Due Date: 31-May-2019)

ACTION ITEM: Lindsey Shaw will lead the team of: David Cianfrini, Russ Cole, Steven Meyer, Michael Roberts, Victor Schonberger, Davide Solerno, and Dave Soong to develop strategies to improve observation audit participation (Due Date: 31-May-2019)

ACTION ITEM: Jon Steffey will continue to develop eAuditNet to make it able to gather the data to provide a Letter/Approval Ballot Participation metric that complies with his proposal (Due Date: 31-May-2019)

8.0 POTENTIAL QUALITY METRIC UPDATE [MCA-81, MCA-93]

Richard presented the Quality Metric that we are piloting through 2019. The percent of non-sustaining reaccreditation NCR’s relative to the number of reaccreditation audits is at 4.2%. This is up from the last period (4.0%). Due to time constraints the committee agreed to discuss this further at the June meeting.

NMC METRICS COMMITTEEFEBRUARY 2019

UNCONFIRMED

9.0 NADCAP EFFECTIVENESS & CUSTOMER SATISFACTION 2017 SURVEY UPDATE [MCA-84]

Glenn Shultz presented the Nadcap Effectiveness and Customer Satisfaction spider graph updated with the 2017 results.

Glenn also announced that the 2019 Nadcap Effectiveness and Customer Satisfaction Survey was distributed 30-JAN-2019 and will be open through 30-APR-2019. Reminders will be sent out in early March and April. Data from the 2019 survey will also be forwarded to the NMC Continuous Improvement Committee for review.

10.0 NADCAP UPDATE

The team reviewed Scott Klavon’s Nadcap Update presentation.

11.0 NEW BUSINESS REVIEW

No new business was raised.

12.0 NEW ACTION ITEMS

New action items were reviewed and will be added to the RAIL.

13.0 ADJOURNMENT – 19-FEB-2019

Meeting was adjourned at 12:14 pm (motion by Roger Merriman and seconded by Jeff Cerre).

Minutes Prepared by: Glenn Shultz gshultz@p-r-i.org

***** For PRI Staff use only: ******

Are procedural/form changes required based on changes/actions approved during this meeting? (select one)

YES* ☐ NO ☒

*If yes, the following information is required:Documents requiring revision: Who is responsible: Due date: