12. caas risk based surveillance v3. caas_ri… · certificate holders 1 aerodrome certificate...
TRANSCRIPT
![Page 1: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/1.jpg)
ICAO Risk Based Surveillance WorkshopLima, Peru
Singapore CAASRisk Based Surveillance
19-20 March 2018
![Page 2: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/2.jpg)
Industry Overview
2
Diverse group of aviation safety approval holders
AIR TRAFFIC CONTROL TRAINING
ORGANISATION
REGISTERED AIRCRAFT
230 6
MAINTENANCETRAINING
ORGANISATIONS
10AIR OPERATOR
CERTIFICATEHOLDERS
1AERODROME CERTIFICATE
HOLDER
43 DESIGNAND PRODUCTION
ORGANISATIONS
169 MAINTENANCE AND REPAIRORGANISATIONS
4,400PILOTS 443
AIR TRAFFICCONTROLLERS
2,200 AIRCRAFT
MAINTENANCE LICENCE HOLDERS
1
AVIATIONTRAINING
ORGANISATIONS11
![Page 3: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/3.jpg)
CAAS Overview
3
3 mandates: safety regulation, aviation development, and ANS provision
![Page 4: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/4.jpg)
The Need for Enhanced Risk-Based Surveillance
4
eRBS as part of CAAS’ drive for efficient and effective surveillance
Basic RBS eRBS
• Qualitative assessments of ‘severity’
• Standardised assessments of ‘severity’ and ‘likelihood’
• Inspectors’ judgement to determine risk levels
• Formal framework calibrated by inspectors’ judgement to determine risk levels
• Sector‐specific (e.g airlines, MROs, design organisations)
• Sector‐ and activity‐specific (e.g audits on MROs, inspections on aicraft)
• Risk levels determine resourcesallocated and surveillance frequency (for some)
• Risk levels determine resourcesallocated, surveillance frequency (for some), and depth of surveillance
eRBS was developed to help CAAS allocate the right amount of surveillance resources to the right entity at the right time
![Page 5: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/5.jpg)
Enhanced Risk-Based Surveillance Development
5
Building on the good work of others
![Page 6: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/6.jpg)
Enhanced Risk-Based Surveillance Development
6
Focus on surveillance activities within our control – Audits and Inspections
Surveillance
Safety Performance Indicators
Mandatory Occurrence Reporting
Audits Inspections Occurrence Investigations
Whistleblower Reports
‘Stratified Sampling’ method“How do we obtain a proportionate sample
of the entire population?”
Image from mathcaptain.com
Organisation Risk Profile• Approved scope of work• Volume of work• Turnover of Key Appointment Holders• Past surveillance results• Approvals from other CAAs
Risk Scores Manpower Allocation
High X man‐days
Medium Y man‐days
Low Z man‐day
![Page 7: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/7.jpg)
Enhanced Risk-Based Surveillance Development
7
Organisation Risk Profile (ORP) Trial on Design Organisations
Example of ORP Parameters• Approved scope of work• Volume of work• Turnover of Key Appointment Holders• Past surveillance results• Approvals from other CAAs
Total ORP Score
Weightage
Resource Allocation (Man‐Days)• Number of auditors• Number of days
Individual Scores• 3 (least desirable)• 2• 1 (most desirable)
X
Risk Scores Manpower Allocation
High X man‐days
Medium Y man‐days
Low Z man‐day
![Page 8: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/8.jpg)
Enhanced Risk-Based Surveillance Development
8
Weighted Stratified Sampling Trial on Cabin Safety Inspections
Total Flights in Year X
Airline A Airline B Airline C
50% 30% 20%
North Asia
South Asia
20% 30%
South East Asia
30%
South America Europe
10% 10%
Airline ANorth Asia
Airline ASouth Asia
Airline BSouth East
Asia
Airline CSouth
America
Airline CEurope
17% 33% 28% 14% 8%
Cabin Safety Risk Factors
No. of Aircraft Types in Fleet
Experience of Cabin Crew
Cabin Crew OperatingPattern
Airline
Final Distribution
Region
![Page 9: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/9.jpg)
Enhanced Risk-Based Surveillance Development
9
Getting colleagues and management on board eRBS was crucial
Development of eRBS Framework
Trial on selected surveillance activities (Design Organisation Audits and Cabin Safety Inspections)
Present eRBS framework to management
Full implementation on other approval holders
Update to Management on benefits gained
Learning by doing through
an iterative process
![Page 10: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/10.jpg)
Envisioned Benefits of eRBS
10
Clarity on envisioned benefits is important for engaging with CAA management and industry
• CAAS– Standardised framework for risk assessment– Systematically identify areas of greater concern– More efficient manpower deployment– “Do more with the same resources”
• Industry– ‘Nudge’ organisations towards desired behaviour– Help promote stronger safety culture
![Page 11: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/11.jpg)
Further Work
11
Expanding implementation and leveraging IT enhancements
• Roll-out of eRBS to all other surveillance activities• Integrate eRBS with the rest of CAAS’ safety
oversight activities through enhanced IT solutions– Improve efficiency– Fuse data from different sources to gain more accurate
picture
![Page 12: 12. CAAS Risk Based Surveillance v3. CAAS_Ri… · CERTIFICATE HOLDERS 1 AERODROME CERTIFICATE HOLDER 43 DESIGN AND PRODUCTION ... safety regulation, aviation development, and ANS](https://reader036.vdocuments.net/reader036/viewer/2022063011/5fc76ce699a943642b6a3b0d/html5/thumbnails/12.jpg)
12
Thank you