module n° 5icao state safety programme (ssp) implementation course 1 module n° 5 – alos related...
TRANSCRIPT
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 1
Module N° 5 – ALoS related to an SSP
Revision N° 5 ICAO State Safety Programme (SSP) Implementation Course
25/02/10
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 2
SSP – A structured approach
Module 2Basic safety management
concepts
Module 3 ICAO SARPs related
to safety management
Module 4 ICAO SSP framework
Module 5ALoS related to an
SSP
Module 6 Prescription / Performance
Module 8SSP implementation plan
Module 1 Introduction to the
SSP implementation course
Module 7 SSP training programme
Module 5ALoS related to an
SSP
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 3
At the end of this module, participants will be able to describe
the concepts and dimensions underlying the acceptable level
of safety (ALoS) related to an SSP
Objective
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 4
Introductory concepts
Acceptable level of safety (ALoS)
ALoS related to an SSP
Summary
Questions and answers
Points to remember
Contents
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 5
The development and implementation of ALoS builds upon certain basic concepts of systems theory
There is a hierarchy underlying the progression of these basic concepts towards the development and implementation of ALoS
Understanding of the concepts and hierarchy is an essential foundation for the development and implementation of ALoS and the SSP
Introductory concepts
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 6
1. Safety – as defined by Doc 98592. Level of safety – degree of safety of a system, representing
the quality of the system, safety-wise, expressed through safety indicators
3. Safety indicators – parameters that characterize and/or typify the level of safety of the system
4. Value of safety indicators – quantification of a safety indicator
5. Safety targets – concrete objectives to be achieved6. Value of safety targets – quantification of a safety target7. Acceptable level of safety – minimum degree of safety that
must be assured by a system in actual practice
Introductory concepts – The basic theory
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 7
The selection of appropriate safety indicators is an essential foundation for the development and implementation of ALoS
The selection of safety indicators is a function of the detail to which the level of safety of the system is to be represented
Meaningful safety indicators must be representative of the elements that characterise system safety
Introductory concepts – Selection of safety indicators
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 8
Safety indicators Fatal airline accidents/serious incidentsRunway excursion events/ground collision eventsDevelopment/absence of primary aviation legislationDevelopment/absence of operating regulationsLevel of regulatory compliance…
Safety targetsReduction in fatal airline accident/serious incidentsMaintain the number in runway excursion events/ground
collision eventsImprove the actual level of regulatory compliance…
Introductory concepts – The basic theory: examples
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 9
Value of safety indicators 1. [Rate/number] Fatal airline
accidents per [number] operations
2. [Rate/number] Runway excursion events per [number]
operations3. [Rate/number] Ground collision
events per [number] operations4. [Number] inspections to
operators completed [timeframe] ...
Value of safety targets1. [Reduce / maintain
by / maximum] fatal airline accidents per [number] operations
2. [Reduce / maintain by / maximum] runway excursion events per [number] operations
3. [Reduce / maintain by / maximum] ground collision events per [number] operations
4. [Minimum number] of inspections completed [timeframe]…
Introductory concepts – The basic theory: examples
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 10
Safety measurement (strategic)Generally associated to the SSPQuantification of outcomes of selected high-level or high-
consequence eventsAccident rates Serious incident rates
Quantification of selected high-level State functionsDevelopment/absence of primary aviation legislationDevelopment/absence of operating regulationsLevel of regulatory compliance
A measure of achievement of high-level safety objectives of safety interventions and/or mitigations strategies
Introductory concepts – A fundamental differentiation
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 11
Safety performance measurement (tactical)Generally associated to an SMS Quantification of the outcomes of selected low-level, low-
consequence processesNumber of FOD events per number of ramp operationsNumber of ground vehicle events in taxiways per
number of airport operations…
A measure of the actual performance of safety interventions and/or mitigation strategies, beyond accident rates and regulatory compliance
Introductory concepts – A fundamental differentiation
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 12
Safety measurement
Not a continuous processA spot checkConducted following pre-specified timeframes
Safety performance measurement
Continuous processMonitoring and measurement of selected operational
activities necessary for the provision of services
Introductory concepts – A fundamental differentiation
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 13
The acceptable level of safety (ALoS) to be achieved shall
be established by the State
When establishing ALoS, consideration must be given to
the level of safety risk that applies
the safety risk tolerance
the cost/benefits of improvements to the aviation system
the public expectations in civil aviation system
Basic safety management SARPs
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 14
Values of safety indicators and values of safety targets
Initial ALoS – Quantitative action statements on selected high level/high consequence outcomes (safety measurement)
Mature ALoS – Quantitative action statements on selected high level/high consequence events (safety measurement) and low level/low consequence outcomes (safety performance measurement)
Expressing the ALoS
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 15
Examples of values of safety indicators and safety targets based on safety measurement
Values of safety indicators
1. [Number] CFIT and approach & landing accidents per [number] departures
2. [Number] runway excursions per [number] operations
3. [Number] ground collision accidents per year on a [x-year] rolling average
4. [Number] of high-severity events captured through the State MOR yearly
5. [Number] inspections to operators completed quarterly
6. [Number] AIS facilities with QMS implemented
7. Electronic filing of differences completed within [number] months/weeks
Values of safety targets1. [Reduce by/maximum] CFIT and approach
& landing accidents per [number] departures
2. [Reduce by/maximum] runway excursions per [number] operations
3. [Reduce by/maximum] ground collision accidents per year on a [x-year] rolling average
4. [Minimum number] of high-severity events captured through the State MOR yearly
5. [Minimum number] inspections to operators completed quarterly
6. [Number] AIS facilities with QMS implemented by [time]
7. Electronic filing of differences completed within [revised number] months/weeks
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 16
In the longer-term, once States develop safety data collection
and analysis capabilities under the Safety Assurance
component of the SSP, ALoS should reflect a combination of
safety measurement
safety performance measurement
ALoS – Mature SSP
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 17
Examples of values of safety indicators and targets based on safety performance measurement
Values of safety targets
1. [Reduce by/maximum] number of level busts per [number] operations by [date]
2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports by [date]
3. [Reduce by/maximum] number of TCAS/airprox events per [number] operations by [date]
4. [Reduce by/maximum] number of non-conforming approaches (NCA) at 5 international [State] airports by [date]
5. [Reduce by/maximum] the number of apron FOD events at 5 international [State] airports by [date]
Values of safety indicators
1. [Number] level busts per [number] operations
2. [Number] Cat B and C runway incursions in 5 international [State] airports per
[number] operations
3. [Number] TCAS/airprox events per [number] operations
4. [Number] non-conforming approaches (NCA) at 5 international [State]
airports per [number] operations
5. [Number] apron FOD events at 5 international [State] airports per [number] operations
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 18
Tools and means to deliver the safety targets of an SSP
Regulations
Training
Technology
Delivering ALoS – Safety action plans
TechnologyTrainingRegulations
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 19
Today
State Civil Aviation Authority
State Civil Aviation Authority
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 20
Initial ALoS
State Safety Programme
State Civil Aviation Authority
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
Initial ALoS
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 21
Initial ALoS
State Safety Programme
State Civil Aviation Authority
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
Initial ALoS
Exchange of protected safety data
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 22
Mature ALoS
State Safety Programme
State Civil Aviation Authority
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
Exchange of protected safety data
Exchange of protected
safety data
Exchange of protected
safety data
Mature ALoS
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 23
Establishing ALoS related to an SSPdoes not replace legal,
regulatory, or other already established requirements, but it must support compliance with them
leaves unaffected the obligations of States, and does not relieve States from compliance with SARPs
ALoS – Legal considerations
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 24
ALoS – Initial (Safety measurement)
Values of safety targets
1. [Reduce by/maximum] CFIT and approach and landing accidents per [number] departures
2. [Minimum number] inspections to operators completed quarterly 3. ...
Actionplans
1. CFIT training package distributed to industry and supported by training courses
2. Revision and if necessary update of hiring policy. Inspection manual updated
3. ...
Values of safety indicators
1. [Number] CFIT and approach and landing accidents per [number] departures
2. [Number] inspection to operators completed quarterly3. ...
State Shall comply with all applicable international standards
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 25
ALoS – Mature (Safety performance measurement)
Values of safety targets
1. [Reduce by/maximum] Unstabilized approaches (NCA) at 5 international airports per [number] arrivals by [date]
2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports per [number] by [date]
3. …
Actionplans
1. Continuous Descend Operations (CDO) procedures implemented – Arrival procedures charts designed for stabilized approaches
2. Installation of ASDE/X in 5 international [State] airports3. ….
Values of safety indicators
1. [Number] non-conforming approaches (NCA) at 5 international airports [State] per [number] operations
2. [Number] of Cat B and C runway incursions in 5 international airports [State] per [number] operations
3. …
State Shall comply with all applicable international standards
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 26
Transition from initial to mature ALoS
Initial ALoS
(Safety measurement)
Quantification of outcomes of selected high-level/high-consequence events
Quantification of selected high-level State functions
State safety assurance
Safety oversight
Safety data collection, analysis and exchange
Safety data driven targeting of oversight on areas of greater concern or need
Mature ALoS(Safety measurement and
safety performance measurement)
Quantification of outcomes of selected high-level/high-consequence eventsQuantification of selected high-level State functionsQuantification of outcomes of selected low-level/low-consequence events
Timeline
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 27
Summary
ATS Service provider
Aerodrome operator AMOAircraft
operator N° 1
SSPSSP(ALoS)(ALoS)
ATS Service provider
Aerodrome operator AMO
Aircraft operator N° 2
Training organization
SMSSMS SMSSMS SMS
State accepts and oversees individual service providers’ SMS
Safety performance
State accepts and oversees individual service providers’ SMS
State agrees and supervises individual service provider’s SMS safety performance
Safety performance Safety performance Safety performance Safety performance
Safety performance Safety performance Safety performance Safety performance Safety performance
Trainingorganization
SMS SMS SMSSMS SMS
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 28
Questions and answers
ALoS related to an SSP
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 29
Questions and answers
Q: Explain the fundamental differentiation between safety measurement and safety performance measurement?
A: ?
Slide number:
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 30
Q: What are the tools and means to deliver the safety targets of an SSP?
A: ?
Questions and answers
Slide number:
Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 31
1. The basic systems safety theory
2. Safety measurement and safety performance measurement
3. Initial and mature ALoS
4. ALoS does not replace legal, regulatory, or other already
established requirements
Points to remember
Revision N° 5 ICAO State Safety Programme (SSP) Implementation Course
25/02/10
Module N° 5 ALoS related to an SSP