what does a good investigation look like? · and assist the design of new measures. understanding...

16
What does a good investigation look like? Railway Accident Investigation Seminar Simon French, Chief Inspector, RAIB

Upload: others

Post on 24-Mar-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

What does a good investigation look

like?

Railway Accident Investigation Seminar

Simon French, Chief Inspector, RAIB

Page 2: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

The benefits of accident investigation

in depth analysis of the causal chain gives new insights

into the way machines, infrastructure, the actions of

people and organisational factors can contribute to

harm

most accident investigations reveal how combinations

of factors combined to create a dangerous event

accident investigations provide a special insight into

the vulnerability of existing risk mitigation measures

and assist the design of new measures

Page 3: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Understanding our risk

3

Failure mode

and effects

analysis

Precursor

modelling

Stress testing

Investigation of

system failures

Analysis of

real-life

performance

Risk assessment

Hazard and

operability study

Accident

investigation

Investigation of

dangerous events

BEFORE THE EVENT

BEFORE THE

NEXT EVENT

TIME

Page 4: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

The benefits of accident investigation

accident investigations shine a searchlight into

particular corners of the railway industry and

therefore provide valuable intelligence to those with

the responsibility for safety

accident investigations demonstrate to those involved,

those affected and wider society that action is being

taken and lessons will be learnt

Page 5: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

So what does good look like?

Evidence

Findings

Recommendations

Safety

improvements

CAUSAL ANALYSIS

DEFINITION OF SCOPE AND METHODOLOGY

REPORT DRAFTING and CONSULTATION

COMMUNICATION

Page 6: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

So what does a good investigation look like

There are no grey areas, never any doubt about ‘who did it’

Blamey

Thinnest of evidence

The guilty party always manages to ‘give the game away’

Legal powers?

not

Page 7: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

So what does a good investigation look like

Accuracy and detail

Openness to new evidence

Analysis focused on understanding the cause of the event

Good cooperation with the police and other investigators

Story-telling based on factual evidence

Page 8: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

Be clear about the scope of your investigation and your methodology

Always aim to be thorough, yet proportionate to the potential safety learning

Avoid apportioning blame, but do not shrink from presenting all of the relevant facts

Focus on understanding the causal links rather than pursuing a particular safety issue

Page 9: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

An interdependence between the activities of A and B does not prove causality

Similarly, correlation is not proof of causation

Page 10: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

Understand cause and effect; and be open to alternative possibilities

Page 11: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

Residual uncertainty about cause is a normal outcome of a competent investigation and should never be seen as failure – the duty of investigators is to be clear about areas that remain unclear

Page 12: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

The simplest explanation is often, but not always, the best

Beware confirmation bias

Page 13: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

Accuracy is everything – never take the trust for granted, it has to be earned

Keep track of your evidence

Keep people informed as best you can, especially those who were directly involved in the accident and the bereaved

Never forget the impact that serious accidents can have on industry workers and management teams

Page 14: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

A good investigation integrates direct causal factors with underlying management and organisational factors

Safe

ty m

anag

emen

t

Org

anis

atio

nal

fact

ors

system (SMS) Risk

awareness

SMS assurance (eg monitoring, review

and audit)

Control measures

Org

anis

atio

nal

saf

ety

cult

ure

an

d r

esili

ence

Causal factors (including competence, behaviours, team dynamics)

Immediate cause

Absent/inadequate

Lack of awareness

Learning from experience

Deviation not

identified

Absent or inadequate control

measures not identified

Accident

Corporate knowledge

Willingness and ability

to learn

Reporting

Willingness and ability

to change

Blame/just culture

Not able/willing to learn

Poor reporting

Not able/willing to change

Focus on blame

Knowledge gap

Absent or inadequate

Page 15: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

Consult with those who understand the system best, they may have better ideas

To understand what went wrong, you need to first understand how a safe outcome is normally delivered

A good investigation report must tell the story as clearly as possible – never lose safety learning in poor English and waffle

Page 16: What does a good investigation look like? · and assist the design of new measures. Understanding our risk 3 Failure mode and effects analysis Precursor modelling Stress testing Investigation

Advice to new investigators

Remember why we are investigating, and the huge potential for improving railway safety