gxp data integrity –what really matters · 2018. 12. 20. · gxp data integrity –what really...
TRANSCRIPT
![Page 1: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/1.jpg)
GxP Data Integrity – What really mattersDr Andrew Gray – Head MHRA InspectorateEBF 11th Open Symposium - Barcelona21st November 2018
![Page 2: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/2.jpg)
2
Data IntegrityGuidance Published March 2018Data integrity has always been central to what we do -• As regulators
• As quality professionals
So what's the new?The way we look at data integrity controls?
![Page 3: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/3.jpg)
3
Data Integrity – International Focus
![Page 4: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/4.jpg)
4
Data Integrity – What’s New?
What's New
Awareness
Concepts
Ways of Working
Fraud
IT Systems
Operational Complexity
![Page 5: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/5.jpg)
5
Data Integrity Controls
Concepts
Thinking
Approach
![Page 6: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/6.jpg)
6
Data Integrity - ConceptsData lifecycle - “All phases in the life of the data (including raw data) from initial generation and recording through processing (including transformation or migration), use, retention, archiving, retrieval and destruction”
• Collection• Processing• Reporting• Review• Archival
Data Lifecycle
![Page 7: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/7.jpg)
7
Data Integrity - ConceptsData Governance – “The sum total of arrangements to ensure that data irrespective of the format in which it is generated, is recorded, processed, retained and used to ensure a complete, consistent and accurate record throughout the data lifecycle.”
• Process & Systems• Ownership• Monitoring/Audit• Environment• Training
Data Governance
![Page 8: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/8.jpg)
8
Assessing DI Risk
![Page 9: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/9.jpg)
9
Assessing DI Risk
• Risk assessment
• Identify areas of risk
• Implement proportionate risk mitigation measures
• Assess residual risk
![Page 10: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/10.jpg)
10
Assessing DI Risk
Is all data retained? • Including metadata, event logs, audit trails.
Can data be excluded from the decision-making process?• What is the justification for doing so?• Is this visible?
![Page 11: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/11.jpg)
11
Assessing DI Risk
Is QA review/inspection appropriately focused
• Including e-data? (or only when the reviewer thinks there is a problem?)
• Does e-data review include meaningful metadata? Is this in the SOPs / training?
![Page 12: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/12.jpg)
12
Proportionality
Comfortable with residual risks
![Page 13: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/13.jpg)
13
Organisational culture and risk awareness
IgnoranceDenial
Under-standing
‘Policing’System maturityHigh risk
Low risk.
![Page 14: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/14.jpg)
14
Compliance & Culture
Attitudes
BeliefsBehaviours
![Page 15: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/15.jpg)
15
Attitudes Quality adds value!
![Page 16: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/16.jpg)
16
Behaviours
• Management attitudes• Open reporting culture• Inter-department cooperation
• Corrective Actions / Preventative Actions• Realism
• Pragmatism
![Page 17: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/17.jpg)
17
Beliefs
The work we do mattersPublic Health
Patient safety
Environmental impact
It’s easy to become detached
![Page 18: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/18.jpg)
18
Beliefs
Context should be at the centre of any training programme
……It provides purpose and meaning
……It will impact on attitudes
……It will impact on compliance
![Page 19: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/19.jpg)
19
What we see
![Page 20: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/20.jpg)
20
Common Inspection Findings User Permission Settings
• None in place / shared log-ins• Multiple log-ins per user with different permissions (for different
activities) but no checks to ensure used appropriately• Person assigning user permissions is also a user of the system• Poor control of assigned users (removal of permissions)
![Page 21: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/21.jpg)
21
Common Inspection Findings
Quality Control / Quality Assurance
• Checks conducted against paper ‘source’ data rather than electronic raw data
• No review of audit trails / permissions• Lack of clear explanations of discrepancies or changes to data.
![Page 22: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/22.jpg)
22
Laboratory DI Issues
• The facility utilised a generic login termed “autospec” which was used by multiple users.• Data could be deleted via windows explorer.• The main audit trail functionality had not been installed – gaps in the audit trail.• The run log which was used as the basis for confirming all data was present could be edited.• Quality assurance (QA) did not have access to the electronic data and were provided with paper print
outs of the data. • Operating software was installed with basic security configuration.
The manipulation of data within analytical runs combined with the set up of the system has cast significant doubt over the validity of the data generated.
DI Deficiencies
![Page 23: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/23.jpg)
23
Laboratory DI Issues cont..
• Falsification of temperature data
• Continued in CAPA response to inspectorate!
*****• The generation of results from data acquired by the MassLynx software included a process step
where modifications could be made to the data. A .txt file could be generated as an output from the software, edited and then uploaded to the LIMS system.
• QA review of data acquired by the MassLynx software was limited to review of data held in LIMSsystem and printed chromatograms. The was no review of essential supporting data which would potential identify DI issues.
![Page 24: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/24.jpg)
24
Lab DI Issues
Falsification of data – company culture
• Loss on drying weight• LOD results as part of in-process testing• Falsification of calibration records• Disposal of settle plates when inspectors arrived unannounced• ‘Made-up’ pH meter calibration values recorded
![Page 25: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/25.jpg)
25
Lab DI Issues
Falsification of mixing steps for over 60 batches
• Identified error in stirring rpm and so changed the records
• Could have been fixed with a change control & impact assessment
• Fraud orchestrated by a manager and involved multiple members of staff
![Page 26: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/26.jpg)
26
Do we understand our processes?
• Data lifecycles • Data Governance • Where are opportunities for data integrity issues to occur?• Bad practices; do we have any? • Do we understand what our residual risks are and are we happy to live with
and justify them?
Is our culture conducive to maintaining a focus on data integrity?
Summary
![Page 27: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/27.jpg)
27
Thank you for your attention
![Page 28: GxP Data Integrity –What really matters · 2018. 12. 20. · GxP Data Integrity –What really matters Dr Andrew Gray –Head MHRA Inspectorate EBF 11thOpen Symposium -Barcelona](https://reader036.vdocuments.net/reader036/viewer/2022070213/6109013f7b854805745e98a5/html5/thumbnails/28.jpg)
28
© Crown copyright 2018