joint research centre (jrc) proficiency testing (support to
TRANSCRIPT
![Page 1: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/1.jpg)
2
Joint Research Centre (JRC)
Proficiency Testing (support to ISO17025)
Marc Van den BulckeMolecular Biology and Genomics Unit
AGR 42006 - TAIEX - 28/29 October 2010
![Page 2: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/2.jpg)
3
General outlay of GMO activities for enforcement
- Laboratory Organisation
- Sample Analysis Workflow
- Proficiency Testing
![Page 3: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/3.jpg)
4
General outlay of GMO activities for enforcement
- Laboratory Organisation
- Sample Analysis Workflow
- Proficiency Testing
![Page 4: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/4.jpg)
5
Laboratory Organisation
Routine analysisLaboratory
DevelopmentLaboratory
ResearchLaboratory
Homogenisationroom
Storage room
Office
![Page 5: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/5.jpg)
6
General requirements for the competence of testing and calibration laboratories
High quality service to the
costumer
Goal
Tools
• Documents (SOP, DOC, Forms, and traceability)• Staff training• Non Conformity• Intern & extern audits• Management review• Proficiency testing
Laboratory Organisation
![Page 6: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/6.jpg)
7
General outlay of GMO activities for enforcement
- Laboratory Organisation
- Sample Analysis Workflow
- Proficiency Testing
![Page 7: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/7.jpg)
8
Sample collection
Reception & registration
Analysis
Report
Sample Analysis Workflow
4 Steps process:
![Page 8: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/8.jpg)
9
Sample collection
Reception & registration
Analysis
Report
Sample Analysis Workflow
Verification of invoice conformity & intact pack
Sample registration (indicator)
Sample file opening
Working page
Contact :Technicians and GMO-Lab
![Page 9: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/9.jpg)
10
Sample Analysis Workflow
Sample collection
Reception & registration
Analysis
Report
1. Sample grinding2. DNA extraction and
quantification3. Q PCR Analysis
![Page 10: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/10.jpg)
11
ConformAuthorized < 0.9%
Non-conformNon-authorized orAuthorized > 0.9%
AnalysisReport
Sample collection
Reception & registration
Analysis
Report
Sample Analysis Workflow
![Page 11: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/11.jpg)
12
Subsampling: > 0.5 kgDirect grinding: < 0.5 kg
Step 1 : sample grinding
RETSCH ZM-200
WS MS
Analysis(50g)
Storage room
Sample Analysis Workflow
![Page 12: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/12.jpg)
13
WS
DNA extraction (CTAB)(4x 250mg or 4x1g)
DNA quantification (fluorimeter)
Step 2: DNA extraction and quantification
Sample Analysis Workflow
![Page 13: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/13.jpg)
14
Step 3: Real-time PCR analysis
Screening (50ng/analysis)(SYBR®Green)
Identification (50ng/analysis)TAQMAN
QuantificationTAQMAN
CRL methods
Sample Analysis Workflow
![Page 14: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/14.jpg)
15
QPCR methods are validated CRL methods or in house validated methods (according to ISO 7525)
Flexible scope for validation of Methods
Target
In situ and in silico
dvelopment
Tests ok?
Doc validation
DC in DSS
proof
FormDSS proof
DSS & in situ tests
Tests ok?
Analysisreport
Client information
Validated method
Sign
ProofreadingQA
yes
no
![Page 15: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/15.jpg)
16
General outlay of GMO activities for enforcement
- Laboratory Organisation
- Sample Analysis Workflow
- Proficiency Testing
![Page 16: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/16.jpg)
17
General definition:
‘evaluation of participant performance against pre-established criteria by means of interlaboratory comparisons’
Standard ISO/IEC 17043:2010(E) (Ed1 from 01-02-2010)
Scope: very broad (quantitative, qualitative, sequential, simultanous, single occasion, continuous scheme…)
Proficiency Testing
![Page 17: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/17.jpg)
18
General Proficiency Testing Procedure
Step 1 Dispatch
Step 2 Analysis
Step 3 Statistics
Step 4 Report
Proficiency Testing
![Page 18: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/18.jpg)
19
Step 1 Dispatch
- Test materials are dispatched to participating laboratories - Specific instructions about storage or handling of the test
material and the closing date by which your results should be returned.
- Some instructions may be included with the analysis to allow results to be compared but no specific methods which must be used are indicated
Laboratories are encouraged to use their own methods and procedures to reflect the handling of real
samples as closely as possible.
Proficiency Testing
![Page 19: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/19.jpg)
20
Step 2 Analysis
Participants analyse test materials and report results and methods (e.g. via the web)
Step 3 Statistics
A statistical analysis of results is performed and a z-score is awarded to the laboratory, which provides an assessment of your performance.
Full details of the statistical procedures used to calculate z- scores are detailed in the protocol.
Proficiency Testing
![Page 20: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/20.jpg)
21
Step 4 Report
After the closing date a confidential report is made available to participants.
This report identifies the performance of the laboratory and the anonymous performances of other laboratories in the test for comparison.
The report also contains details of the test material preparation, the testing carried out to ensure the test material is homogenous and methods used by participant laboratories.
NEW: Proficiency Test Provider should give ‘comments or recommendations, based on the outcomes of the proficiency testing round’ (ISO/IEC 17043)
Proficiency Testing
![Page 21: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/21.jpg)
22
Proficiency test Providers:
- FAPAS/GEMMA (UK) (powders, DNA)
- ISTA (CH) (Seeds)
- BIPEA (F) (powders)
- JRC-IHCP/IRMM (EU) (powders)
- GIPSA (US) (powders, DNA)
Proficiency Testing
![Page 22: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/22.jpg)
23
INTERPRETATION of PT outcome
Key evaluator: z-score (acceptable between ± 2)-Indicates results as equally well performing as the other partcipating labs in the PT
-what if falling ‘out of scope’- compare with other failing labs (similar methods, equipment …)- call on ‘Non Conformity’: repeat analysisNEW: input from PT provider
Proficiency Testing
![Page 23: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/23.jpg)
24
GM level 1 m/m [%] cp/cp [%]
Assigned value 0.1 -
Robust mean 0.12 0.102
GM level 2Assigned value 1.69 -
Robust mean 1.71 1.52
JRC-IHCP PT 2009
JRC-IHCP Proficiency Test 1 (D. Charels, M. Maras, T. Weber)
![Page 24: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/24.jpg)
25
Participants from third countries: Brazil, Chile, China, India, Rep. Of Korea, Malaysia, Mexico, Singapore, US, Switzerland
0
50
100
150
Total in
vited
ENGL
NRLThir
d cou
ntries
Regist
ration
sENGL
NRLThir
d cou
ntries
Sponta
neou
sDou
bleLaboratories
# of
invi
tatio
ns/r
egis
trat
ions
Invitations Registrations
54 12
6776
93
11
73
99110
JRC-IHCP PT 2009
![Page 25: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/25.jpg)
26
Results grouped per
0
50
100
Result
sENGL
NRLThir
d cou
ntries
Not su
bmitte
dRes
ults s
ubmitte
d
m/m
cp/cp Both
# of
resu
lts
Measurement unitLaboratories
5 8
33
60
93
11
65 74
93
JRC-IHCP PT 2009
![Page 26: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/26.jpg)
27
Data analysis : Z-scores using data from:
• NRLs• All participants
• Calculation of z-scores on the basis of:– Assigned reference value– Robust mean
JRC-IHCP PT 2009
![Page 27: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/27.jpg)
28
Statistical analysis:
• Aim: Look for parameters that may influence GM quantification e.g. instrumentation, DNA extraction method, real-time PCR method,…
• Multivariate analyses, ANOVA• Principal components analysis• Partial least squares regression
JRC-IHCP PT 2009
![Page 28: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/28.jpg)
29
m/m level 2reference value =1.69
-6
-5
-4
-3
-2
-1
0
1
2
3
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60
Laboratory (recoded)
Z-s
core
JRC-IHCP PT 2009
![Page 29: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/29.jpg)
30
cp/cp level 2robust mean = 1.52
-3-2-1012345678
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34
Laboratory (recoded)
Z-s
core
JRC-IHCP PT 2009
![Page 30: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/30.jpg)
31
EXPERIENCE from IPH (Be) PT testingAbout 100 GEMMA & ISTA tests (rule: one PT/method/year)
GEMMA: - GM maize : zygosity- rare GM: low amounts of DNA
ISTA: - GM canola : zygosity/copy number- GM cotton: reference material
Qualitative screening (CoSYPS): all favourable
Quantitative analysis: a) GEMMA: all favourableb) cotton/canola deviations
Proficiency Testing
![Page 31: Joint Research Centre (JRC) Proficiency Testing (support to](https://reader031.vdocuments.net/reader031/viewer/2022021022/6204ead84c89d3190e0c8198/html5/thumbnails/31.jpg)
32