fully automated quantification of cytomegalovirus (cmv) in ......2013/04/18  · 12 hôpital...

27
1 Fully automated quantification of cytomegalovirus (CMV) in whole 1 blood with the new sensitive Abbott RealTime CMV assay in the era 2 of the CMV international standard. 3 4 5 Nathalie Schnepf 1,2 , Catherine Scieux 1 , Matthieu Resche-Riggon 3 , Linda Feghoul 1 , Alienor 6 Xhaard 4 , Sébastien Gallien 5 , Jean-Michel Molina 5 , Gérard Socié 4 , Denis Viglietti 6 , François 7 Simon 1 , Marie-Christine Mazeron 1,2 , Jérôme LeGoff 1 . 8 9 10 1 Univ Paris Diderot, Pres Sorbone Paris Cité, Inserm U941, APHP, Microbiology laboratory, 11 Hôpital Saint-Louis, Paris, France 12 2 National Reference Center for CMV, Hôpital Saint-Louis, Paris, France 13 3 Univ Paris Diderot, Pres Sorbone Paris Cité, Biostatistics Department, APHP, Hôpital Saint- 14 Louis, Paris, France 15 4 Univ Paris Diderot, Pres Sorbone Paris Cité, Hematology and Stem Cell Transplantation 16 Department, APHP, Hôpital Saint-Louis, Paris, France 17 5 Univ Paris Diderot, Pres Sorbone Paris Cité, Inserm U941, Infectious Diseases Department, 18 APHP, Hôpital Saint-Louis, Paris, France 19 6 Univ Paris Diderot, Pres Sorbone Paris Cité, Nephrology Department, APHP, Hôpital Saint- 20 Louis, Paris, France. 21 22 23 24 Copyright © 2013, American Society for Microbiology. All Rights Reserved. J. Clin. Microbiol. doi:10.1128/JCM.00067-13 JCM Accepts, published online ahead of print on 24 April 2013 on May 27, 2021 by guest http://jcm.asm.org/ Downloaded from

Upload: others

Post on 23-Jan-2021

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

1

Fully automated quantification of cytomegalovirus (CMV) in whole 1

blood with the new sensitive Abbott RealTime CMV assay in the era 2

of the CMV international standard. 3

4

5

Nathalie Schnepf1,2, Catherine Scieux1, Matthieu Resche-Riggon3, Linda Feghoul1, Alienor 6

Xhaard4, Sébastien Gallien5, Jean-Michel Molina5, Gérard Socié4, Denis Viglietti6, François 7

Simon1, Marie-Christine Mazeron1,2, Jérôme LeGoff1. 8

9

10

1 Univ Paris Diderot, Pres Sorbone Paris Cité, Inserm U941, APHP, Microbiology laboratory, 11

Hôpital Saint-Louis, Paris, France 12

2 National Reference Center for CMV, Hôpital Saint-Louis, Paris, France 13

3 Univ Paris Diderot, Pres Sorbone Paris Cité, Biostatistics Department, APHP, Hôpital Saint-14

Louis, Paris, France 15

4 Univ Paris Diderot, Pres Sorbone Paris Cité, Hematology and Stem Cell Transplantation 16

Department, APHP, Hôpital Saint-Louis, Paris, France 17

5 Univ Paris Diderot, Pres Sorbone Paris Cité, Inserm U941, Infectious Diseases Department, 18

APHP, Hôpital Saint-Louis, Paris, France 19

6 Univ Paris Diderot, Pres Sorbone Paris Cité, Nephrology Department, APHP, Hôpital Saint-20

Louis, Paris, France. 21

22

23

24

Copyright © 2013, American Society for Microbiology. All Rights Reserved.J. Clin. Microbiol. doi:10.1128/JCM.00067-13 JCM Accepts, published online ahead of print on 24 April 2013

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 2: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

2

25

26

27

Corresponding author 28

29

Dr Jerome LeGoff, Pharm D, PhD 30

Laboratoire de Microbiologie 31

Hôpital Saint-Louis 32

1, Avenue Claude Vellefaux 33

75010 Paris 34

Tel: +33 1 42 49 94 84 Fax: +33 1 42 49 92 00 35

E-mail: [email protected] 36

37

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 3: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

3

ABSTRACT 38

Fully standardized reproducible and sensitive quantification assays for cytomegalovirus 39

(CMV) are needed to better define thresholds for antiviral therapy initiation and interruption. 40

We evaluated the new released Abbott RealTime CMV assay for CMV quantification on 41

whole blood (WB) that includes automated extraction and amplification (m2000 RealTime 42

system). Sensitivity, accuracy, linearity and intra- and inter-assay variability were validated in 43

WB matrix using quality control panels (QCMD) and the WHO international standard (IS). 44

Intra- and inter-assay coefficients of variation were 1.37% and 2.09% at 5 log10 copies/ml and 45

2.41% and 3.80% at 3 log10 copies/ml, respectively. According to QCMD and Abbott 46

RealTime CMV expected values, the lower limit of quantification was 104 and below 47

50 copies/ml, respectively. The conversion factor between international units and copies 48

(2.18), determined from serial dilutions of the WHO IS in WB, was significantly different 49

from the factor provided by the manufacturer (1.56) (P = 0.001). Results from 302 clinical 50

samples were compared to the Qiagen/artus CMV assay on the same m2000 RealTime 51

system. The two assays provided highly concordant results (concordance correlation 52

coefficient = 0.92), but Abbott RealTime CMV assay detected and quantified respectively 53

20.6% and 47.8% more samples than Qiagen/artus CMV assay. The sensitivity and 54

reproducibility results along with automation fulfill quality requirements to implement Abbott 55

RealTime CMV assay in clinical settings. Our results stress out the need for careful validation 56

of conversion factors of the WHO IS in WB provided by manufacturers to allow future 57

comparison of results obtained with different assays. 58

59 60

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 4: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

4

INTRODUCTION 61

Cytomegalovirus (CMV), a member of the Herpesviridiae family, establishes a life-long 62

persistent and latent infection within its host. Reactivations occur frequently throughout the 63

life with asymptomatic viral shedding in healthy individuals. However in 64

immunocompromised patients, especially in allogeneic hematopoietic stem cell or solid-organ 65

transplantation recipients, CMV may cause severe disease (1, 2). Viremia is a well-recognized 66

risk factor for CMV disease and viral loads kinetics has been reported to be predictive for the 67

development of CMV disease (3, 4). Quantitative viral genome testing in blood (whole blood 68

or plasma) is the best option for diagnosis, decision making regarding initiation of preemptive 69

therapy and monitoring response to therapy (5, 6). The reliability and accuracy in the viral 70

load determination are then critical points for the management of transplant patients. Due to 71

better sensitivities and reduced technical hand time, quantitative real-time PCR assays for 72

quantification of CMV DNA have largely replaced the pp65-antigenemia testing in routine 73

diagnostic laboratories (7, 8). 74

Because of the increased needs in quality certification requirements of laboratories, there is a 75

trend for the use of IVD/CE labeled or FDA-approved commercial assays. However, 76

commercially available assays may differ significantly between each other for the 77

measurement of CMV DNA loads in particular according to the extraction method used 78

which is a source of variability with whole blood (WB) (9-11). An interlaboratory comparison 79

of CMV viral load assays in 33 different laboratories over USA, Canada and Europe has 80

shown a significant variability with more than of 40% results with a delta log above 0.5, 81

which may impact patient care and limit inter-institutional comparisons (12). Two other 82

studies conducted in USA have reported interlaboratory comparison of CMV viral load 83

measures with both in-house and commercial assays and have shown significant differences 84

in quantitative values ranging to 2 up to 3 log10 between two laboratories (13, 14). In order to 85

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 5: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

5

standardize results and overcome the variability between laboratories, the World Health 86

Organization (WHO) Expert Committee on Biological Standardization has established the 87

first International Standard (IS) for human cytomegalovirus for Nucleic Acid Amplification 88

Techniques by November 30th 2010 (15). For each assay, a conversion factor is applied in 89

order to provide the results in International Units per ml (IU/ml). 90

In this study we report the evaluation of the recently available IVD/CE-labeled RealTime 91

CMV assay (Abbott RealTime CMV) that includes a complete fully automated extraction and 92

amplification of CMV DNA from WB on the m2000 RealTime system. The analytical 93

performances have been validated in WB matrix using quality control panels and the IS. 94

Clinical samples were tested and the results compared to those obtained with the 95

Qiagen/Artus IVD/CE-labeled CMV assay on the m2000 RealTime system. Our results 96

demonstrate a good reliability and accuracy of results. 97

98

MATERIALS AND METHODS 99

Standards and clinical samples. (i) QCMD samples. The QCMD 2010 (Quality Control for 100

Molecular Diagnostics) CMV proficiency panel (QCMD, Scotland) consisted of 10 101

lyophilized samples (QCMD CMV 10-01 to QCMD CMV 10-10). Nine samples contained 102

various concentrations of cultured CMV strain AD169 in either virus transport medium or 103

human plasma and one plasma sample was negative for CMV. In positive samples, CMV 104

DNA concentrations ranged from 230 to 2,552,701 copies/ml (i.e. 2.36 to 105

6.41 log10 copies/ml). (ii) WHO International Standard (WHO IS). The WHO IS for 106

human CMV for Nucleic Acid Amplification Techniques (National Institute for Biological 107

Standards and Control [NIBSC] code: 09/162, NIBSC, Hertfordshire, Great Brittany) is a 108

lyophilized whole virus preparation of the CMV Merlin strain (15). After reconstitution in 109

1 ml of water, the WHO IS has a concentration of 5x106 IU/ml (i.e. 6.7 log10 IU/ml). (iii) 110

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 6: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

6

Clinical samples. A total of 302 blood specimens received in the laboratory for CMV load 111

quantification from November 2010 to December 2010 were selected if at least two aliquots 112

of 0.5 ml of WB collected in EDTA tubes were stored at -80°C. They were collected from 113

207 patients, including 14 hematopoietic stem cell transplant (HSCT) recipients, 94 kidney 114

transplant recipients, 47 HIV-infected patients, 27 patients with leukemia or lymphoma and 115

11 patients with inflammatory bowel disease. The clinical samples were tested in singlet with 116

the Abbott RealTime CMV assay and with the test of record Qiagen/Artus CMV assay in 117

separate runs. 118

Quantitative real-time PCR assays. (i) Abbott RealTime CMV assay. Quantification of 119

CMV in WB was carried out with the Abbott RealTime CMV (Abbott Molecular Inc., Des 120

Plaines, Il, USA) on the m2000 RealTime platform that includes the m2000sp instrument for 121

automated extraction of DNA and the m2000rt instrument for the real time PCR in batches of 122

48 tests. Extraction of DNA was done with the Sample Preparation System DNA Kit. The 123

Abbott RealTime CMV assay uses three reagents kits: Amplification Reagent Kit for the 124

amplification, Control Kit for external controls and Calibrator Kit for the standard curve. The 125

amplification targets two highly conserved regions, within the UL34 and UL80.5 genes, 126

respectively. An internal control (IC) is also supplied to check the overall process including 127

DNA extraction and possible PCR inhibition. Automated DNA extraction was performed 128

from 500 µl WB (processed 300 µl, eluted in 150 µl) in the Abbott m2000sp instrument, 129

followed by automated addition into the PCR plate of the master mixture and DNA extracts 130

(volume used for PCR: 20 µl, corresponding to 40µl of WB). The sealed PCR plate was 131

loaded on the m2000rt instrument for quantification of viral CMV DNA. Two controls (one 132

positive and one negative) provided by the manufacturer are included in each run. Two 133

calibrators (A and B) analyzed in triplicate were used to establish the standard curve and 134

calculated the CMV DNA concentration in samples. The results are expressed in copies/ml or 135

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 7: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

7

log10 copies/ml, as follows : no detection of amplification signal = “Not Detected”, detection 136

of amplification signal with value under 1.60 log10 copies/ml = “Detected”, absolute values 137

for quantification between 1.60 à 8.00 log10 copies/ml, and for values above 8.00 log10 138

copies/ml = “Upper limit of quantification”. (ii) Qiagen/Artus CMV assay. Real-time PCR 139

with the CMV ABI Prism SDS Kit (Qiagen Hamburg GmbH, Hilde, Germany) was also 140

performed on the m2000 RealTime platform in batches of 48 tests. The Qiagen/Artus CMV 141

kit contains reagents and enzymes for the specific amplification of a 105 bp region of the 142

CMV major immediate early gene. DNA extractions were performed using the Abbott m2000 143

Sample Preparation System DNA kit. CMV DNA was extracted from 500 µl of WB 144

(processed 300 µl) including IC spiking and eluted in a final volume of 150 µl. According to 145

the manufacturer’s instructions, PCR was carried out in a 96-well plate with a reaction 146

volume of 50 µl containing 20 µl of DNA extract and 30 µl of Master mixture. Four external 147

positive controls (CMV QS 1–4) were used to establish the standard curve. Controls are DNA 148

plasmids containing either the CMV target sequence (QS) or a heterologous target sequence 149

(IC). The results are given in copies/ml or log10 copies/ml, as follows: no detection of 150

amplification signal = “Not Detected”, detection of amplification signal with value under 151

2.30 log10 copies/ml = “Detected”, absolute values for quantification between 2.30 à 8.00 152

log10 copies/ml, and for values above 8.00 log10 copies/ml = “Upper limit of quantification”. 153

Analytical performances of the Abbott RealTime CMV assay. (i) The lower limit of 154

quantification (LLQ) was determined first by using serial dilutions of the QCMD CMV 10-155

08 sample (23988 copies/ml; i.e. 4.38 log10 copies/ml) at expected values of 200, 150, 100 156

and 50 copies/ml. The first dilution was prepared by adding 417 µl of QCMD CMV 10-08 157

sample to 50 ml of CMV DNA negative WB. The LLQ was determined secondarily by using 158

serial dilutions of clinical samples with expected viral loads of 150, 100 and 50 copies/ml 159

with the Abbott RealTime CMV assay. Serial dilutions were generated starting with a fifty 160

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 8: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

8

fold dilution of a pool of 6 WB positive samples at 4 log10 copies/ml in CMV negative WB. 161

For the LLQ based on QCMD and Abbott RealTime CMV expected values, each dilution was 162

tested 28 to 30 times. (ii) The between-run and within-run reproducibility was determined 163

at 3 log10 copies/ml and 5 log10 copies/ml by diluting serially in CMV DNA negative WB the 164

remainder of 6 CMV DNA positive WB samples with values around 6 log10 copies/ml. Thirty 165

and eleven replicates were tested for intra-assay and inter-assay reproducibility, respectively. 166

(iii) The linearity of the assay was verified with dilutions of a highly CMV DNA positive 167

sample in CMV negative WB. These dilutions had expected viral loads ranging from 1.7 to 5 168

log10 copies/ml. For each dilution, CMV DNA was quantified with the Abbott RealTime 169

CMV assay at least three times and the mean concentration was calculated. 170

Concordance correlation coefficient. To assess the agreement of the two methods, we use 171

the concordance correlation coefficient (CCC) (16). A value of 1 denotes a perfect 172

concordance; a value of zero denotes its complete absence. In our work, as the data were left-173

censored by the minimal detected value of each method, we use the maximum likelihood 174

estimator proposed by Barnhart et al. to estimate the CCC (17). 95% confidence intervals 175

(95% CI) are given and were assessed using bootstrap. 176

Conversion factor between copies/ml and IU/ml. The conversion factor between copies/ml 177

and UI/ml was evaluated with the Abbott RealTime assay. Serial dilutions of the WHO IS 178

were prepared in PBS (PBS_dilutions) and in WB (WB_dilutions) with expected values of 5, 179

4 and 3 log10 IU/ml. In detail, 200 µl of the reconstituted WHO IS was added to 9.8 ml of 180

PBS (1:50 dilution) to constitute the PBS_dilution#1 at an expected concentration of 181

5 log10 IU/ml and the mixture was homogenized on a rotary shaker for 20 minutes. Two 182

successive ten-fold dilutions were carried out to obtain PBS_dilution#2 (4 log10 IU/ml) and 183

PBS_dilution#3 (3 log10 IU/ml). Each dilution was split in aliquots of 600 µl. WB_dilution#1, 184

WB_dilution#2 and WB_dilution#3 were prepared following the same protocol. To assess the 185

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 9: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

9

conversion factor in PBS and WB, 11 replicates of the three PBS_dilutions and the three 186

WB_dilutions were analyzed in the same run. 187

Statistical analysis. Analyses were performed using the statistical R package (2.15.0) 188

(http://www.R-project.org/). A P value < 0.05 was considered to be a statistical significance. 189

(i) Determination of the LLQ. Parameters of the detection-number of copies curve were 190

estimated using a probit regression model. The LLQ defined as the 95th percentile of the 191

previous model was then estimated. (ii) Linearity. Observed values were plotted against 192

theoretical values. Parameters of the corresponding linear regression model were estimated. 193

(iii) Conversion factor between copies/ml and IU/ml. Conversion factors for the number of 194

copies were estimated using a linear regression model (observed values against theoretical 195

values) without intercept. Conversion factors for log10 of copies were estimated using the 196

mean difference between the observed and the theoretical value. 95% CI are given and tests 197

against values given by the Abbott RealTime CMV assay were performed. 198

199

RESULTS 200

Analytical performances of the Abbott RealTime CMV assay. The LLQ, between-run and 201

within-run reproducibility and linearity of the assay were determined by using dilutions of 202

QCMD or clinical samples positive for CMV DNA. As the assay is CE marked for whole 203

blood, the dilutions were performed in CMV negative WB. (i) Lower limit of quantification. 204

The LLQ for WB was defined as the CMV viral load detected by the assay with the 205

probability of 95% and tested with dilutions of QCMD samples and clinical samples. Probit 206

analysis of the data predicted a LLQ at 104 copies/ml (95% CI: 81-122 copies/ml) with the 207

QCMD dilutions (Table 1). All dilutions of clinical samples with expected values of 150 and 208

100 copies/ml and 96.7% with expected values of 50 copies/ml were detected. (ii) Between-209

run and within-run reproducibility. Intra-assay coefficients of variation (CV), determined 210

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 10: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

10

on 30 replicates, were 1.37% and 2.41% at the mean values of 5.09 and 3.04 log10 copies/ml, 211

respectively. The same two samples were tested in 11 different assays. Testing showed CV of 212

2.09% and 3.80% for 5.01 and 2.95 log10 copies/ml, respectively. The variability of the 213

detection of the IC supplied with Abbott RealTime CMV assay to check the overall process 214

including DNA extraction and possible PCR inhibition was evaluated on the clinical samples. 215

Overall through the 302 samples tested in 14 separate experiments, no inhibition was detected 216

and the mean cycle threshold (Ct) value (±SD) was 29.28 (± 0.30). The intra-run variation 217

coefficients ranged from 0.01 % to 1.71 %. The inter run variation coefficient calculated with 218

the means of Ct values of each run was 0.43 %. (iii) Linearity. The assay was linear 219

(r²=0.9682) in the range of all samples tested (1.7 to 5 log10 copies/ml) (not shown). 220

Correlation with QCMD values. CMV DNA was not detectable in the negative QCMD 221

CMV 10-05 sample and was quantified for the other 9 positive samples (Table 2). CMV DNA 222

loads measured by the Abbott RealTime CMV assay were lower than those expected. 223

Differences between measured and expected values ranged from -0.13 (QCMD CMV 10-02) 224

to -0.55 log10 copies/ml (QCMD CMV 10-08), with a mean of -0.26 log10 copies/ml When 225

viral loads were expressed in copies/ml, the conversion factor between measured and 226

expected values was 1.81 (95% CI: 1.78 to 1.83). 227

Comparison of the Abbott RealTime CMV and Qiagen/Artus CMV assays. The 302 228

clinical samples were analyzed using both analytical systems. 229

By using the Abbott RealTime CMV assay, CMV DNA was detected in 129 (42.7%) clinical 230

samples. For 99 of them (32.8%), DNA was quantifiable (above 1.60 log10 copies/ml). With 231

the Qiagen/Artus CMV assay, CMV DNA was detected in 107 (35.4%) samples of which 67 232

(22.2%) were quantified above the LLQ value (2.30 log10 copies/ml). Compared to 233

Qiagen/Artus CMV assay, the Abbott RealTime CMV assay provided thus an increase of 234

20.6% and 47.8% of samples detected and quantified, respectively. 235

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 11: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

11

Results between the two techniques were discordant for 38 (12.6%) samples. Discrepancies 236

were observed only for samples with low copies numbers, mostly below the lower 237

quantification limit. In 8 of them, CMV DNA was undetectable by using the Abbott RealTime 238

CMV assay but detected by using the Qiagen/Artus CMV assay (DNA load below the LLQ 239

for 6 samples and at 2.36 and 2.78 log10 copies/ml for the two other samples, respectively). 240

Conversely, CMV DNA was undetectable with the Qiagen/Artus CMV assay in 30 samples, 241

but detected in 23 of them (DNA load below the LLQ) or quantified in the 7 other samples 242

(median DNA load: 2.00 log10 copies/ml; range, 1.67 to 2.18) with the Abbott RealTime 243

CMV assay. To further analyze the 30 Abbott RealTime CMV positive and Qiagen/Artus 244

CMV negative samples, we examined if previous or subsequent samples collected within two 245

weeks in the same patients were tested with the Qiagen/Artus CMV assay. For the 30 246

discrepant samples, 15 previous or subsequent samples were available (including 13 tested in 247

this study) and all were positive. 248

The two assays showed for the 65 positive samples quantified with both assays a good 249

concordance with a CCC of 0.92 (95% CI: 0.62 to 0.98). Viral load values measured with the 250

Qiagen/Artus CMV assay were on average 0.23 log10 higher than those measured by the 251

Abbott RealTime CMV assay (P = 0.0003). Bland Altman analysis on the same 65 samples 252

showed that 41 (63.1%) and 63 (96.9%) of them had a variation below 0.5 log10 and 1.0 log10 253

copies/ml, respectively (Fig. 1). 254

In order to further analyze the correlation between the two assays, we compared the viral load 255

kinetics for patients with at least three successively positive samples. As shown in Fig. 2, the 256

profiles are very similar with overlapping patterns in all patients. In addition, variations were 257

always in the same direction except between the second and third sample for patient #72 258

(decrease of 0.08 log10 copies/ml with the Qiagen/Artus CMV assay and increase of 0.15 log10 259

with the Abbott RealTime CMV assay) and the first and second sample for patient #182 260

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 12: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

12

with the Abbott RealTime CMV assay). 261

Determination of conversion factor between international units and copies. Boxplots of 262

conversion factors calculated for the 11 replicates of each dilution of the WHO IS in PBS 263

(PBS_dilution#1, PBS_dilution#2 and PBS_dilution#3) or in WB (WB_dilution#1, 264

WB_dilution#2 and WB_dilution#3) are depicted in Fig. 3. In PBS, the conversion factor 265

varied according to the dilution tested (Fig. 3A). In WB, the conversion factor was roughly 266

constant and always higher than the manufacturer's value (Fig. 3B). The seemingly wide 267

dispersion of conversion factor values for the WB_dilution#1 was due only to one extreme 268

value (8.04) which was however not rejected. 269

The conversion factors determined using linear regression models were in copies/ml 1.16 270

(95% CI: 1.11 to 1.22, test against Abbott RealTime value [1.56]: P < 0.0001) for PBS and 271

2.18 (95% CI: 1.79 to 2.80, test against Abbott RealTime value [1.56]: P = 0.001) for WB and 272

in log10 copies/ml 0.15 (95% CI: 0.11 to 0.18, test against Abbott RealTime value [0.19]: 273

P = 0.02) for PBS and 0.45 (95% CI: 0.38 to 0.52, test against Abbott RealTime value [0.19]: 274

P < 0.0001) for WB. The calculated conversion factor in WB was thus significantly different 275

compared with the manufacturer’s conversion factor. 276

277

DISCUSSION 278

Sensitive and reproducible quantification of CMV DNA is crucial for the initiation and the 279

monitoring of therapy to control CMV infection in transplant recipients. In regards to the 280

detection of CMV DNA from blood, the specimens, WB or plasma, vary. Both specimens 281

have been shown suitable for the monitoring of CMV infection in transplant recipients (4, 18, 282

19). A fully automated real time PCR assay, the IVD/CE-labeled Abbott RealTime CMV 283

assay provides distinct procedures adapted to each of these specimens. Use of WB as a 284

matrix, also convenient for other viral targets of interest in the monitoring of transplant 285

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 13: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

13

recipients (i.e. Epstein-Barr virus, Human herpes 6 virus), takes advantage for the laboratory 286

workflow optimization by avoiding a centrifugation step required with plasma (20). In this 287

study, we evaluated Abbott RealTime CMV assay for the quantification of CMV in WB. 288

CMV DNAemia dynamics should be taken into consideration for the initiation of preemptive 289

therapy as underlined by recent studies (21, 22). Thus the reproducibility of the assay used for 290

monitoring CMV infection is of great concern. In this regard the Abbott RealTime CMV 291

assay was shown to achieve a high level of both intra and inter reproducibility with low 292

coefficients of variation for high DNA levels and DNA levels close to the cut-offs usually 293

proposed for therapy initiation. This low variability was further confirmed with the narrow 294

range of Ct values of the IC supporting the effectiveness of the automated extraction 295

procedure used in the assay. Importantly no PCR inhibitory effect was observed with the WB 296

samples analyzed in the present study. Since the implementation of the assay in routine (from 297

May 21st to September 30th 2012), IC cycle threshold was suggestive of PCR inhibitor or 298

extraction deficiency in only 16 samples out of 4560 (0.35%) (i.e. cycle threshold value out of 299

the range of validity as established automatically in the calibration run) (not shown). 300

The LLQ of the assay according to the manufacturer is 40 copies/ml of WB. This threshold 301

was validated by testing QCMD panel samples and clinical samples diluted in WB to 302

maintain extraction conditions, thus confirming the high sensitivity of this assays for CMV 303

quantification in WB. This new commercial assay validated and released for WB samples 304

reaches a higher sensitivity than the tests already commercially available which provide a 305

higher LLQ (23, 24). 306

We compared Abbott RealTime CMV with Qiagen/Artus CMV assay on 302 clinical samples 307

by using the same platform for both extraction and amplification, thus avoiding variability 308

due to different instruments and extraction methods. The two assays were highly concordant. 309

Similar kinetics of CMV replication from patients with successive samples confirmed this 310

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 14: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

14

correlation. Most of the discrepancies occurred for samples positive with the Abbott 311

RealTime CMV assay and negative with the Qiagen/Artus CMV assay at low viral loads, 312

which is in agreement with the lower limit of detection of the Abbott RealTime CMV assay 313

validated with serial dilutions. Because the use of a third assay may have little chance to 314

resolve the discrepancies, previous or subsequent samples collected within two weeks in the 315

same patients were examined and all confirm that patients with discrepant results had a CMV 316

active infection. The Abbott RealTime CMV assay showed a significantly higher sensitivity 317

with 42.7% of samples positive compared to 35.4% with the Qiagen/Artus CMV assay. In 318

addition, the Abbott RealTime CMV assay provided a 47.8% increase of quantified samples 319

compared to the Qiagen/Artus CMV assay (32.8% versus 22.2%). This high sensitivity will 320

allow to assess more precisely the kinetics of viral replication thus (i) to early detect 321

individuals with short CMV doubling time and (ii) to better determine CMV half-time in 322

patients receiving antiviral therapy. These measures could help to adjust the duration of 323

treatment (3, 22, 25). Despite a good overall correlation among concordant positive results, 324

differences above 0.5 log10 copies/ml were observed for 36.9% of these samples. 325

Differences in DNA quantification techniques between laboratories have led to site-specific 326

recommendations for both initiating and monitoring antiviral treatment. The international 327

quantitative reference standard (WHO IS for CMV) currently available will likely allow direct 328

comparisons between different quantification techniques after conversion of copies/ml into 329

UI/ml. For the Abbott RealTime CMV assay, the manufacturer had determined the conversion 330

factor in plasma and provides a unique conversion factor whatever the matrix used (WB or 331

plasma). When using the WHO IS diluted in PBS or WB, the conversion factor 332

experimentally determined in the present study was significantly different from the one 333

proposed by the manufacturer. Its value was lower in PBS and higher in WB meaning that 334

less CMV DNA was quantified from WB, likely reflecting to difference in DNA extraction 335

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 15: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

15

efficiency. An even more divergent conversion factor for WB was found by Furione et al. 336

using Abbott RealTime PCR assay and WHO IS diluted in WB (26). The reasons for this 337

discrepancy were not clear. As the same automated extraction system was used in both 338

studies, difference in extraction efficiency was very unlikely. The dilution factors of the 339

reconstituted WHO IS in WB differed between the studies (1/16 in the study by Furione et al. 340

versus 1/50 in the present study) (26). As indicated in the package insert, once reconstituted, 341

the WHO IS should be diluted in the matrix appropriate to the material being calibrated. 342

However, the dilution factor to apply is not indicated. Thus, in order to normalize the results 343

obtained with different commercially available and in-house assays, dilution factors and the 344

matrix used to dilute the WHO IS as well as the statistical analysis of the results should be 345

standardized. Then, a detailed and consensual protocol should be defined to calculate the 346

conversion factor according to assays and matrixes used. 347

In conjunction with current laboratory quality requirements as defined by the International 348

Standardization Organization (ISO) 1589 norm for laboratory techniques, commercial assays 349

fulfill several criteria that an individual hospital laboratory will achieve with difficulty. 350

Considering the benefits of a fully automated assay in reducing hands on time and repetitive 351

motion injuries and the traceability and security of blood sample management, and the 352

precision and the reproducibility of the results observed in this study, Abbott RealTime CMV 353

assay answers several quality requirements for the CMV quantitative assay implementation in 354

a routine laboratory. 355

356

ACKNOWLEDGMENTS 357

We are grateful to Ghislaine Borit and Muriel Vitu for their technical assistance and Dr 358

Nathalie Parquet for providing whole blood. 359

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 16: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

16

J. LeGoff, F. Simon and MC. Mazeron have consulted for Abbott Molecular. All other 360

authors have declared that no competing interests exist. This does not alter the authors' 361

adherence to all the Journal of Clinical Microbiology policies on sharing data and materials. 362

363

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 17: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

17

REFERENCES 364

1. Beam E, Razonable RR. 2012. Cytomegalovirus in solid organ transplantation: 365

epidemiology, prevention, and treatment. Curr Infect Dis Rep 14:633-641. 366

2. Ljungman P, Hakki M, Boeckh M. 2011. Cytomegalovirus in hematopoietic stem 367

cell transplant recipients. Hematol Oncol Clin North Am 25:151-169. 368

3. Emery VC, Sabin CA, Cope AV, Gor D, Hassan-Walker AF, Griffiths PD. 2000. 369

Application of viral-load kinetics to identify patients who develop cytomegalovirus 370

disease after transplantation. Lancet 355:2032-2036. 371

4. Kotton CN, Kumar D, Caliendo AM, Asberg A, Chou S, Snydman DR, Allen U, 372

Humar A. 2010. International consensus guidelines on the management of 373

cytomegalovirus in solid organ transplantation. Transplantation 89:779-795. 374

5. Baldanti F, Lilleri D, Gerna G. 2008. Monitoring human cytomegalovirus infection 375

in transplant recipients. J Clin Virol 41:237-241. 376

6. Gerna G, Lilleri D, Chiesa A, Zelini P, Furione M, Comolli G, Pellegrini C, 377

Sarchi E, Migotto C, Bonora MR, Meloni F, Arbustini E. 2011. Virologic and 378

immunologic monitoring of cytomegalovirus to guide preemptive therapy in solid-379

organ transplantation. Am J Transplant 11:2463-2471. 380

7. Cardenoso L, Pinsky BA, Lautenschlager I, Aslam S, Cobb B, Vilchez RA, 381

Hirsch HH. 2013. CMV antigenemia and quantitative viral load assessments in 382

hematopoietic stem cell transplant recipients. J Clin Virol 56:108-112. 383

8. Piiparinen H, Hockerstedt K, Gronhagen-Riska C, Lautenschlager I. 2004. 384

Comparison of two quantitative CMV PCR tests, Cobas Amplicor CMV Monitor and 385

TaqMan assay, and pp65-antigenemia assay in the determination of viral loads from 386

peripheral blood of organ transplant patients. J Clin Virol 30:258-266. 387

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 18: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

18

9. Lee AV, Atkinson C, Manuel RJ, Clark DA. 2011. Comparative evaluation of the 388

QIAGEN QIAsymphony(R) SP system and bioMerieux NucliSens easyMAG 389

automated extraction platforms in a clinical virology laboratory. J Clin Virol 52:339-390

343. 391

10. Mengelle C, Mansuy JM, Da Silva I, Davrinche C, Izopet J. 2011. Comparison of 2 392

highly automated nucleic acid extraction systems for quantitation of human 393

cytomegalovirus in whole blood. Diagn Microbiol Infect Dis 69:161-166. 394

11. Mengelle C, Mansuy JM, Saune K, Barthe C, Boineau J, Izopet J. 2012. A new 395

highly automated extraction system for quantitative real-time PCRs from whole blood 396

samples: routine monitoring of opportunistic infections in immunosuppressed patients. 397

J Clin Virol 53:314-319. 398

12. Pang XL, Fox JD, Fenton JM, Miller GG, Caliendo AM, Preiksaitis JK. 2009. 399

Interlaboratory comparison of cytomegalovirus viral load assays. Am J Transplant 400

9:258-268. 401

13. Hayden RT, Yan X, Wick MT, Rodriguez AB, Xiong X, Ginocchio CC, Mitchell 402

MJ, Caliendo AM. 2012. Factors contributing to variability of quantitative viral PCR 403

results in proficiency testing samples: a multivariate analysis. J Clin Microbiol 404

50:337-345. 405

14. Wolff DJ, Heaney DL, Neuwald PD, Stellrecht KA, Press RD. 2009. Multi-Site 406

PCR-based CMV viral load assessment-assays demonstrate linearity and precision, but 407

lack numeric standardization: a report of the association for molecular pathology. J 408

Mol Diagn 11:87-92. 409

15. Freyer JF, Heath AB, Anderson R, Minor PD, the Collaborative Study Group. 410

2010. Collaborative study to evaluate the proposed 1st WHO International Standard 411

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 19: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

19

for human cytomegalovirus (HCMV) for nucleic acid amplification (NAT)-based 412

assays. WHO ECBS Report 2010; WHO/BS/10.2138:1-40. 413

16. Lin LI. 1989. A concordance correlation coefficient to evaluate reproducibility. 414

Biometrics 45:255-268. 415

17. Barnhart HX, Song J, Lyles RH. 2005. Assay validation for left-censored data. Stat 416

Med 24:3347-3360. 417

18. Andrews PA, Emery VC, Newstead C. 2011. Summary of the British 418

Transplantation Society Guidelines for the Prevention and Management of CMV 419

Disease After Solid Organ Transplantation. Transplantation 92:1181-1187. 420

19. Ljungman P. 2008. CMV infections after hematopoietic stem cell transplantation. 421

Bone Marrow Transplant 42 Suppl 1:S70-S72. 422

20. Deback C, Geli J, Ait-Arkoub Z, Angleraud F, Gautheret-Dejean A, Agut H, 423

Boutolleau D. 2009. Use of the Roche LightCycler 480 system in a routine laboratory 424

setting for molecular diagnosis of opportunistic viral infections: Evaluation on whole 425

blood specimens and proficiency panels. J Virol Methods 159:291-294. 426

21. Atabani SF, Smith C, Atkinson C, Aldridge RW, Rodriguez-Peralvarez M, 427

Rolando N, Harber M, Jones G, O'Riordan A, Burroughs AK, Thorburn D, 428

O'Beirne J, Milne RS, Emery VC, Griffiths PD. 2012. Cytomegalovirus replication 429

kinetics in solid organ transplant recipients managed by preemptive therapy. Am J 430

Transplant 12:2457-2464. 431

22. Munoz-Cobo B, Solano C, Costa E, Bravo D, Clari MA, Benet I, Remigia MJ, 432

Montoro J, Navarro D. 2011. Dynamics of cytomegalovirus (CMV) plasma 433

DNAemia in initial and recurrent episodes of active CMV infection in the allogeneic 434

stem cell transplantation setting: implications for designing preemptive antiviral 435

therapy strategies. Biol Blood Marrow Transplant 17:1602-1611. 436

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 20: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

20

23. Michelin BD, Hadzisejdic I, Bozic M, Grahovac M, Hess M, Grahovac B, Marth 437

E, Kessler HH. 2008. Detection of cytomegalovirus (CMV) DNA in EDTA whole-438

blood samples: evaluation of the quantitative artus CMV LightCycler PCR kit in 439

conjunction with automated sample preparation. J Clin Microbiol 46:1241-1245. 440

24. Raggam RB, Bozic M, Salzer HJ, Hammerschmidt S, Homberg C, Ruzicka K, 441

Kessler HH. 2010. Rapid quantitation of cytomegalovirus DNA in whole blood by a 442

new molecular assay based on automated sample preparation and real-time PCR. Med 443

Microbiol Immunol 199:311-316. 444

25. Buyck HC, Griffiths PD, Emery VC. 2010. Human cytomegalovirus (HCMV) 445

replication kinetics in stem cell transplant recipients following anti-HCMV therapy. J 446

Clin Virol 49:32-36. 447

26. Furione M, Rognoni V, Cabano E, Baldanti F. 2012. Kinetics of human 448

cytomegalovirus (HCMV) DNAemia in transplanted patients expressed in 449

international units as determined with the Abbott RealTime CMV assay and an in-450

house assay. J Clin Virol 55:317-322. 451

452

453 454

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 21: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

21

FIGURE LEGENDS 455

456

FIG 1 Bland Altman analysis between the CMV Qiagen/Artus and Abbott RealTime CMV 457

assays for samples (n=65) with a CMV DNA load above the lower limit of quantification 458

(LLQ) of each assay (2.30 log10 and 1.60 log10 copies/ml for the Abbott RealTime CMV and 459

Qiagen/Artus CMV assays, respectively). CMV DNA loads are expressed in log10 copies/ml. 460

461

462

FIG 2 Kinetics of CMV replication in whole blood in seven patients, by using Qiagen/Artus 463

CMV assay (open triangles) and CMV RealTime Abbott assay (closed circles). Patient 72 was 464

an HSCT recipient and other patients were kidney transplant recipients. CMV DNA loads are 465

expressed in log10 copies/ml. 466

467

468

FIG 3 Conversion factors (copies/ml to IU/ml) in PBS and whole blood. 469

Eleven replicates of each dilution of the WHO IS in PBS or WB (at expected values of 1,000, 470

10,000 and 100,000 copies/ml) were tested in the same run. Boxplots of conversion factors 471

estimated on each dilution were shown for PBS (A) and whole blood (B). Manufacturer’s 472

values are given by the dotted horizontal line. 473

474

475

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 22: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

22

TABLES 476

TABLE 1 Lower limit of quantification (LLQ) of the Abbott RealTime CMV assay for whole 477

blood. 478

Expected valuesa

No. of replicates

Mean valuesa Detection rate (%)

QCMDb 200 30 91 100.0 150 30 67 100.0 100 28 39 89.3 50 30 20 70.0 25 30 22 20.0

Clinical samplesc

150 30 147 100.0 100 30 142 100.0 50 29 72 96.7

a Values are expressed in copies/ml. 479

b The LLQ was determined by using dilutions of QCMD CMV 10-08 sample in whole blood. 480

c The LLQ was determined by using dilutions of clinical samples in whole blood. 481

482

483

TABLE 2 Quantification of CMV DNA in QCMD 2010 CMV samples. 484

QCMD sample

Expected values a

Abbott RealTime CMV a

10-01 3.27 2.96 10-02 2.36 2.23 10-03 5.44 5.23 10-04 3.74 3.45 10-05 ndb ndb 10-06 6.41 6.15 10-07 3.26 3.03 10-08 4.38 3.83 10-09 2.84 2.59 10-10 4.23 4.07

a Values are expressed in log10 copies/ml. 485

b nd: CMV DNA is not detected. 486

487

488

489

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 23: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 24: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 25: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 26: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

1

TABLE 1 Lower limit of quantification (LLQ) of the Abbott RealTime CMV assay for whole 1

blood. 2

Expected valuesa

No. of replicates

Mean valuesa Detection rate (%)

QCMDb 200 30 91 100.0 150 30 67 100.0 100 28 39 89.3 50 30 20 70.0 25 30 22 20.0

Clinical samplesc

150 30 147 100.0 100 30 142 100.0 50 29 72 96.7

a Values are expressed in copies/ml. 3

b The LLQ was determined by using dilutions of QCMD CMV 10-08 sample in whole blood. 4

c The LLQ was determined by using dilutions of clinical samples in whole blood. 5

6

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from

Page 27: Fully automated quantification of cytomegalovirus (CMV) in ......2013/04/18  · 12 Hôpital Saint-Louis, Paris, France 13 2 National Reference Center for CMV, Hôpital Saint-Louis,

1

TABLE 2 Quantification of CMV DNA in QCMD 2010 CMV samples. 1

QCMD sample

Expected values a

Abbott RealTime CMV a

10-01 3.27 2.96 10-02 2.36 2.23 10-03 5.44 5.23 10-04 3.74 3.45 10-05 ndb ndb 10-06 6.41 6.15 10-07 3.26 3.03 10-08 4.38 3.83 10-09 2.84 2.59 10-10 4.23 4.07

a Values are expressed in log10 copies/ml. 2

b nd: CMV DNA is not detected. 3

4

5

on May 27, 2021 by guest

http://jcm.asm

.org/D

ownloaded from