Escolar Documentos
Profissional Documentos
Cultura Documentos
Abstract
Background: The QuantiFERONH-TB Gold In-Tube test (QFT-GIT) is a viable alternative to the tuberculin skin test (TST) for
detecting Mycobacterium tuberculosis infection. However, within-subject variability may limit test utility. To assess variability,
we compared results from the same subjects when QFT-GIT enzyme-linked immunosorbent assays (ELISAs) were performed
in different laboratories.
Methods: Subjects were recruited at two sites and blood was tested in three labs. Two labs used the same type of
automated ELISA workstation, 8-point calibration curves, and electronic data transfer. The third lab used a different
automated ELISA workstation, 4-point calibration curves, and manual data entry. Variability was assessed by interpretation
agreement and comparison of interferon-c (IFN-c) measurements. Data for subjects with discordant interpretations or
discrepancies in TB Response .0.05 IU/mL were verified or corrected, and variability was reassessed using a reconciled
dataset.
Results: Ninety-seven subjects had results from three labs. Eleven (11.3%) had discordant interpretations and 72 (74.2%) had
discrepancies .0.05 IU/mL using unreconciled results. After correction of manual data entry errors for 9 subjects, and
exclusion of 6 subjects due to methodological errors, 7 (7.7%) subjects were discordant. Of these, 6 (85.7%) had all TB
Responses within 0.25 IU/mL of the manufacturers recommended cutoff. Non-uniform error of measurement was observed,
with greater variation in higher IFN-c measurements. Within-subject standard deviation for TB Response was as high as
0.16 IU/mL, and limits of agreement ranged from 20.46 to 0.43 IU/mL for subjects with mean TB Response within 0.25 IU/
mL of the cutoff.
Conclusion: Greater interlaboratory variability was associated with manual data entry and higher IFN-c measurements.
Manual data entry should be avoided. Because variability in measuring TB Response may affect interpretation, especially
near the cutoff, consideration should be given to developing a range of values near the cutoff to be interpreted as
borderline, rather than negative or positive.
Citation: Whitworth WC, Hamilton LR, Goodwin DJ, Barrera C, West KB, et al. (2012) Within-Subject Interlaboratory Variability of QuantiFERON-TB Gold In-Tube
Tests. PLoS ONE 7(9): e43790. doi:10.1371/journal.pone.0043790
Editor: Madhukar Pai, McGill University, Canada
Received May 3, 2012; Accepted July 23, 2012; Published September 6, 2012
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for
any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding: The United States Air Force (USAF) funded this study as part of a larger project assessing reproducibility of the QuantiFERON-TB Gold In-Tube tests. The
USAF and the Centers for Disease Control and Prevention (CDC) reviewed the study design, data collection methods, and analysis plans prior to approval. The
USAF, U.S. Army, and CDC cleared the manuscript for publication according to established guidelines. No outside funders had a role in the study design, data
collection, analysis, decision to publish, or preparation of the manuscript.
Competing Interests: The authors have declared that no competing interests exist.
* E-mail: wcw2@cdc.gov
a Current address: Epidemiology Consult Services, United States Air Force School of Aerospace Medicine, Wright-Patterson Air Force Base, Dayton, Ohio, United
States of America
b Current address: Healthcare Informatics Division/SG6H, United States Air Force, Lackland Air Force Base, Texas, United States of America
c Current address: Geneva Foundation, Akimeka Division, San Antonio, Texas, United States of America
d Current address: Department of Aeromedical Research, United States Air Force School of Aerospace Medicine, Wright-Patterson Air Force Base, Dayton, Ohio,
United States of America
Introduction
Interferon gamma (IFN-c) release assays (IGRAs) are designed
to detect both latent Mycobacterium tuberculosis infection (LTBI) and
infections manifesting as active tuberculosis disease, collectively
referred to as M. tuberculosis infection (MtbI). IGRAs are a popular,
viable, and often preferred alternative to the traditional tuberculin
skin test (TST) in some settings [13]. Despite inadequacies in
diagnostic standards for identifying MtbI, numerous studies have
assessed the sensitivity and specificity of IGRAs [24]. However,
few studies have assessed the within-subject variability of IGRA
results. Within-subject variability includes differences in test results
due to both subject fluctuations and test performance fluctuations.
Excessive variability in IGRA results may limit their utility for
detecting MtbI. A limited number of studies have assessed IGRA
variability among people where treatment might affect serial test
results [59] or among contacts, healthcare workers (HCW), or
residents of high-TB burden countries where ongoing transmission
may affect serial IGRA results [1024]. Rarely have investigators
examined variability due solely to test performance fluctuations on
blood collected at the same time [13,20]. No published
investigation has addressed variability when IGRAs are performed
in different laboratories on blood collected at the same time.
The QuantiFERONH-TB Gold In-Tube test (QFT-GIT,
Cellestis Limited, Carnegie, Victoria, Australia) is one of two
commercially available IGRAs currently in use in the U.S. The
goal of this study was to determine the within-subject variability of
the QFT-GIT when performed in different laboratories on blood
collected at the same time and to investigate potential reasons for
variability.
Methods
Ethics Statement
The Centers for Disease Control and Prevention (CDC) and
Wilford Hall Medical Center human subjects institutional review
boards approved this study. All subjects provided written informed
consent.
Subject Selection
Subjects were recruited from among Air Force and CDC staff
located in San Antonio, Texas, and Atlanta, Georgia, respectively,
as part of a larger study investigating parameters that affect QFTGIT variability. Prior unpublished assessments among a similar
cohort found a broad range of IFN-c measurements, and that 40%
to 50% of persons with self-reported prior positive TST results were
positive by QFT-GIT as compared to ,3% for the general U.S.
population. To increase the proportion of subjects with positive
QFT-GIT results and to assess subjects with a continuous range of
IFN-c measurements, including those with IFN-c measurements
near the cutoff separating positive and negative interpretations, only
persons with self-reported prior positive TST results were recruited.
Exclusion criteria were age of less than 18 years or a history of an
adverse reaction to TST (e.g., blistering, scarring, or anaphylaxis).
All subjects completed a detailed study questionnaire.
QFT-GIT Procedure
Statistical Methods
Characteristic
Category
n (%)
Age, years
2029
8 (8.2%)
3039
23 (23.7%)
4049
29 (29.9%)
5059
28 (28.9%)
$60
9 (9.3%)
Gender
47 (48.5%)
50 (51.5%)
Race/Ethnicity
White, non-Hispanic
46 (47.4%)
Black, non-Hispanic
19 (19.6%)
Hispanic
15 (15.5%)
Asian/Pacific
13 (13.4%)
Native American
0 (0.0%)
Other
4 (4.1%)
19501959
1 (1.0%)
19601969
4 (4.1%)
19701979
5 (5.2%)
19801989
12 (12.4%)
19901999
38 (39.2%)
20002009
37 (38.1%)
Yes
2 (2.1%)
No
95 (97.9%)
Yes
78 (80.4%)
No
19 (19.6%)
Yes
36 (37.1%)
No/Unknown
61 (62.9%)
Yes
22 (22.7%)
No/Unknown
75 (77.3%)
Region of Birth
66 (68.0%)
Central America/Caribbean
9 (9.3%)
Results
7 (7.2%)
Southeast Asia
4 (4.1%)
Pacific
3 (3.1%)
Europe/Russia
3 (3.1%)
Africa
2 (2.1%)
Middle East
2 (2.1%)
South America
1 (1.0%)
None
36 (37.1%)
110
40 (41.2%)
1120
12 (12.4%)
2130
8 (8.2%)
3140
1 (1.0%)
doi:10.1371/journal.pone.0043790.t001
Subject Characteristics
Study participation is depicted in Figure 1. Of the 174 people
asked to participate, 103 consented, and 97 had QFT-GIT tests
PLOS ONE | www.plosone.org
Asia
Table 2. Summary comparisons of QuantiFERON-TB Gold In-Tube test interpretations performed on the same subjects in three
labs.
Results compared
All 3 positive
All 3 negative
2 positive & 1
negative
1 positive & 2
negative
Total
discordant (%)
97
39
47
11 (11.3%)
91
35
49
7 (7.7%)
doi:10.1371/journal.pone.0043790.t002
Table 3. Pairwise comparisons of QuantiFERON-TB Gold In-Tube test interpretations performed on the same subjects in three labs.
%
Discordant
% Agreement
Results compared
(Group 1 vs. Group 2)
Both
positive
Both
negative
Positive*/negative
Negative*/positive
Overall
Positive
Negative Overall
Kappa
42
50
94.8
89.4
90.9
5.2
0.90
40
47
89.7
80.0
82.5
10.4
0.79
41
49
92.8
85.4
87.5
7.2
0.85
36
50
94.5
87.8
90.9
5.5
0.89
36
49
93.4
85.7
89.1
6.6
0.87
37
51
96.7
92.5
94.4
3.3
0.93
* = Group1/Group2.
doi:10.1371/journal.pone.0043790.t003
Table 4. Median and mean IFN-c measurements for QuantiFERON-TB Gold In-Tube tests performed on the same subjects in three
labs.
Source
Nil
TB
TB Response
Median
Mean
Median
Mean
Median
Mean
97
0.07
0.10
0.27
4.11
0.15
4.01
97
0.06
0.09
0.24
3.88
0.19
3.79
97
0.07
0.11
0.40
5.92
0.26
5.81
91
0.07
0.09
0.18
3.11
0.08
3.01
35
0.07
0.11
3.93
7.85
3.31
7.74
49
0.07
0.08
0.08
0.10
0.01
0.02
Unstratified *
91
0.06
0.09
0.16
2.91
0.09
2.83
Concordant Positive{
35
0.07
0.11
4.47
7.37
4.23
7.26
Concordant Negative1
49
0.06
0.07
0.08
0.09
0.01
0.02
Unstratified *
91
0.07
0.11
0.32
2.94
0.18
2.33
Concordant Positive{
35
0.07
0.12
3.72
6.04
3.25
5.91
49
0.07
0.10
0.11
0.14
0.02
0.05
Lab1 (reconciled)
Unstratified *
Concordant Positive
Concordant Negative1
Lab2 (reconciled)
Lab3 (reconciled)
Concordant Negative
Nil = IFN-c concentrations (IU/mL) in plasma from the Nil tube of the QuantiFERON-TB Gold In-Tube test (QFT-GIT); TB = IFN-c concentrations (IU/mL) in plasma from the
TB tube of QFT-GIT; TB Response = TB minus Nil.
*Includes 7 subjects with discordant QFT-GIT interpretations.
{
Concordant positive among results from all 3 labs.
1
Concordant negative among results from all 3 labs.
doi:10.1371/journal.pone.0043790.t004
Figure 2. Difference (Bland-Altman) plots. Difference (Bland-Altman) plots for Nil (panel A) and TB (panel B). Differences (y-axis) and means of
pairs (x-axis) are in IU/mL IFN-c.
doi:10.1371/journal.pone.0043790.g002
Discussion
We observed substantial within-subject interlaboratory variability in QFT-GIT interpretations and IFN-c measurements when
blood samples collected from the same person at the same time
were tested in three different labs. Of the 97 subjects tested in
three labs, 11% had discordant QFT-GIT interpretations based
on the original reported data. Electronic transfer of data was not
possible for one of the three labs testing specimens for this study,
and a portion of the variability in test interpretation was associated
with manual data entry errors. Data entry errors included data
misalignments and a misplaced decimal point that were encountered with manual data entry but not electronic data transfers. All
three labs used an automated ELISA workstation to assist in
performing QFT-GIT, and this may have avoided additional data
entry errors. As compared to manually performed ELISAs,
automated ELISA workstations can read specimen barcodes that
discriminate subjects and QFT-GIT tube type (i.e., Nil tube, TB
Antigen tube, Mitogen tube) and assign OD values to specific
specimens. This avoids some inaccuracies that have been
PLOS ONE | www.plosone.org
Table 5. Variability in Quantiferon-TB Gold in-Tube test measurements performed on the same subjects in three labs excluding
those with extremely high TB Response.
LOA*
Measure
Bias*{ (SDD*)
Unstratified1
91
0.016(0.11)
Concordant Positive#
35
0.006(0.12)
Concordant Negative
49
0.016(0.10)
Unstratified1
91
20.016(0.16)
Concordant Positive#
35
20.016(0.17)
Concordant Negative
49
20.026(0.16)
Unstratified1
91
20.026(0.19)
Concordant Positive#
35
20.016(0.22)
Concordant Negative
49
20.026(0.17)
Unstratified1
91
0.196(2.98)
Concordant Positive#
35
0.486(4.79)
Concordant Negative
49
0.006(0.09)
Unstratified1
91
0.676(6.18)
Concordant Positive#
35
1.816(9.62)
Concordant Negative
49
20.046(0.19)
Unstratified1
91
0.486(4.28)
Concordant Positive#
35
1.336(6.61)
Concordant Negative
49
20.056(0.20)
Unstratified1
91
0.196(2.97)
Concordant Positive#
35
0.486(4.77)
Concordant Negative
49
0.006(0.08)
0.70 (0.530.82)
Unstratified1
91
0.686(6.17)
Concordant Positive#
35
1.826(9.61)
Concordant Negative
49
20.036(0.11)
Unstratified1
91
0.506(4.29)
Concordant Positive#
35
1.356(6.64)
Concordant Negative
49
20.036(0.11)
Comparison
Nil
Lab1 vs. Lab2
TB
Lab1 vs. Lab2
TB Response
Lab1 vs. Lab2
Table 6. W-S SD, bias, and LOA in three strata based on the mean TB Response for Lab1, Lab2, and Lab3.
Comparison
34
14
mean* ,0.10
43
34
14
mean* ,0.10
43
34
14
mean* ,0.10
43
95% CI = 95% confidence interval; LOA = limit of agreement; W-S SD = within-subject standard deviation.
*Stratifications based on mean TB Response among all three labs.
doi:10.1371/journal.pone.0043790.t006
Table S2
(DOC)
Table S3 QuantiFERON-TB Gold In-Tube test results before
and after correction of data entry errors.
(DOC)
Table S4 TB and TB Response Values for 7 subjects with
highest Lab3 Values.
(DOC)
Acknowledgments
The authors would like to express their gratitude to the subjects for their
participation in this study; to Matthew Crum and David Temporado for
logistical support; to Michelle Owen, Clyde Hart, Tammy EvansStrickfaden, and Davis Lupo for laboratory space and technical advice;
to Erin Justen for administrative support; and to Eva Bozeman for assisting
with blood collection.
Author Contributions
Conceived and designed the experiments: GHM DJG LRH. Performed
the experiments: WCW ATJ GHM DJG CB. Analyzed the data: WCW
GHM BHC WD. Wrote the paper: WCW GHM DJG LRH CB KBW LR
LJD SOC BHC JB ATJ WD DM. Statistical analysis consultation: WD.
Supporting Information
Table S1 QuantiFERON-TB Gold In-Tube test results for
subjects with discordant interpretations.
(DOC)
References
16. Pollock NR, Campos-Neto A, Kashino S, Napolitano D, Behar SM, et al. (2008)
Discordant QuantiFERON-TB Gold test results among US healthcare workers
with increased risk of latent tuberculosis infection: a problem or solution? Infect
Control Hosp Epidemiol 29: 878886.
17. Ringshausen FC, Nienhaus A, Schablon A, Schlosser S, Schultze-Werninghaus
G, et al. (2010) Predictors of persistently positive Mycobacterium-tuberculosis-specific
interferon-gamma responses in the serial testing of health care workers. BMC
Infect Dis 10: 220.
18. Ringshausen FC, Nienhaus A, Torres CJ, Knoop H, Schlosser S, et al. (2011)
Within-subject Variability of Mycobacterium-tuberculosis-specific Interferongamma Responses in German Health Care Workers. Clin Vaccine Immunol 18:
11761182.
19. van Zyl-Smit RN, Pai M, Peprah K, Meldau R, Kieck J, et al. (2009) Withinsubject Variability and Boosting of T Cell IFN-{gamma} Responses Following
Tuberculin Skin Testing. Am J Respir Crit Care Med 180: 4958.
20. Veerapathran A, Joshi R, Goswami K, Dogra S, Moodie EE, et al. (2008) T-cell
assays for tuberculosis infection: deriving cut-offs for conversions using
reproducibility data. PLoS ONE 3: e1850.
21. Zwerling A, Cloutier-Ladurantaye J, Pietrangelo F, Behr M, Schwartzman K, et
al. (2009) Conversions and Reversions in Health Care Workers in Montreal,
Canada Using QuantiFERON-TB-Gold In-Tube. Am J Respir Crit Care Med
179: A1012.
22. Doberne D, Gaur RL, Banaei N (2011) Preanalytical delay reduces sensitivity of
QuantiFERON-TB Gold In-Tube for detection of latent tuberculosis infection.
Journal of Clinical Microbiology 49: 30613064.
23. Park JS, Lee JS, Kim MY, Lee CH, Yoon HI, et al. (2012) Monthly follow-ups of
interferon gamma release assays among healthcare workers in contact with TB
patients. Chest. doi:10.1378/chest.11-3299.
24. Zwerling A, van den HS, Scholten J, Cobelens F, Menzies D, et al. (2011)
Interferon-gamma release assays for tuberculosis screening of healthcare
workers: a systematic review. Thorax 67: 6270.
25. Cellestis Limited (2009) QuantiFERONH-TB Gold In-Tube Package Insert.
Carnegie, Victoria, Australia. Cellestis Limited website. Available: http://www.
cellestis.com/IRM/Company/ShowPage.aspx?CPID = 1370. Accessed 2012
Aug 15.
26. Powell RD III, Whitworth WC, Bernardo J, Moonan PK, Mazurek GH (2011)
Unusual Interferon Gamma Measurements with QuantiFERON-TB Gold and
QuantiFERON-TB Gold In-Tube Tests. PLoS ONE 6: e20061.
27. Beckerman H, Roebroeck ME, Lankhorst GJ, Becher JG, Bezemer PD, et al.
(2001) Smallest real difference, a link between reproducibility and responsiveness. Qual Life Res 10: 571578.
28. Guyatt GH, Kirshner B, Jaeschke R (1992) Measuring health status: what are
the necessary measurement properties? J Clin Epidemiol 45: 13411345.
29. Hopkins WG (2000) Measures of reliability in sports medicine and science.
Sports Med 30: 115.
30. Atkinson G, Nevill A (2000) Typical error versus limits of agreement. Sports
Med 30: 375377.
31. Bland JM, Altman DG (1986) Statistical methods for assessing agreement
between two methods of clinical measurement. Lancet 1: 307310.
32. Lu L, Shara N (2007 November) Reliability analysis: Calculate and Compare
Intra-class Correlation Coefficients (ICC) in SAS. Northeast SAS Users Group
Website, 2007 Conference Proceedings. Available: http://www.nesug.org/
proceedings/nesug07/sa/sa13.pdf. Accessed 2012 Aug 15.
10