Next Article in Journal
Shining a Light on the Challenging Behaviors of Adolescents with Comorbid Diagnoses: Use of Pictorial Concurrent Operant Preference Assessment
Next Article in Special Issue
Update on Viral Infections Involving the Central Nervous System in Pediatric Patients
Previous Article in Journal
Perceived Barriers and Facilitators of Adventurous Play in Schools: A Qualitative Systematic Review
Previous Article in Special Issue
Human Species D Adenoviruses Isolated from Diarrheal Feces Show Low Infection Rates in Primary Nasal Epithelial Cells
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Diagnostic Performance of SARS-CoV-2 Rapid Antigen Test in a Large, German Cohort

1
Center for Child and Adolescent Medicine, Center for Clinical and Translational Research (CCTR), Helios University Hospital Wuppertal, Witten/Herdecke University, 42283 Wuppertal, Germany
2
Institute for Medical Laboratory Diagnostics, Center for Clinical and Translational Research (CCTR), Helios University Hospital Wuppertal, Witten/Herdecke University, 42283 Wuppertal, Germany
3
Laboratory of Experimental Pediatric Pneumology and Allergology, Center for Biomedical Education and Research, School of Life Sciences (ZBAF), Faculty of Health, Witten/Herdecke University, 58448 Witten, Germany
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Children 2021, 8(8), 682; https://doi.org/10.3390/children8080682
Submission received: 12 July 2021 / Revised: 1 August 2021 / Accepted: 5 August 2021 / Published: 8 August 2021
(This article belongs to the Special Issue Advances in Pediatric Infection and Immunity)

Abstract

:
We assessed the performance of a rapid antigen test (RAT) in everyday clinical practice. Between 1 November 2020 until 1 April 2021 all in-patients at the Helios University Hospital Wuppertal, Germany, as well as the accompanying relatives at the Children’s Hospital received a SARS-CoV-2 RAT and a SARS-CoV-2 RT-PCR prior to admission. Out of 3686 patients, 22 (0.6%) subjects were tested positive by RT-PCR and RAT, and 3591 (97.4%) were negative by both methods, showing discordant results: RT-PCR+/RAT− in 58 (1.6%) and RT-PCR−/RAT+ in 15 patients (0.4%). Overall sensitivity and specificity of RAT was 27.5% (95%CI 18.1–38.6%) and 99.6% (95%CI 99.3–99.8%), respectively. The sensitivity was slightly higher in adults (30.4%, 95%CI 18.8–90.9%) than in pediatric subjects (20.8%, 95%CI 7.1–42.2%). False negative RAT had a statistically higher Ct-value (p < 0.001) compared to true positive values, and overall sensitivity increased to 80% [59.3–93.2%] with Ct value < 30. While the sensitivity of the RAT was poor compared with the RT-PCR, the specificity was excellent. However, the sensitivity increased with lower Ct value, and with the right anamnesis the RAT can be a quick and easy approach to distinguish people who are infectious with SARS-CoV-2 from noninfectious people, enabling appropriate triage in clinical practice while waiting for the RT-PCR result.

1. Introduction

Emerging infectious diseases that spread as pandemics do not only influence the morbidity and mortality of affected populations but also have a major socioeconomic and political impact [1,2]. Since the beginning of the 21st century, three separate outbreaks of coronaviruses (CoVs) have caused global public health crises: the Severe Acute Respiratory Syndrome (SARS) in 2002–2003, the Middle East Respiratory Syndrome (MERS) in 2012, and SARS-CoV-2/COVID-19 (Coronavirus Disease 2019) since winter 2019 [3,4,5]. The clinical presentation of the infection may vary from barely noticeable flu-like symptoms to severe pneumonia with acute respiratory distress and death [4].
SARS-CoV-2 is a single-stranded RNA virus with a virion diameter of 60–140 nm [5]. On the basis of its phylogenetic cluster formation, it belongs to the genera of the β-coronavirus [6]. Approximately 50% of its genome sequence is identical to MERS-CoV, and an 80% match exists with SARS-CoV [7]. Referring to the numbers from the Johns Hopkins University (Baltimore, MD, USA, July 2021), this virus is associated with over 4.1 million deaths worldwide [8]. In Germany, over 3.7 million people have been infected with the virus, with over 91,000 deaths related to the virus being recorded [9].
Therefore, a rapid and reliable diagnostic method is crucial in combating the epidemic, as it enables infected individuals to be identified quickly and correctly. This allows for timely isolation and adequate therapy, which contributes to significant containment of the pandemic. It was shown during the SARS-CoV pandemic in 2003 that control measures delayed by one week not only resulted in the outbreak lasting four weeks longer, but that it also increased quantitatively by almost three times [10].
During this pandemic, adults have been the main affected group with higher morbidity and mortality than children [11,12,13]. Furthermore, it appears that children play a minor role in the dynamics of the pandemic and, therefore, fewer data are available on performance of the SARS-CoV-2 antigen rapid test in the pediatric population [13,14,15].
At our facility, all admitted patients received both reverse transcription polymerase chain reaction (RT-PCR) and a rapid antigen test (RAT) regardless of clinical symptoms or signs of COVID-19. The antigen test can be performed with little effort and provides the result after approx. 15 min, whereas the PCR results take up to 24 h, depending on the capacity of the laboratory [16,17].
This enables an advanced triage in clinical practice and prevents further infection, as all patients with a positive antigen test are isolated until the (RT-PCR) test result is available.
This project was designed to determine the diagnostic test accuracy of the SARS-CoV-2 antigen rapid test in everyday clinical practice and to compare the performance in adult and pediatric subjects.

2. Materials and Methods

2.1. Study Cohort and Recruiting Period

We performed a single center, observational study, which was conducted between 1 November 2020 until 1 April 2021 at the Helios University Hospital Wuppertal, Witten/Herdecke University, Germany. All in-patients, as well as the accompanying relatives at the Children’s Hospital received a SARS-CoV-2 RAT and a SARS-CoV-2 RT-PCR prior to admission. On the day of the test, a form was filled out in advance by the guardians. The form consisted of item parameters regarding clinical symptoms associated with SARS-CoV-2, as well as possible contacts who had been tested positive for the virus. Relatives who had a temperature ≥ 38.5 °C or were under quarantine at the time of admission were not included and had to be replaced by another adult family member.
The study was approved by the Ethics Committee of Witten/Herdecke University, Germany (S-09/2021).
Each patient admitted to the hospital received a total of two sequential swabs. For each swab, the throat was swabbed first and then the nasopharynx. (MANTACC™, Miraclean Technology Co., Ltd., Shenzhen, China). One of the swabs was used for the rapid antigen test, while the other was placed in 3 mL of universal transport medium (Glucose-Lactalbumin-Yeast Virus (GLY), Xebios Diagnostics GmbH, Düsseldorf, Germany) and sent to our laboratory to carry out the RT-PCR testing.

2.2. Diagnostic Procedures

For the RAT, we used the VivaDiag™ SARS-CoV-2 Ag Rapid Test Device (VivaCheck Biotech (Hanghzou) Co., Ltd., Hangzhou, China) and the Panbio™ COVID-19 Ag Rapid Test Device (Abbott Rapid Diagnostic Jena GmbH, Jena, Germany). Both tests were qualitative membrane-based immunoassay based on the Colloidal Gold Immunochromography principle and target the nucleocapsid protein of SARS-CoV-2 in nasopharyngeal samples.
For the isolation of RNA, we used Maelstrom (Taiwan Advanced Nanotech Inc. (TANBead), Taoyuan, Taiwan) or NIMBUS (Seegene, Seoul, Korea). The RT PCR was performed using different Seegene assays following the manufacturer’s instructions (Allplex™ 2019-nCoV Assay, Allplex™ SARS-CoV-2 Master Assay, Allplex™ SARS-CoV-2/Flu A/Flu B/RSV Assay), or assays on the NeuMoDx 288 (Qiagen N.V., Hilden, Germany).

2.3. Clinical Data

Demographic (age and sex) and clinical variables of the study population were obtained from electronic medical records retrospectively.

2.4. Statistical Analysis

Continuous variables were given as median with interquartile range (IQR), and the categorical variables as proportions. Differences between groups were compared using the Mann-Whitney U-test or Fisher’s exact test. Receiver operating characteristic (ROC) curves and Youden’s index were used to determine the SARS-CoV-2 RT-PCR cycle threshold (Ct) cut-off value best discriminating between RT-PCR+/RAT+ and RAT− subjects. A two-sided p value of 0.05 or below was considered significant for these comparisons. Statistical analysis was performed with SPSS v26.0 (IBM Corp., Armonk, NY, USA).
To assess the diagnostic test accuracy of the RAT, the SARS-CoV-2 RT-PCR was established as the gold standard. Sensitivity (Se), specificity (Sp), positive (PPV) and negative predictive value (NPV) were calculated with a 95% confidence interval (CI). Cohen-Kappa statistics were used to calculate the agreement between the various test procedures.

3. Results

3.1. Patient Characteristics

A total of 3686 patients were included during this period, 876 (23.9%) of whom were children and 2810 (76.2%) were adults. Of these, 61.3% were female. The median age distribution of the children was 6 years (interquartile range (IQR) 1–14 years) and 43 years (IQR 31–71 years) for the adults. The largest group in this population were adults between 18–34 years old. Clinical characteristics were collected solely in case of positive RT-PCR SARS-CoV-2 result (Table 1 and Table 2).

3.2. Performance of the Rapid Antigen Test

Out of 3686 patients, 22 (0.6%) subjects tested positive and 3591 (97.4%) tested negative through RT-PCR and RAT. Interestingly, both methods showed discordant results: RT-PCR+/RAT− in 58 patients (1.6%) and RT-PCR−/RAT+ in 15 patients (0.4%) (Appendix A Table A1). The overall concordance between the two methods was fair (κ 0.37, 95% CI 0.26–0.48). However, this was moderate (κ 0.42, 95% CI 0.28–0.56) for adults and fair for pediatric patients (κ 0.26, 95% CI 0.07–0.45). Overall Se and Sp of RAT was 27.5% (95%CI 18.1–38.6%) and 99.6% (95%CI 99.3–99.8%), respectively. The sensitivity was slightly higher in adults (30.4%, 95%CI 18.8–90.9%) than in pediatric subjects (20.8%, 95%CI 7.1–42.2%) (Table 3). The Se was also higher in symptomatic subjects (52.9%) compared to asymptomatic subjects (20.6%) (Appendix A Table A2). Se in the different pediatric age groups was highest in 5 to 14 years age group at 25%, followed by 23.1% in 0 to 4 years age group, and 14.3% in 15 to 17 years age group (Appendix A Table A3). With a prevalence of 2.2%, overall RAT positive and negative predictive values were 59.5% (95%CI 44.2–73.1%) and 98.4% (95%CI 98.2–98.6%), respectively. The positive predictive value was higher in adults (70.8%, 95%CI 51.2–84.9%) than in pediatric subjects (38.5%, 95%CI 18.1–63.9%) (Table 3).
The range of cycle threshold (Ct) values of the nucleocapsid (N)-gene were 12.2–39.9 (median 31.9 IQR 24.3–36.8), 14.3–38.5 (median 29.5 IQR 22.6–34.5) for the envelope (E)-gene and 15.9–39.9 (median 30.8 IQR 23.0–36.8) for the RNA-dependent RNA polymerase (RdRP)-gene.
There were statistically significant differences when comparing the Ct values between patients with a false-negative and those with a true-positive RAT (Figure 1). This remained the same in the pediatric population (p < 0.05) and in the adult population (p < 0.001) (Appendix A Figure A1 and Figure A2).
In our study, ROC curves and Youden’s index analyses indicated that for the N-, E- and RdRP-gene, the optimum cut-off of the different Ct values which discriminated best between RT-PCR+/RAT+ and RT-PCR+/RAT− subjects, were <30, <25 and <30 respectively. The sensitivities were 100% (N- and RdRP-gene) and 88.9% (E-gene). The specificities were 78.6%, 92.9% and 78.6% (Figure 2).
In the pediatric group, the Ct cut-off values were <30 (N- and RdRP-gene) and <27 (E-gene) with overall Se and Sp of 100%. For the adult subjects the Ct cut-off values stayed the same with a sensitivity of 100% and specificity of 75% (Appendix A Figure A3). As expected, the total RAT sensitivity was directly dependent on the Ct values (Appendix A Table A4).
To quantify the performance of the RAT in the context of community-based testing, a calculated cut-off for the N-gene Ct value of < 30 was used. This is also the threshold for high virus concentrations that corresponds to the range considered most transmissible. The overall population Se increased to 80% (95%CI 59.3–93.2%) with 75 % (95%CI 50.1–91.3%) for the adult group and 100% (95%CI 47.8–100%) for the pediatric group (Table 4).

4. Discussion

The primary goal of controlling the COVID-19 pandemic is to reduce the transmission of infection in the population by reducing the basic reproduction number (R0). The R0 is determined by different factors, such as the duration of infectiousness or the number of susceptible individuals in the population [18]. Diagnostic technologies play a vital role in infectious disease control as they help to identify and isolate infected individuals and thus prevent further spreading of infection [19].
As of 10 May 2021, the European Commission department of Health and Food Safety has presented a common list of 83 SARS-CoV-2 RAT of which 35 the Member States have agreed to mutually recognize their test results for public health measures [20]. Over 400 RAT Kits have been listed by the German Federal Institute for Drugs and Medical Devices [21].
A characteristic of our study population is that accompanying relatives in the children’s hospital who had a temperature ≥ 38.5 °C or had any symptoms related to COVID-19 at the time of admission were excluded. All other subjects from the other medical units were tested, even if they had symptoms of COVID-19 or not. That allowed the calculation of sensitivity and specificity values with greater relevance for daily clinical practice. In our study group, there were more women in the adult group (64.8%), as most of the children were admitted with their mothers.
The sensitivity and specificity of the SARS-CoV-RAT were published in a technical data sheet of the test to be 95% and 100% for VivaDiag™ SARS-CoV-2 Ag and 98.1% and 99.8% for Panbio™ COVID-19 Ag, respectively [22,23]. In this study, the two test kits were not separated from each other because it was no longer possible to determine which kit was used for which subject.
The overall specificity in this study was very high at 99.6% (99.8% adults vs. 99.1% pediatrics), and similar to that of the manufacturer’s information. This is consistent with previous studies describing the excellent specificities of different RATs ranging from 87.1–100% [24,25,26,27,28].
However, the sensitivities measured by the manufacturers differed markedly from the value determined by us. Here, the overall sensitivity was 27.5% (30.4% adults vs. 20.8% pediatric). One explanation for this could be that the manufacturer used a large number of samples with a high viral load in the analysis, not reflecting the distribution of the general population.
In clinical practice, overall SARS-CoV-2 RAT sensitivity has been reported to vary between 30.2% and 97% depending on the kit used [26,28,29,30]. These studies were performed in a population with different SARS-CoV-2 prevalence, ranging from 5% to 40% with large fractions of asymptomatic subjects [25,26,31,32]. In addition, the lower sensitivity of the RAT in this study could be partly explained by the high proportion of asymptomatic persons in the study population. The sensitivity was higher in symptomatic persons, with 52.9%, than in asymptomatic with 20.6%. These results are also confirmed by other studies, which suggest that the Se in symptomatic people can be twice as high as in asymptomatic people [33,34,35,36]. The prevalence in this study was 2.2%, possibly because this study was conducted during a major lockdown in Germany, and also because relatives with positive symptoms of a SARS-CoV-2 infection were not allowed to be admitted. Depending on the period and region, prevalence has been described to vary from 0.9% up to 80% [25,26,28,37].
Our results showed a greater sensitivity in adults (30.4%) than in pediatric subjects (20.8%). While there was no age-related difference in SARS-CoV-2 RNA load in the upper respiratory tract in other studies, one retrospective study in the Netherlands showed that viral load increases significantly with age [26,38,39]. However, direct comparison between studies is difficult due to differences in test kits used, clinical characteristics, age of patients, and types of samples processed.
In this study 15 (0.4%) of the RAT results were false positive. In retrospect, it was found that five of these 15 showed up on the same day and that the manufacturer’s instructions were not carried out correctly. Instead of three drops of the extraction solution, more drops were applied. Another source of error for false positive rapid antigen test is explained by the fact that weak bands were often subjectively assessed as positive in order to avoid incorrectly assessing patients as RAT negative and to prevent further spread of the infection. One study found that optimal performance was achieved with significant reductions in false positive rapid antigen tests when the bands were rated positive when spanning the entire width of the strip, regardless of the intensity of the band [30]. A training tool has been developed for this purpose [40].
The overall NPV of the SARS-CoV-2 RAT in this study was excellent, at 98.4%, and there was no significant difference in the pediatric or adult subjects, and in cases with low or high Ct-values. Similar high NPVs were also described in previous studies [26,41,42]. However, the clinical interpretation of NPVs should be made with caution, since predictive values depend on the prevalence of the disease and can therefore be deceptive. The negative predictive values are high especially in regions with low prevalence [43].
The Ct-dependent evaluation of all three genes shows that false negative rapid antigen test had a statically higher Ct value (Figure 1). In this study, using the ROC curves and Youden’s index analyses, the optimum cut-off of the different Ct values for the N-gene, E-gene and RdRP-gene which discriminated best between RT-PCR+/RAT+ and RT-PCR+/RAT− subjects were <30, <25 and <30, respectively.
The overall increasing of sensitivity to 80% (adults 75% vs. pediatric 100%) for positive SARS-CoV-2 RAT with a Ct value < 30, and thus with higher viral load, has been described in previous studies, with reports going up to 98% [24,25,26,27,32,44,45].
However, the cultivation of SARS-CoV-2 does not seem to be possible at a threshold of 106 copies/mL [46]. Depending on the RAT-Kit used, and the laboratory, this represents a different Ct value cut-off. In some studies, this has been described as being >29–31, so that an infection with a high Ct value in the late stage of the infection could have little effect from a public health perspective [47]. A quantitative reference sample was established by the Robert Koch Institute, Department for Infectious Diseases and Center for Biological Hazards and Special Pathogens/Highly Pathogenic Viruses, and the consulting laboratory for coronaviruses at the Institute for Virology of the Charité–Berlin University of Medicine in Germany [48]. Using this, our laboratory determined the Ct cut-off value for the E-, RdRP- and N-gene, that corresponds to a viral load of 106 copies/mL were 21.6, 24.5 and 25.2, respectively [49].
Nevertheless, in our study, 3% of the potentially infectious people (Ct values < 25.2) received negative RAT results. This means that a small number of infectious people were not recognized. In a cohort in Norway with over 4500 subjects tested, this number was 15% [25]. It is also important to note that the viral load of a sample does not necessarily reflect the viral load in the subject’s respiratory tract. It is also not sufficient to assess a patient’s contagiousness with the Ct value only, because this is influenced by other factors, such as the time since the onset of symptoms.
To put this in the context of child public health, serial testing is critical to compensate for the lower sensitivity of RAT, as asymptomatic children with high Ct levels at an early stage of infection may not be detected until later in the course.
The strengths of this study lie in the relatively large number of participants, and that it demonstrates the accuracy of a RAT in the context of everyday clinical practice.
Nevertheless, the results of the study should be considered in light of its limitations. First, we excluded all relatives who had symptoms associated with SARS-CoV-2 infection, which also explains the low prevalence in our study. The incorrect compliance with instructions and misinterpretation of test results can be interpreted as possible limitations of our study. In addition, we used Ct values as a surrogate for viral load and didn’t determine whether asymptomatic patients with high Ct values were in the early or late stage of infection.
To avoid underestimating the viral load of the patient, only efficient sample collection methods can deliver meaningful results. For that, adequate swabs must be made available, especially in pediatrics, which are fine enough to adapt to the child’s anatomy.

5. Conclusions

In summary, we conclude that although the overall sensitivity of the RAT is inferior, the specificity is excellent compared with the RT-PCR in adult and pediatric populations. With the right clinical history, the RAT can be a quick and easy approach, while waiting for the RT-PCR result, to distinguish people who are infectious with SARS-CoV-2 from noninfectious people, and thus enable appropriate triage in clinical practice and reduce further spreading of the virus in the clinical environment. Nevertheless, it is important to note that the excellent NPV of RAT, especially at times of low prevalence, is misleading, and that tools are needed with the highest possible sensitivity in the field.

Author Contributions

Conceptualization, O.M. and S.W.; methodology, O.M., E.R., P.A.-N., S.W. and M.A.; software, O.M.; validation, O.M., E.R., S.W. and M.A; formal analysis, O.M.; investigation, S.W.; resources, P.A.-N., S.W.; data curation, O.M. and S.W.; writing—original draft preparation, O.M., P.A.-N., M.A. and S.W.; writing—review and editing, all authors; visualization, O.M.; supervision, S.W.; project administration, S.W.; funding acquisition, not applicable. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of Witten/Herdecke University, Germany (S-09/2021, 3 March 2021).

Informed Consent Statement

Due to pandemic-related safety-hygiene precautions, all children, and adolescents, as well as their families, were required to have a swab test for SARS-CoV-2 as part of their presentation at our center. Testing was mandated as part of general public health policy and due to official order.

Data Availability Statement

The data to this study can be shared upon reasonable request from the first and corresponding authors.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Agreement between rapid antigen test and RT-PCR.
Table A1. Agreement between rapid antigen test and RT-PCR.
SARS-CoV-2 RT-PCR+SARS-CoV-2 RT-PCR−
SARS-CoV-2
rapid antigen test+
22
(0.6%)
15
(0.4%)
37
(1.0%)
SARS-CoV-2
rapid antigen test−
58
(1.6%)
3591
(97.4%)
3649
(99.0%)
80
(2.2%)
3606
(97.2%)
3686
(100.0%)
Table A2. Overall performance of the RAT for asymptomatic and symptomatic subjects.
Table A2. Overall performance of the RAT for asymptomatic and symptomatic subjects.
Overall Asymptomatic SubjectsOverall Symptomatic Subjects
Se20.6%
[11.5–32.7%]
52.9%
[27.8–77.0%]
Sp99.6%
[99.3–99.8%]
99.6%
[99.3–99.7%]
PPV46.4%
[30.1–63.6%]
37.5%
[23.4–54.1%]
NPV98.6%
[98.5–98.8%]
99.8%
[99.6–99.9%]
Table A3. Sensitivity and specificity of the RAT in different pediatric age groups.
Table A3. Sensitivity and specificity of the RAT in different pediatric age groups.
Pediatric 0–4 YearsPediatric 5–14 YearsPediatric 15–17 Years
Se
(95% CI)
23.1%
5.0–53.8%
25.0%
0.6–80.6%
14.3%
0.4–57.9%
Sp
(95% CI)
98.7%
97.1–99.6%
99.3%
97.4–99.9%
99.4%
96.9–99.9%
Table A4. Overall sensitivity of the RAT according to the different Ct-values.
Table A4. Overall sensitivity of the RAT according to the different Ct-values.
N-Gene Ct-Value
<23≤25≤30≤35
Se
(95% CI)
100%
76.8–100%
88.9%
65.3–98.6%
76.9%
56.4–91%
45.7%
30.9–61%
RdRP-gene Ct-value
<23≤25≤30≤35
Se
(95% CI)
100%
71.5–100%
91.7%
61.5–99.8%
76.2%
52.8–91.8%
53.5%
34.4–71.7%
E-gene Ct-value
<21≤25≤30≤35
Se
(95% CI)
100%
54.1–100%
84.6%
54.6–98.1%
60%
36.1–80.9%
38.7%
21.9–57.8%
Figure A1. Distribution of different Ct values from people tested either RAT+ or RAT− in the pediatric group.
Figure A1. Distribution of different Ct values from people tested either RAT+ or RAT− in the pediatric group.
Children 08 00682 g0a1
Figure A2. Distribution of different ct values from people tested either RAT+ or RAT− in the adult group.
Figure A2. Distribution of different ct values from people tested either RAT+ or RAT− in the adult group.
Children 08 00682 g0a2
Figure A3. ROC curves of the different Ct-values for the pediatric and adult subjects.
Figure A3. ROC curves of the different Ct-values for the pediatric and adult subjects.
Children 08 00682 g0a3

References

  1. Jones, K.E.; Patel, N.G.; Levy, M.A.; Storeygard, A.; Balk, D.; Gittleman, J.L.; Daszak, P. Global trends in emerging infectious diseases. Nature 2008, 451, 990–993. [Google Scholar] [CrossRef]
  2. Madhav, N.; Oppenheim, B.; Gallivan, M.; Mulembakani, P.; Rubin, E.; Wolfe, N. Pandemics: Risks, Impacts, and Mitigation. In Disease Control Priorities: Improving Health and Reducing Poverty, 3rd ed.; Jamison, D.T., Gelband, H., Horton, S., Jha, P., Laxminarayan, R., Mock, C.N., Nugent, R., Eds.; The International Bank for Reconstruction and Development/The World Bank: Washington, DC, USA, 2017. [Google Scholar]
  3. Hu, T.; Liu, Y.; Zhao, M.; Zhuang, Q.; Xu, L.; He, Q. A comparison of COVID-19, SARS and MERS. PeerJ 2020, 8, e9725. [Google Scholar] [CrossRef] [PubMed]
  4. Caruana, G.; Croxatto, A.; Coste, A.T.; Opota, O.; Lamoth, F.; Jaton, K.; Greub, G. Diagnostic strategies for SARS-CoV-2 infection and interpretation of microbiological results. Clin. Microbiol. Infect. 2020, 26, 1178–1182. [Google Scholar] [CrossRef]
  5. Dhama, K.; Khan, S.; Tiwari, R.; Sircar, S.; Bhat, S.; Malik, Y.S.; Singh, K.P.; Chaicumpa, W.; Bonilla-Aldana, D.K.; Rodriguez-Morales, A.J. Coronavirus Disease 2019–COVID-19. Clin. Microbiol. Rev. 2020, 33. [Google Scholar] [CrossRef]
  6. Fehr, A.R.; Perlman, S. Coronaviruses: An Overview of Their Replication and Pathogenesis. Coronaviruses 2015, 1282, 1–23. [Google Scholar] [CrossRef] [Green Version]
  7. Ren, L.-L.; Wang, Y.-M.; Wu, Z.-Q.; Xiang, Z.-C.; Guo, L.; Xu, T.; Jiang, Y.-Z.; Xiong, Y.; Li, Y.-J.; Li, X.-W.; et al. Identification of a novel coronavirus causing severe pneumonia in human: A descriptive study. Chin. Med. J. 2020, 133, 1015–1024. [Google Scholar] [CrossRef]
  8. COVID-19 Map. Johns Hopkins Coronavirus Resource Center. Available online: https://coronavirus.jhu.edu/map.html (accessed on 30 July 2021).
  9. RKI. Coronavirus SARS-CoV-2. COVID-19: Fallzahlen in Deutschland und Weltweit. Available online: https://www.rki.de/DE/Content/InfAZ/N/Neuartiges_Coronavirus/Fallzahlen.html (accessed on 30 July 2021).
  10. Wallinga, J.; Teunis, P. Different Epidemic Curves for Severe Acute Respiratory Syndrome Reveal Similar Impacts of Control Measures. Am. J. Epidemiol. 2004, 160, 509–516. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Dong, E.; Du, H.; Gardner, L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect. Diseases 2020, 20, 533–534. [Google Scholar] [CrossRef]
  12. Wu, Z.; McGoogan, J.M. Characteristics of and Important Lessons From the Coronavirus Disease 2019 (COVID-19) Outbreak in China: Summary of a Report of 72 314 Cases From the Chinese Center for Disease Control and Prevention. J. Am. Med. Assoc. 2020, 323, 1239–1242. [Google Scholar] [CrossRef] [PubMed]
  13. Jung, C.; Levy, C.; Varon, E.; Biscardi, S.; Batard, C.; Wollner, A.; Deberdt, P.; Sellam, A.; Hau, I.; Cohen, R. Diagnostic Accuracy of SARS-CoV-2 Antigen Detection Test in Children: A Real-Life Study. Front. Pediatr. 2021, 9. [Google Scholar] [CrossRef]
  14. Levy, C.; Basmaci, R.; Bensaid, P.; Bru, C.B.; Coinde, E.; Dessioux, E.; Fournial, C.; Gashignard, J.; Haas, H.; Hentgen, V.; et al. Changes in Reverse Transcription Polymerase Chain Reaction—Positive Severe Acute Respiratory Syndrome Coronavirus 2 Rates in Adults and Children According to the Epidemic Stages. Pediatric Infect. Dis. J. 2020, 39, e369. [Google Scholar] [CrossRef]
  15. Eleftheriou, I.; Dasoula, F.; Dimopoulou, D.; Lebessi, E.; Serafi, E.; Spyridis, N.; Tsolia, M. Real-life evaluation of a COVID-19 rapid antigen detection test in hospitalized children. J. Med. Virol. 2021. [Google Scholar] [CrossRef]
  16. Afzal, A. Molecular diagnostic technologies for COVID-19: Limitations and challenges. J. Adv. Res. 2020, 26, 149–159. [Google Scholar] [CrossRef] [PubMed]
  17. La Marca, A.; Capuzzo, M.; Paglia, T.; Roli, L.; Trenti, T.; Nelson, S.M. Testing for SARS-CoV-2 (COVID-19): A systematic review and clinical guide to molecular and serological in-vitro diagnostic assays. Reprod. Biomed. Online 2020, 41, 483–499. [Google Scholar] [CrossRef]
  18. Delamater, P.L.; Street, E.J.; Leslie, T.F.; Yang, Y.T.; Jacobsen, K.H. Complexity of the Basic Reproduction Number (R0). Emerg. Infect. Dis. 2019, 25, 1–4. [Google Scholar] [CrossRef] [Green Version]
  19. Younes, N.; Al-Sadeq, D.W.; Al-Jighefee, H.; Younes, S.; Al-Jamal, O.; Daas, H.I.; Yassine, H.M.; Nasrallah, G.K. Challenges in Laboratory Diagnosis of the Novel Coronavirus SARS-CoV-2. Viruses 2020, 12, 582. [Google Scholar] [CrossRef] [PubMed]
  20. EU Health Preparedness: A Common List of COVID-19 Rapid Antigen Tests and a Common Standardised Set of Data to Be Included in COVID-19 Test Result Certificates. Available online: https://ec.europa.eu/health/sites/default/files/preparedness_response/docs/covid-19_rat_common-list_en.pdf (accessed on 28 May 2021).
  21. Liste der Antigentests. Available online: https://antigentest.bfarm.de/ords/f?p=110:100:12851818521609:::::&tz=2:00 (accessed on 28 May 2021).
  22. 2020_11_20_MS_Agen_Produktdatenblatt_V04-11.2020_pd.pdf n.d. Available online: https://www.medicsprint.com/wp-content/uploads/2020/11/2020_11_20_MS_Agen_Produktdatenblatt_V04-11.2020_pd.pdf (accessed on 20 November 2020).
  23. Panbio-Covid-19-ag-Nasal-Antigenschnelltest-Instructions-for-Use.pdf n.d. Available online: https://www.bvkj-shop.de/media/attachment/file/p/a/panbio-covid-19-ag-nasal-antigenschnelltest-instructions-for-use.pdf (accessed on 28 April 2021).
  24. Schildgen, V.; Demuth, S.; Lüsebrink, J.; Schildgen, O. Limits and Opportunities of SARS-CoV-2 Antigen Rapid Tests: An Experienced-Based Perspective. Pathogens 2021, 10, 38. [Google Scholar] [CrossRef] [PubMed]
  25. Landaas, E.T.; Storm, M.L.; Tollånes, M.C.; Barlinn, R.; Kran, A.-M.B.; Bragstad, K.; Christensen, A.; Andreassen, T. Diagnostic performance of a SARS-CoV-2 rapid antigen test in a large, Norwegian cohort. J. Clin. Virol. 2021, 137, 104789. [Google Scholar] [CrossRef] [PubMed]
  26. Albert, E.; Torres, I.; Bueno, F.; Huntley, D.; Molla, E.; Fernández-Fuentes, M.Á.; Martínez, M.; Poujois, S.; Forqué, L.; Valdivia, A.; et al. Field evaluation of a rapid antigen test (PanbioTM COVID-19 Ag Rapid Test Device) for COVID-19 diagnosis in primary healthcare centres. Clin. Microbiol. Infect. 2021, 27, 472. [Google Scholar] [CrossRef] [PubMed]
  27. Linares, M.; Pérez-Tanoira, R.; Carrero, A.; Romanyk, J.; Pérez-García, F.; Gómez-Herruz, P.; Arroyo, T.; Cuadros, J. Panbio antigen rapid test is reliable to diagnose SARS-CoV-2 infection in the first 7 days after the onset of symptoms. J. Clin. Virol. 2020, 133, 104659. [Google Scholar] [CrossRef]
  28. Lambert-Niclot, S.; Cuffel, A.; Le Pape, S.; Vauloup-Fellous, C.; Morand-Joubert, L.; Roque-Afonso, A.-M.; Le Goff, J.; Delaugerre, C. Evaluation of a Rapid Diagnostic Assay for Detection of SARS-CoV-2 Antigen in Nasopharyngeal Swabs. J. Clin. Microbiol. 2020, 58. [Google Scholar] [CrossRef]
  29. Scohy, A.; Anantharajah, A.; Bodéus, M.; Kabamba-Mukadi, B.; Verroken, A.; Rodriguez-Villalobos, H. Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis. J. Clin. Virol. 2020, 129, 104455. [Google Scholar] [CrossRef]
  30. Pilarowski, G.; Lebel, P.; Sunshine, S.; Liu, J.; Crawford, E.; Marquez, C.; Rubio, L.; Chamie, G.; Martinez, J.; Peng, J.; et al. Performance characteristics of a rapid SARS-CoV-2 antigen detection assay at a public plaza testing site in San Francisco. MedRxiv 2020. [Google Scholar] [CrossRef]
  31. Gremmels, H.; Winkel, B.M.; Schuurman, R.; Rosingh, A.; Rigter, N.A.; Rodriguez, O.; Ubijaan, J.; Wensing, A.M.; Bonten, M.J.; Hofstra, L. Real-life validation of the PanbioTM COVID-19 antigen rapid test (Abbott) in community-dwelling subjects with symptoms of potential SARS-CoV-2 infection. EClinicalMedicine 2020, 31. [Google Scholar] [CrossRef]
  32. Merino, P.; Guinea, J.; Muñoz-Gallego, I.; González-Donapetry, P.; Galán, J.C.; Antona, N.; Cilla, G.; Hernáez-Crespo, S.; Tuesta, J.L.D.-D.; Torrella, A.G.-D.; et al. Multicenter evaluation of the PanbioTM COVID-19 rapid antigen-detection test for the diagnosis of SARS-CoV-2 infection. Clin. Microbiol. Infect. 2021, 27, 758–761. [Google Scholar] [CrossRef] [PubMed]
  33. Harris, D.T.; Badowski, M.; Jernigan, B.; Sprissler, R.; Edwards, T.; Cohen, R.; Paul, S.; Merchant, N.; Weinkauf, C.; Bime, C.; et al. SARS-CoV-2 Rapid Antigen Testing of Symptomatic and Asymptomatic Individuals on the University of Arizona Campus. Biomedicines 2021, 9, 539. [Google Scholar] [CrossRef]
  34. L’Huillier, A.G.; Lacour, M.; Sadiku, D.; Gadiri, M.A.; Siebenthal, L.D.; Schibler, M.; Eckerle, I.; Pinösch, S.; Kaiser, L.; Gervaixet, A.; et al. Diagnostic accuracy of SARS-CoV-2 rapid antigen detection testing in symptomatic and asymptomatic children in the clinical setting. MedRxiv 2021. [Google Scholar] [CrossRef]
  35. Pray, I.W.; Ford, L.; Cole, D.; Lee, C.; Bigouette, J.P.; Abedi, G.R.; Bushman, D.; Delahoy, M.J.; Currie, D.; Cherney, B.; et al. Performance of an Antigen-Based Test for Asymptomatic and Symptomatic SARS-CoV-2 Testing at Two University Campuses, Wisconsin, September–October 2020. Morb. Mortal. Wkly. Rep. 2021, 69, 1642–1647. [Google Scholar] [CrossRef]
  36. Schwartz, K.L.; McGeer, A.J.; Bogoch, I.I. Rapid antigen screening of asymptomatic people as a public health tool to combat COVID-19. Can. Med. Assoc. J. 2021, 193, E449–E452. [Google Scholar] [CrossRef]
  37. Pavelka, M.; Van-Zandvoort, K.; Abbott, S.; Sherratt, K.; Majdan, M.; Jarčuška, P.; Krajčí, M.; Flasche, S.; Funk, S. The impact of population-wide rapid antigen testing on SARS-CoV-2 prevalence in Slovakia. Science 2021, 372, 635–641. [Google Scholar] [CrossRef]
  38. Euser, S.; Aronson, S.; Manders, I.; van Lelyveld, S.; Herpers, B.; Sinnige, J.; Kalpoe, J.; van Gemeren, C.; Snijders, D.; Jansen, R.; et al. SARS-CoV-2 viral load distribution reveals that viral loads increase with age: A retrospective cross-sectional cohort study. MedRxiv 2021. [Google Scholar] [CrossRef]
  39. Baggio, S.; L’Huillier, A.G.; Yerly, S.; Bellon, M.; Wagner, N.; Rohr, M.; Huttner, A.; Blanchard-Rohner, G.; Loevy, N.; Kaiser, L.; et al. SARS-CoV-2 viral load in the upper respiratory tract of children and adults with early acute COVID-19. Clin. Infect. Dis. 2020. [Google Scholar] [CrossRef] [PubMed]
  40. Binax Training. United in Health. Available online: https://unitedinhealth.org/binax-training (accessed on 25 May 2021).
  41. Peeling, R.W.; Olliaro, P.L.; Boeras, D.I.; Fongwen, N. Scaling up COVID-19 rapid antigen tests: Promises and challenges. Lancet Infect. Dis. 2021. [Google Scholar] [CrossRef]
  42. Torres, I.; Poujois, S.; Albert, E.; Colomina, J.; Navarro, D. Evaluation of a rapid antigen test (PanbioTM COVID-19 Ag rapid test device) for SARS-CoV-2 detection in asymptomatic close contacts of COVID-19 patients. Clin. Microbiol. Infect. 2021, 27, 636. [Google Scholar] [CrossRef] [PubMed]
  43. Fouzas, S. SARS-CoV-2 rapid antigen detection tests. Lancet Infect. Dis. 2021, 21, 1068–1069. [Google Scholar] [CrossRef]
  44. Krüttgen, A.; Cornelissen, C.G.; Dreher, M.; Hornef, M.W.; Imöhl, M.; Kleines, M. Comparison of the SARS-CoV-2 Rapid antigen test to the real star Sars-CoV-2 RT PCR kit. J. Virol. Methods 2021, 288, 114024. [Google Scholar] [CrossRef] [PubMed]
  45. Schwob, J.M.; Miauton, A.; Petrovic, D.; Perdrix, J.; Senn, N.; Jaton, K.; Onya, O.; Maillard, A.; Minghelli, G.; Cornuz, J.; et al. Antigen rapid tests, nasopharyngeal PCR and saliva PCR to detect SARS-CoV-2: A prospective comparative clinical trial. MedRxiv 2020. [Google Scholar] [CrossRef]
  46. Wölfel, R.; Corman, V.M.; Guggemos, W.; Seilmaier, M.; Zange, S.; Müller, M.A.; Niemeyer, D.; Jones, T.C.; Vollmar, P.; Rothe, C.; et al. Virological assessment of hospitalized patients with COVID-2019. Nature 2020, 581, 465–469. [Google Scholar] [CrossRef] [Green Version]
  47. Van Kampen, J.J.A.; van de Vijver, D.A.M.C.; Fraaij, P.L.A.; Haagmans, B.L.; Lamers, M.M.; Okba, N.; Akker, J.P.C.V.D.; Endeman, H.; Gommers, D.A.M.P.J.; Cornelissen, J.J.; et al. Duration and key determinants of infectious virus shedding in hospitalized patients with coronavirus disease-2019 (COVID-19). Nat. Commun. 2021, 12, 1–6. [Google Scholar] [CrossRef]
  48. RKI. Coronavirus SARS-CoV-2. Available online: https://www.rki.de/DE/Content/InfAZ/N/Neuartiges_Coronavirus/nCoV_node.html;jsessionid=7E7A6B497753535F6178F399DA5F8378.internet082 (accessed on 12 June 2021).
  49. 20210118g_Begleitheft_-_Quantitative_Bezugsproben_1_und_2_-_SARS-CoV-2.pdf n.d. Available online: https://www.instand-ev.de/fileadmin/uploads/user_upload/Dokumente/Virologie/20210118g_Begleitheft_-_quantitative_Bezugsproben_1_und_2_-_SARS-CoV-2.pdf (accessed on 12 June 2021).
Figure 1. Distribution of the different Ct values from people who tested either RAT+ or RAT−.
Figure 1. Distribution of the different Ct values from people who tested either RAT+ or RAT−.
Children 08 00682 g001
Figure 2. ROC-curves of the different Ct values.
Figure 2. ROC-curves of the different Ct values.
Children 08 00682 g002
Table 1. Demographic and clinical distribution of patients.
Table 1. Demographic and clinical distribution of patients.
Adults ≥ 18 Years (n = 2810)Pediatric < 18 Years (n = 876)
Demographic characteristics
Gender
(female)
1820
(64.8%)
440
(50.2%)
Age in years, Median [IQR]43
(31–71)
6
(1–14)
Clinical characteristics of positive RT-PCR SARS-CoV-2 tested (n = 80 *)
Fever > 38.5 °C7 (14.3%)
n = 49
4 (16.7%)
n = 24
Cough6 (12.2%)
n = 49
3 (12.5%)
n = 24
Rhinitis6 (12.2%)
n = 49
4 (16.7%)
n = 24
Anosmia and/or ageusia0 (0%)
n = 49
1 (8.3%)
n = 12
Diarrhea0 (0%)
n = 49
2 (8.3%)
n = 24
Vomiting0 (0%)
n = 49
0 (0%)
n = 24
* Some clinical information of the person who tested positive for RT-PCR was missing because not all forms were correctly filled out and the persons could not be contacted retrospectively.
Table 2. Age distribution of the patients (n = 3686).
Table 2. Age distribution of the patients (n = 3686).
Age in YearsNumber of SubjectsGender (Female)
0–4410 (11.1%)185 (45.1%)
5–14283 (7.7%)151 (53.3%)
15–17183 (5.0%)104 (84.1%)
18–341010 (27.4%)913 (90.4%)
35–59751 (20.4%)460 (61.2%)
60–79639 (17.3%)247 (38.7%)
>80410 (11.1%)200 (48.7%)
Table 3. Performance of the Rapid antigen test in field.
Table 3. Performance of the Rapid antigen test in field.
Overall Study PopulationAdults ≥ 18 YearsPediatric < 18 Years
Se27.5%
[18.1–38.6%]
30.4%
[18.8–44.1%]
20.8%
[7.1–42.2%]
Sp99.6%
[99.3–99.8%]
99.8%
[99.5–99.9%]
99.1%
[98.2–99.6%]
PPV *59.5%
[44.2–73.1%]
70.8%
[51.2–84.9%]
38.5%
[18.1–63.9%]
NPV *98.4%
[98.2–98.6%]
98.6%
[98.3–98.8%]
97.8%
[97.3–98.2%]
* Positive predictive value (PPV) and negative predictive value (NPV) were calculated using a prevalence of 2.2%.
Table 4. Performance of the rapid antigen test depending on the N-gene Ct value.
Table 4. Performance of the rapid antigen test depending on the N-gene Ct value.
TOTAL
Ct Value < 30
TOTAL
Ct Value ≥ 30
≥18 Years
Ct Value < 30
≥18 Years
Ct Value ≥ 30
<18 Years
Ct Value < 30
<18 Years
Ct Value ≥ 30
Se80%
[59.3–93.2%]
2.2%
[0.1–11.8%]
75%
[50.1–91.3%]
3.23%
[0.1–16.7%]
100%
[47.8–100%]
0%
[0–23.2%]
Sp99.6%
[99.3–99.8%]
99.6%
[99.3–99.8%]
99.8%
[99.5–99.9%]
99.8%
[99.5–99.9%]
99,6%
[98.2–99.6%]
99.1%
[98.2–99.6%]
PPV57.1%
[43.7–69.6%]
6.3%
[0.9–33.1%]
68.2%
[49.5–82.4%]
12.5%
[1.8–53.0%]
38.5%
[23.9–55.5%]
0
NPV99.9%
[99.7–99.9%]
98.8%
[98.7–98.8%]
99.8%
[99.6–99.9%]
98.2%
[98.9–99.0%]
100.0%98.4%
[98.3–98.4%]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mboma, O.; Rieke, E.; Ahmad-Nejad, P.; Wirth, S.; Aydin, M. Diagnostic Performance of SARS-CoV-2 Rapid Antigen Test in a Large, German Cohort. Children 2021, 8, 682. https://doi.org/10.3390/children8080682

AMA Style

Mboma O, Rieke E, Ahmad-Nejad P, Wirth S, Aydin M. Diagnostic Performance of SARS-CoV-2 Rapid Antigen Test in a Large, German Cohort. Children. 2021; 8(8):682. https://doi.org/10.3390/children8080682

Chicago/Turabian Style

Mboma, Olivier, Elmar Rieke, Parviz Ahmad-Nejad, Stefan Wirth, and Malik Aydin. 2021. "Diagnostic Performance of SARS-CoV-2 Rapid Antigen Test in a Large, German Cohort" Children 8, no. 8: 682. https://doi.org/10.3390/children8080682

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop