Next Article in Journal
A New Artificial Intelligence-Based Method for Identifying Mycobacterium Tuberculosis in Ziehl–Neelsen Stain on Tissue
Previous Article in Journal
COVLIAS 2.0-cXAI: Cloud-Based Explainable Deep Learning System for COVID-19 Lesion Localization in Computed Tomography Scans
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

First Results of an External Quality Assessment (EQA) Scheme for Molecular, Serological and Antigenic Diagnostic Test for SARS-CoV-2 Detection in Lombardy Region (Northern Italy), 2020–2022

1
Centro di Riferimento per la Qualità dei Servizi di Medicina di Laboratorio di Regione Lombardia, 20162 Milano, Italy
2
Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, 20133 Milano, Italy
3
Direzione Generale Welfare Regione Lombardia, 20124 Milano, Italy
*
Author to whom correspondence should be addressed.
Diagnostics 2022, 12(6), 1483; https://doi.org/10.3390/diagnostics12061483
Submission received: 24 May 2022 / Revised: 13 June 2022 / Accepted: 13 June 2022 / Published: 16 June 2022
(This article belongs to the Section Diagnostic Microbiology and Infectious Disease)

Abstract

:
For diagnosing SARS-CoV-2 infection and for monitoring its spread, the implementation of external quality assessment (EQA) schemes is mandatory to assess and ensure a standard quality according to national and international guidelines. Here, we present the results of the 2020, 2021, 2022 EQA schemes in Lombardy region for assessing the quality of the diagnostic laboratories involved in SARS-CoV-2 diagnosis. In the framework of the Quality Assurance Programs (QAPs), the routinely EQA schemes are managed by the regional reference centre for diagnostic laboratories quality (RRC-EQA) of the Lombardy region and are carried out by all the diagnostic laboratories. Three EQA programs were organized: (1) EQA of SARS-CoV-2 nucleic acid detection; (2) EQA of anti-SARS-CoV-2-antibody testing; (3) EQA of SARS-CoV-2 direct antigens detection. The percentage of concordance of 1938 molecular tests carried out within the SARS-CoV-2 nucleic acid detection EQA was 97.7%. The overall concordance of 1875 tests carried out within the anti-SARS-CoV-2 antibody EQA was 93.9% (79.6% for IgM). The overall concordance of 1495 tests carried out within the SARS-CoV-2 direct antigens detection EQA was 85% and it was negatively impacted by the results obtained by the analysis of weak positive samples. In conclusion, the EQA schemes for assessing the accuracy of SARS-CoV-2 diagnosis in the Lombardy region highlighted a suitable reproducibility and reliability of diagnostic assays, despite the heterogeneous landscape of SARS-CoV-2 tests and methods. Laboratory testing based on the detection of viral RNA in respiratory samples can be considered the gold standard for SARS-CoV-2 diagnosis.

1. Introduction

As SARS-CoV-2 spread globally becoming a pandemic, the urgent need to provide a laboratory diagnosis of the infection for clinical management of individual patients and for monitoring its spread in the community arose [1,2,3]. This resulted in a rapid development of diagnostic tests, including methods for the direct detection of the virus in biological samples (molecular and antigenic tests) and for indirect detection by documenting a contact with SARS-CoV-2 (serological antibodies tests). Molecular analyses on nasal-pharyngeal swabs (NPS) detecting the viral RNA are usually in use for SARS-CoV-2 diagnosis [4]. In particular, due to its accuracy and sensitivity, real-time RT-PCR is considered the gold standard method, being able to detect the viral RNA also in samples with low viral load [5,6,7]. However, faster methods based on the detection of the viral antigens are available [8]. Moreover, serological assays, able to determine a past infection through the identification of anti-viral specific antibodies, are complementary to the molecular tests, whenever a suspected COVID-19 case is not tested or results negative with molecular methods [9]. This approach is also useful to perform a retrospective diagnosis, to estimate SARS-CoV-2 time of infection, to measure the infection and exposure rates and to analyse the presence of neutralising antibodies after vaccination [10,11,12].
The impact of the pandemic on economic and social life required a rapid response able to face the health crisis that generated a huge number of diagnostic assays, which could have different sensitivity and specificity.
The diagnostic laboratories in Italy can implement the diagnostic assays of their choice after a proper validation with the gold standard methods. In order to guarantee a high quality in clinical diagnosis, it is required that the diagnostic laboratories participate at definite time to external quality assessments (EQA) consisting of a set of anonymised samples that must be analysed by each diagnostic laboratory. After matching the results obtained in each laboratory, the third party provides the evaluation of each diagnostic laboratory and shares the final report. The participation to EQA schemes is mandatory in Italy according to regional and national laws [13,14] and it is necessary to obtain and keep laboratory accreditation [12].
The regional reference centre for diagnostic laboratories quality (RRC-EQA) is in charge for the diagnostic laboratories’ evaluation through EQA schemes in Lombardy, reporting to the local health agencies any irregularity (i.e., no participation or non-compliant results) [15,16].
Here, we present the results of the 2020, 2021 and 2022 EQA schemes applied in Lombardy region in order to assess the quality of the laboratories operating in the region.

2. Materials and Methods

2.1. Organization of the EQA Schemes and Description of the Control Materials

In the framework of the Quality Assurance Programs (QAPs), the routinely EQA schemes are managed by the RRC-EQA of the Lombardy region and are usually carried out by all diagnostic laboratories. Regarding to the SARS-CoV-2 EQA schemes three EQA programs were organized. In particular:
(i).
EQA of SARS-CoV-2 nucleic acid detection, represented by a coded panel consisting of 12 samples of control material (7 SARS-CoV-2 RNA positive and 5 negative) and analysed from July 2020 to July 2021;
(ii).
EQA of anti-SARS-CoV-2 antibody test composed by a panel of 12 serum samples of control material (positive and negative depending on type of antibody) analysed from September 2020 to September 2021;
(iii).
EQA of SARS-CoV-2 direct antigens detection consisting of a panel of 12 samples of control material (9 positive and 3 negative samples) analysed from April 2021 to April 2022.
Detailed information on the coding panel is shown in Tables. In detail, the control materials used in the EQA SARS-CoV-2 nucleic acid detection and direct antigen detection consisted of lyophilized cell culture supernatants obtained from SARS-CoV-2-positive/negative nasopharyngeal swabs. Each participating laboratory had to mix the lyophilized materials provided by the EQA with a dilution buffer or transport medium accordingly to the EQA instructions. The control material of the EQA anti-SARS-CoV-2-antibody detection consisted of a 0.5 mL vial of human plasma with known titre of IgG, IgM, IgA and total Ig. The classification of the samples and the concentration of SARS-CoV-2 was defined by Polymed s.r.l (Barberino Tavarnelle, Italy) in agreement with the RRC-EQA.
All samples were stored and shipped at 2–8 °C. Upon arrival, diagnostic laboratories were requested to store the samples at 2–8 °C until testing and to report the condition of the shipped samples by filling an online form at the RRC-EQA website (www.qualitalaboratorilombardia.it accessed on 20 April 2021). The diagnostic laboratories participating in the EQA were required to test the panels using each of their routine molecular and serological procedures and to report the results and the test carried out for performing the EQA on the RRC-EQA website (www.qualitalaboratorilombardia.it accessed on 20 April 2021). Data about nucleic acid extraction and detection methods, serological assays, instruments and reagents details, manufacturers, raw detection data, and qualitative results were required to be submitted. In particular, in the SARS-CoV-2 nucleic acid detection EQA the diagnostic laboratories were requested to specify the target gene of the assay (Nucleocapside, N; Spike, S; Envelope, E, ORF1ab, ORF8, RdRp) and to report qualitative value of the Cycle Threshold (Ct) of the run of the RT-PCR assay. In the EQA of anti-SARS-CoV-2 antibody testing, the diagnostic laboratories were requested to report qualitative and quantitative results of IgM, IgG, IgA and total Ig and to specify the type of antibodies (anti-N, S1, S2, S1/S2, S1-RBD, Trimeric S). As concern the EQA of SARS-CoV-2 direct antigens detection, the diagnostic laboratories were requested to report qualitative and quantitative results and to specify the viral antigen targeted by the test (N and/or S).
For molecular detection of SARS-CoV-2, before participating in the regional EQA, each laboratory was requested to participate to a preliminary assessment to evaluate the concordance among different commercial assays by testing a panel of 15 samples (5 SARS-CoV-2 RNA-positive and 10 negative samples) [16] to those obtained by the reference centre for COVID-19 virological surveillance at the Department of Biomedical Sciences for Health, University of Milan [17], in the Lombardy region.
The final report was distributed within seven working days from each EQA scheme deadline.

2.2. Analysis of the Results of SARS-CoV-2 Nucleic Acid Detection EQA

The data obtained from each diagnostic laboratory for the SARS-CoV-2 nucleic acid detection EQA were reported overall as number of participating laboratories reporting data. Data were collided by assay in use and by target. The overall number of tests performed was also included in the analysis. Based on the Ct value obtained, each sample was reported as positive, weak positive, negative (when the Ct value was under the cut-off of the assay in use) or invalid (when the test failed for the absence of internal control).

2.3. Analysis of the Results of Anti-SARS-CoV-2 Antibody Testing EQA

The descriptive analysis of the anti-SARS-CoV-2 antibody EQA was performed. The number of the diagnostic laboratories that reported the results, the number of the different serological antigenic assays and the number of tests performed were reported. Per each serological assay the results were analysed by target and reported as negative (i.e., under the cut-off), undetermined (i.e., when the result obtained was not conclusive) or positive (i.e., over the methods’ cut-off).

2.4. Analysis of the Results EQA of SARS-CoV-2 Direct Antigens Detection EQA

The descriptive analysis of the EQA of SARS-CoV-2 direct antigens detection results was performed. The number of the diagnostic laboratories that reported the results, the number of the different serological antigenic assays and the number of tests performed were reported. Per each assay the result was reported as negative (i.e., under the cut-off), undetermined (i.e., when the result obtained was not conclusive) or positive (i.e., over the methods’ cut-off).

3. Results

3.1. SARS-CoV-2 Nucleic Acid Detection EQA

Table 1 reports the number of laboratories participating to each quality assurance exercise, the number of assays used, the number of reported results of the SARS-CoV-2 nucleic acid detection EQA program that included 12 samples distributed from July 2020 to July 2021. Over the time, the number of laboratories participating in this EQA changed from 56 on July 2020 to 86 on July 2021 that carried out from 57 (sample #1) to 115 (sample #12) assays, resulting in 1938 molecular tests (Table 1).
The percentage of concordance of 1938 tests carried out within the SARS-CoV-2 nucleic acid detection EQA was 97.7%. The value of concordance rose to 99.8% by ruling out from the analysis all the “invalid” results (i.e., inconclusive results). Considering results of the positive samples only, the concordance was 99.7% and when weak positive samples (samples #3 and #5) were excluded from the analysis the concordance was 99.9% (Table 1).
The concordance of negative samples #2 and #8 was 100%, of sample #10 was 99% and was 79.4% for the negative sample #4. The analysis of the negative sample #6 gave an invalid result for 3.5% of the diagnostic assays (Table 1).

3.2. Anti-SARS-CoV-2 Antibody Testing EQA

Table 2 reports the number of laboratories reporting, the number of assays, the number of reported testing and results of the anti-SARS-CoV-2 antibody EQA program carried out from September 2020 to September 2021 and including 12 quality exercises. According to the reported results, the most frequently used test was that for the detection of IgG that was conducted by 66 laboratories for sample #1 and by 77 laboratories for sample #12, with 33 different assays to test sample #11. The test for the detection of IgA was carried out only by two laboratories for sample #1 and by one laboratory for samples #3, #4 and #5. Overall, 1875 tests were carried out within the anti-SARS-CoV-2 antibody EQA: in detail, 845 tests targeted IgG, 450 tests targeted IgM, 5 tests identified IgA and 389 tests assayed the presence of total Ig (Table 2). The different number of tests for specific immunoglobulins overlapped the clinical utility of these tests [18]. Overall, the samples of this EQA were investigated with a number of assays ranging from 2 to 33 (Table 2). The overall concordance was 93.9%; in particular, the concordance for the negative samples was 99.1% for IgG, 89% for IgM, 100% for IgA and 100% for total Ig. For positive samples, the concordance was 99.6% for IgG, 100% for IgA and 93.8% for total Ig (Table 2); the concordance of the IgM testing was 79.6%, this latter percentage may depend on the fact that—for a number of assays—the value of positive samples was close to the cut-off level of the assay. Samples #11 and #12 were from COVID-19-vaccinated patients and these samples did not allow a positive response for those analytical tests that target antigens other than the viral protein S.

3.3. SARS-CoV-2 Direct Antigens Detection EQA

Table 3 reports the number of laboratories reporting, the number of assays, the number of reported testing, the classification of the samples and results of the of SARS-CoV-2 direct antigens detection EQA program carried out from April 2021 to April 2022 and including 12 samples. Overall, all samples of this EQA were investigated with a number of assays ranging from 27 (for sample #2) to 35 (for sample #5) (Table 3). The overall concordance of 1495 tests carried out within the SARS-CoV-2 direct antigens detection EQA was 85%. The concordance was 97.8% for positive samples (samples #1, #5, #6, #9, #10), 99.2% for negative samples (samples #2, #4 and #8) and 64.7% for weak positive (borderline) samples (samples #3, #7, #11 and #12). In the case of samples #2 and #7, 1.6% and 1.7%, respectively, of the results were reported as “invalid” since problems in storage and handling of these samples were reported from several laboratories.

4. Discussion

In laboratory medicine EQA programs are pivotal to assess the performance and status of diagnostic assays in clinical laboratories [19]. Reproducibility and reliability of diagnostic assays are of particular importance in the clinical management and for public health purpose [19]. Laboratories should perform verification studies before routine implementation of novel tests and monitor reliability throughout the entire process through routinely quality management [12]. Moreover, the inter-laboratory comparison allows to evaluate participants’ performance by appraising the analytical performance and test interpretation and to evaluate method performance.
The results of the EQA schemes here presented were organized in 2020, 2021 and 2022 to evaluate the accuracy—as well as the ability to detect positive and negative samples in clinical practice—of SARS-CoV-2 diagnostic assays among clinical laboratories in the Lombardy region. Three EQAs were organized: an EQA of SARS-CoV-2 nucleic acid detection was conducted since July 2020, an EQA of anti-SARS-CoV-2 antibody testing was conducted since September 2020 and an EQA of SARS-CoV-2 direct antigens identification was carried out since April 2021. The laboratories participating in these EQA programs were required to assay the panels using their routine procedures and report their qualitative and/or quantitative results.
A level of concordance below 100% could represent a problem in a pandemic situation and in the control of SARS-CoV-2 spread due to the number of false negative results. In our experience, the percentage of concordance of 1938 tests carried out within the SARS-CoV-2 nucleic acid detection EQA was 97.7%, which can depend on different cut-off as defined by Ct values or algorithm to consider a result conclusive or inconclusive in the performing laboratory. In fact, the concordance rises to 99.8% by ruling out from the analysis all the “invalid” results (i.e., inconclusive results). Some of the SARS-CoV-2 RT-PCR kits did not detect the internal control of the negative sample #4, making the value of concordance for this sample equal to 79.4%; this could depend on a low concentration of human cells.
The overall concordance of 1875 tests carried out in the anti-SARS-CoV-2 antibody testing EQA was 93.9%; in particular, the concordance for the positive samples reached 99.6% for IgG, 100% for IgA and 93.8% for total Ig, but the concordance for IgM was 79.6%. The lower level of concordance for IgM could depend on the fact that, for a number of commercial assays, the value of IgM was close to the cut-off level of the assay. As already reported in the recent literature [20,21], immunochromatographic tests—although scarcely used by the diagnostic laboratories involved in this EQA program [3]—have showed a low level of concordance, thus their implementation should be considered critical in clinical setting. Serum samples #11 and #12 were from COVID-19-vaccinated patients and the particular type of sample examined did not allow a positive response for those analytical tests that target antigens other than the viral S protein.
The level of concordance of 1495 tests carried out in the EQA of SARS-CoV-2 direct antigens detection was 85%, thus achieving the World Health Organization (WHO) criteria for the use of antigenic test (minimum performance requirement ≥ 80%) [22]. The lowest level of concordance was reported for samples #3, #7, #11 and #12 that all were weak positive (borderline) samples; this could mean either that the available commercial kits have a different level of sensibility or that the results in the case of a weak positive sample could be laboratory-dependent. Both aspects could heavily impact on SARS-CoV-2 spread in consideration that SARS-CoV-2 direct antigens detection may be used in screening programs. The evidence from this study are in agreement with the findings of Jeulien et al. [8] who have determined that high value of sensitivity of direct antigenic tests can be obtained only for SARS-CoV-2 positive samples with a Ct value ≤ 25 and that in case of asymptomatic patients or individuals with low viral load the sensitivity was of 58.1% [8].

5. Conclusions

In conclusion, EQA schemes are of crucial importance to assess the diagnostic performance of individual laboratories and to improve the overall quality. The EQA schemes here designed by the RRC-EQA for assessing the clinical accuracy of SARS-CoV-2 diagnosis in the Lombardy region highlighted a suitable reproducibility and reliability of diagnostic assays, despite the heterogeneous landscape of SARS-CoV-2 testing and methods. Results from this study show that the measurement of IgM anti-SARS-CoV-2 and the direct detection of SARS-CoV-2 antigens in case of weak positive samples have the lowest level of concordance and that the laboratory testing based on the detection of viral RNA can be considered the gold standard for SARS-CoV-2 diagnosis.

Author Contributions

E.P., M.C., D.C. and S.B. contributed to the conception and design of the study; F.P., M.R. and G.L. were involved in data acquisition and elaboration; F.P., G.A., S.D.M., O.L.L. and S.G. performed the statistical analysis; C.G., L.B. and L.P. contributed to the interpretation of the results; F.P., E.P., L.B. and L.P. drafted the manuscript; E.P., M.C., D.C. and S.B. revised the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We thank the DG Welfare of the Lombardy Region for the consent to public the results of these EQA schemes.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Severe COVID-19 GWAS Group; Ellinghaus, D.; Degenhardt, F.; Bujanda, L.; Buti, M.; Albillos, A.; Invernizzi, P.; Fernández, J.; Prati, D.; Baselli, G.; et al. Genomewide Association Study of Severe COVID-19 with Respiratory Failure. N. Engl. J. Med. 2020, 383, 1522–1534. [Google Scholar] [CrossRef] [PubMed]
  2. World Health Organization (WHO). WHO Coronavirus Disease (COVID-19) Dashboard. Available online: https://covid19.who.int (accessed on 12 June 2022).
  3. Regione Lombardia. Available online: https://urlsand.esvalabs.com/?u=https%3A%2F%2Fwww.regione.lombardia.it%2Fwps%2Fportal%2Fistituzionale%2FHP%2FDettaglioRedazionale%2Fservizi-e-informazioni%2Fcittadini%2Fsalute-e-prevenzione%2Fcoronavirus%2Fcovid-19-lombardia-altre-regioni%2Fcovid-19-lombardia-altre-regioni&e=855a38ce&h=0bb8e44a&f=y&p=y (accessed on 12 June 2022).
  4. Edson, D.C.; Casey, D.L.; Harmer, S.E.; Downes, F.P. Identification of SARS-CoV-2 in a Proficiency Testing Program. Am. J. Clin. Pathol. 2020, 154, 475–478. [Google Scholar] [CrossRef]
  5. Younes, N.; Al-Sadeq, D.W.; Al-Jighefee, H.; Younes, S.; Al-Jamal, O.; Daas, H.I.; Yassine, H.M.; Nasrallah, G.K. Challenges in Laboratory Diagnosis of the Novel Coronavirus SARS-CoV-2. Viruses 2020, 12, 582. [Google Scholar] [CrossRef]
  6. Mancini, F.; Barbanti, F.; Scaturro, M.; Errico, G.; Iacobino, A.; Bella, A.; Riccardo, F.; Marsili, G.; Stefanelli, P.; Pezzotti, P.; et al. Laboratory management for SARS-CoV-2 detection: A user-friendly combination of the heat treatment approach and rt-Real-time PCR testing. Emerg. Microbes Infect. 2020, 9, 1393–1396. [Google Scholar] [CrossRef]
  7. Fomsgaard, A.S.; Rosenstierne, M.W. An alternative workflow for molecular detection of SARS-CoV-2—Escape from the NA extraction kit-shortage, Copenhagen, Denmark, March 2020. Eurosurveillance 2020, 25, 2000398. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Hartard, C.; Berger, S.; Josse, T.; Schvoerer, E.; Jeulin, H. Performance evaluation of an automated SARS-CoV-2 Ag test for the diagnosis of COVID-19 infection on nasopharyngeal swabs. Clin. Chem. Lab. Med. 2021, 59, 2003–2009. [Google Scholar] [CrossRef] [PubMed]
  9. Deeks, J.J.; Dinnes, J.; Takwoingi, Y.; Davenport, C.; Spijker, R.; Taylor-Phillips, S.; Adriano, A.; Beese, S.; Dretzke, J.; di Ruffano, L.F.; et al. Antibody tests for identification of current and past infection with SARS-CoV-2. Cochrane Database Syst. Rev. 2020, 6, CD013652. [Google Scholar] [CrossRef] [PubMed]
  10. Gulholm, T.; Basile, K.; Kok, J.; Chen, S.C.; Rawlinson, W. Laboratory diagnosis of severe acute respiratory syndrome coronavirus 2. Pathology 2020, 52, 745–753. [Google Scholar] [CrossRef] [PubMed]
  11. World Health Organization (WHO). Diagnostic Testing for SARS-CoV-2. Available online: https://www.who.int/publications/i/item/diagnostic-testing-for-sars-cov-2 (accessed on 12 June 2022).
  12. Lisboa Bastos, M.; Tavaziva, G.; Abidi, S.K.; Campbell, J.R.; Haraoui, L.-P.; Johnston, J.C.; Lan, Z.; Law, S.; MacLean, E.; Trajman, A.; et al. Diagnostic accuracy of serological tests for COVID-19: Systematic review and meta-analysis. BMJ 2020, 370, m2516. [Google Scholar] [CrossRef] [PubMed]
  13. Decreto del Presidente della Repubblica 14 Gennaio 1997. Approvazione Dell’atto di Indirizzo e Coordinamento alle Regioni e alle Province Autonome di Trento e di Bolzano. In Materia di Requisiti Strutturali Tecnologici ed Organizzativi Minimi per L’esercizio delle Attività Sanitarie da Parte delle Strutture Pubbliche e Private. G.U. Serie Generale n. 42 del 20 febbraio 1997. Available online: https://www.gazzettaufficiale.it/eli/id/1997/02/20/097A1165/sg (accessed on 12 June 2022).
  14. DGR n. VII/3313–Approvazione delle Direttive in Ordine All’attuazione delle Disposizioni di cui alla l.r. 15/1999 art. 4. Comma 4. Relative ai Servizi di Medicina di Laboratorio e All’attività di Prelievo. Regione Lombardia. Available online: https://cdn.onb.it/2013/11/dgr2001_3313_lombardia.pdf (accessed on 12 June 2022).
  15. DG Welfare protocollo, n. GÌ.2020.0020666 del 19/05/2020-Attivazione Servizi di Medicina di Laboratorio per l’inserimento nella Rete della Regione Lombardia per la Ricerca dell’RNA SARS-CoV-2 e Indicazioni per la Negoziazione. Available online: http://www.qualitalaboratorilombardia.it:8080/front/d_g_welfare.php (accessed on 12 June 2022).
  16. DGR, n. X/6502-Piano Controlli Riguardo i Servizi di Medicina di Laboratorio. Regione Lombardia. Available online: http://www.qualitalaboratorilombardia.it:8080/front/public/1621253899dgr_X-6502_VEQ-unito.pdf (accessed on 12 June 2022).
  17. Centers for Disease Control and Prevention (CDC). Research Use Only 2019-Novel Coronavirus (2019-nCoV) Real-Time RT-PCR Primers and Probes. Available online: https://www.cdc.gov/coronavirus/2019-ncov/lab/rt-pcr-panel-primer-probes.html (accessed on 12 June 2022).
  18. Cassaniti, I.; Novazzi, F.; Giardina, F.; Salinaro, F.; Sachs, M.; Perlini, S.; Bruno, R.; Mojoli, F.; Baldanti, F. Members of the San Matteo Pavia COVID-19 Task Force. Performance of VivaDiag COVID-19 IgM/IgG Rapid Test is inadequate for diagnosis of COVID-19 in acute patients referring to emergency room department. J. Med. Virol. 2020, 92, 1724–1727. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Ceriotti, F. The role of External Quality Assessment Schemes in Monitoring and Improving the Standardization Process. Clin. Chim. Acta 2014, 432, 77–81. [Google Scholar] [CrossRef] [PubMed]
  20. Görzer, I.; Buchta, C.; Chiba, P.; Benka, B.; Camp, J.V.; Holzmann, H.; Puchhammer-Stöckl, E.; Aberle, S.W. First results of a national external quality assessment scheme for the detection of SARS-CoV-2 genome sequences. J. Clin. Virol. 2020, 129, 104537. [Google Scholar] [CrossRef] [PubMed]
  21. Prazuck, T.; Colin, M.; Giachè, S.; Gubavu, C.; Seve, A.; Rzepecki, V.; Chevereau-Choquet, M.; Kiani, C.; Rodot, V.; Lionnet, E.; et al. Evaluation of performance of two SARS-CoV-2 Rapid IgM-IgG combined antibody tests on capillary whole blood samples from the fingertip. PLoS ONE 2020, 15, e0237694. [Google Scholar] [CrossRef] [PubMed]
  22. World Health Organization (WHO). WHO Reference Number: WHO/2019-nCoV/Antigen_Detection/2021.1. 2021. Available online: https://apps.who.int/iris/bitstream/handle/10665/345948/WHO-2019-nCoV-Antigen-Detection-2021.1-eng.pdf?sequence=1&isAllowed=y (accessed on 12 June 2022).
Table 1. Number of laboratories (lab.) reporting, number of assays, number of reported testing and results of the SARS-CoV-2 nucleic acid detection EQA.
Table 1. Number of laboratories (lab.) reporting, number of assays, number of reported testing and results of the SARS-CoV-2 nucleic acid detection EQA.
# SampleNo. of Lab. ReportingNo. of Different AssaysNo. of TestsClassificationInvalid (%)Negative (%)Weak Positive (%)Positive (%)
15657119Positive000100
25662119Negative010000
36165129Weak Positive000.899.2
46172136Negative20.679.400
56376140Weak Positive000.799.3
66678144Negative3.596.500
76991158Positive000100
87495166Negative010000
979121199Positive00.5099.5
1081120204Negative19900
1182122209Positive000100
1286115215Positive000100
Table 2. Number of laboratories reporting, number of assays, number of reported testing and results of the anti-SARS-CoV-2 antibody EQA.
Table 2. Number of laboratories reporting, number of assays, number of reported testing and results of the anti-SARS-CoV-2 antibody EQA.
# SampleTargetClassificationNo. of Lab ReportingNo. of Different AssaysNo. of TestingTotal Results
Negative (%)Doubt (%)Positive (%)
1IgGPositive66178101.298.8
IgMPositive30143330.33.066.7
IgAPositive22200100
Total IgPositive3043000100
2IgGNegative69188310000
IgMNegative33143610000
IgANegative22210000
Total IgNegative3153110000
3IgGPositive6919771.3098.7
IgMPositive38164030.02.567.5
IgAPositive11100100
Total IgPositive3253200100
4IgGNegative69197597.302.7
IgMNegative39164010000
IgANegative11110000
Total IgNegative3463410000
5IgGPositive69207598.71.30
IgMPositive43164316.3083.7
IgAPositive11110000
Total IgPositive3373410000
6IgGNegative69277710000
IgMNegative42154210000
IgA///////
Total IgNegative3183410000
7IgGPositive71278200100
IgMPositive40134136.62.461
IgA///////
Total IgPositive327372.7094.6
8IgGPositive72308400100
IgMPositive39134012.5087.5
IgA///////
Total immunoglobulinsPositive3163600100
9IgGPositive72298400100
IgMNegative38123994.905.1
IgA///////
Total IgPositive3263800100
10IgGPositive72308400100
IgMPositive3711382.62.694.7
IgA///////
Total IgPositive3574100100
11IgGPositive70338300100
IgMNegative37113852.62.644.7
IgA///////
Total IgPositive3574200100
12IgGPositive77328612.8087.2
IgMNegative34113813.2086.8
IgA///////
Total IgPositive3384050050
Table 3. Number of laboratories reporting, number of assays, number of reported testing and results of SARS-CoV-2 direct antigens detection EQA.
Table 3. Number of laboratories reporting, number of assays, number of reported testing and results of SARS-CoV-2 direct antigens detection EQA.
# SampleClassificationNo. of Lab ReportingNo. of Different AssaysNo. of TestingTotal Results
Negative (%)Doubt (%)Positive (%)Invalid (%)
1Positive93301252.40.097.60.0
2Negative942712498.40.00.01.6
3Weak Positive (borderline)953012332.54.163.40.0
4Negative973312699.20.80.00.0
5Positive91321210.80.099.20.0
6Positive96331222.50.097.50.0
7Weak Positive (borderline)943111924.49.264.71.7
8Negative9535121100.00.00.00.0
9Positive963312222.19.068.90.0
10Positive103341300.00.01000.0
11Weak Positive (borderline)1033313265.25.329.50.0
12Weak Positive (borderline)1033413030.83.865.40.0
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Pasotti, F.; Pellegrinelli, L.; Liga, G.; Rizzetto, M.; Azzarà, G.; Da Molin, S.; Lungu, O.L.; Greco, S.; Galli, C.; Bubba, L.; et al. First Results of an External Quality Assessment (EQA) Scheme for Molecular, Serological and Antigenic Diagnostic Test for SARS-CoV-2 Detection in Lombardy Region (Northern Italy), 2020–2022. Diagnostics 2022, 12, 1483. https://doi.org/10.3390/diagnostics12061483

AMA Style

Pasotti F, Pellegrinelli L, Liga G, Rizzetto M, Azzarà G, Da Molin S, Lungu OL, Greco S, Galli C, Bubba L, et al. First Results of an External Quality Assessment (EQA) Scheme for Molecular, Serological and Antigenic Diagnostic Test for SARS-CoV-2 Detection in Lombardy Region (Northern Italy), 2020–2022. Diagnostics. 2022; 12(6):1483. https://doi.org/10.3390/diagnostics12061483

Chicago/Turabian Style

Pasotti, Fabio, Laura Pellegrinelli, Giuseppa Liga, Manuela Rizzetto, Giovanna Azzarà, Simona Da Molin, Oana Livia Lungu, Silvia Greco, Cristina Galli, Laura Bubba, and et al. 2022. "First Results of an External Quality Assessment (EQA) Scheme for Molecular, Serological and Antigenic Diagnostic Test for SARS-CoV-2 Detection in Lombardy Region (Northern Italy), 2020–2022" Diagnostics 12, no. 6: 1483. https://doi.org/10.3390/diagnostics12061483

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop