Skip to main content

Advertisement

Springer Nature Link
Log in

A deep ensemble learning framework for COVID-19 detection in chest X-ray images

  • Original Article
  • Published:
Network Modeling Analysis in Health Informatics and Bioinformatics Aims and scope Submit manuscript

Abstract

The rapid outbreak of COVID-19 has proven to be a dangerous virus with catastrophic effects on large populations and health systems worldwide. Therefore, in order to limit the rapid spread of this virus, artificial intelligence (AI) combined with radiological images such as chest X-rays (CXRs) has recently become a worthwhile option for screening COVID-19 patients, especially in the early stages. We suggest a solution to address the given problem by using a stacked ensemble model. This model combines the predictions of multiple individual models, resulting in improved accuracy compared to using each model separately. Fourteen well-known network architectures (VGG, DenseNet, InceptionResNetV2, ResNetV2 (50, 101, 152), InceptionV3, NasNetMobile, Xception and MobileNet) were trained and evaluated using two forms of transfer learning (TL) strategies, namely feature extraction and fine-tuning. We build network architectures by replacing the original ImageNet classifier with our classifier head, consisting of dense, batch normalization, dropout, and a softmax layer. The experiments conducted indicate that fine-tuning the higher layers of pre-trained architectures can provide more detailed and informative features compared to using "off-the-shelf" features, ultimately resulting in improved classification performance. To boost the classification performance, we utilized a stack ensemble technique that involved combining the prediction scores of the four top performing fine-tuned models: VGG19, DenseNet169, MobileNet, and DenseNet201. By employing this technique, we were able to obtain a robust ensemble model that significantly improved the performance. For model interpretability, feature maps and Grad-CAM analysis are performed to visualize the feature learning procedures that are significant for prediction. For experiments, the research work analyzed two CXR datasets that are very common for detecting COVID-19. The ensemble architecture yielded the highest classification accuracy of 99.03% for the 3-class classification and 99.02% for the 4-class classification. The experimental analysis revealed that the proposed ensemble architecture outperforms existing methods in classifying COVID-19 patients, offering greater accuracy and potential for assisting radiologists with improved screening efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The data that support the findings of this study are available from the first author upon reasonable request.

References

  • Addo D et al (2022) EVAE-Net: an ensemble variational autoencoder deep learning network for COVID-19 classification based on chest X-ray images. Diagnostics 12(11):2569

    Article  Google Scholar 

  • Alshazly H, Linse C, Barth E, Martinetz T (2019) Ensembles of deep learning models and transfer learning for ear recognition. Sensors 19(19):4139

    Article  Google Scholar 

  • Asif S, Wenhui Y, Jin H, Jinhai S (2020) Classification of COVID-19 from chest X-ray images using deep convolutional neural network. In: 2020 IEEE 6th International Conference on computer and communications (ICCC), 2020: IEEE, pp 426–433

  • Asif S, Yi W, Ain QU, Hou J, Yi T, Si J (2022a) Improving effectiveness of different deep transfer learning-based models for detecting brain tumors from MR images. IEEE Access 10:34716–34730

    Article  Google Scholar 

  • Asif S, Zhao M, Tang F, Zhu Y (2022b) A deep learning-based framework for detecting COVID-19 patients using chest X-rays. Multimed Syst 28:1–19

    Article  Google Scholar 

  • Aslan MF, Unlersen MF, Sabanci K, Durdu A (2021) CNN-based transfer learning–BiLSTM network: a novel approach for COVID-19 infection detection. Appl Soft Comput 98:106912

    Article  Google Scholar 

  • Bernheim A et al (2020) Chest CT findings in coronavirus disease-19 (COVID-19): relationship to duration of infection. Radiol 295(3):685–691

  • Botros N, Iyer P, Ojcius DM (2020) Is there an association between oral health and severity of COVID-19 complications? Biomed J 43(4):325–327

    Article  Google Scholar 

  • Chattopadhay A, Sarkar A, Howlader, P Balasubramanian VN (2018) Grad-cam++: generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE Winter Conference on applications of computer vision (WACV), 2018: IEEE, pp 839–847

  • Chen N et al (2020) Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. The Lancet 395(10223):507–513

    Article  Google Scholar 

  • Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, 2017, pp 1251–1258

  • Chowdhury ME et al (2020) Can AI help in screening viral and COVID-19 pneumonia? IEEE Access 8:132665–132676

    Article  Google Scholar 

  • Corman VM et al (2020) Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance 25(3):2000045

    Article  Google Scholar 

  • Dey S, Bhattacharya R, Malakar S, Schwenker F, Sarkar R (2022) CovidConvLSTM: a fuzzy ensemble model for COVID-19 detection from chest X-rays. Expert Syst Appl 206:17812

  • Dietterich TG (1998) Approximate statistical tests for comparing supervised classification learning algorithms. Neural Comput 10(7):1895–1923

    Article  Google Scholar 

  • García-Basteiro AL et al (2020) Monitoring the COVID-19 epidemic in the context of widespread local transmission. Lancet Respir Med 8(5):440–442

    Article  Google Scholar 

  • Gayathri J, Abraham B, Sujarani M, Nair MS (2022) A computer-aided diagnosis system for the classification of COVID-19 and non-COVID-19 pneumonia on chest X-ray images by integrating CNN with sparse autoencoder and feed forward neural network. Comput Biol Med 141:105134

    Article  Google Scholar 

  • Gour M, Jain S (2020) Stacked convolutional neural network for diagnosis of covid-19 disease from x-ray images. arXiv preprint arXiv:2006.13817

  • Goyal S, Singh R (2021) Detection and classification of lung diseases for pneumonia and Covid-19 using machine and deep learning techniques. J Ambient Intell Humaniz Comput 14:1–21

    Google Scholar 

  • Gozes O et al (2020) Rapid ai development cycle for the coronavirus (covid-19) pandemic: Initial results for automated detection & patient monitoring using deep learning ct image analysis. arXiv preprint arXiv:2003.05037

  • Halpin DM, Faner R, Sibila O, Badia JR, Agusti A (2020) Do chronic respiratory diseases or their treatment affect the risk of SARS-CoV-2 infection? Lancet Respir Med 8(5):436–438

    Article  Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, 2016, pp 770–778

  • Howard AG et al (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861

  • Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, 2017, pp 4700–4708

  • Hussain E, Hasan M, Rahman MA, Lee I, Tamanna T, Parvez MZ (2021) CoroDet: A deep learning based classification for COVID-19 detection using chest X-ray images. Chaos Solitons Fractals 142:110495

    Article  MathSciNet  Google Scholar 

  • Islam MZ, Islam MM, Asraf A (2020) A combined deep CNN-LSTM network for the detection of novel coronavirus (COVID-19) using X-ray images. Inform Med Unlock 20:100412

    Article  Google Scholar 

  • Ismael AM, Şengür A (2021) Deep learning approaches for COVID-19 detection based on chest X-ray images. Expert Syst Appl 164:114054

    Article  Google Scholar 

  • Kanne JP, Little BP, Chung JH, Elicker BM, Ketai LH (2020) Essentials for radiologists on COVID-19: an update—radiology scientific expert panel. Radiol 296(2): E113–E114

  • Kedia P, Katarya R (2021) CoVNet-19: a deep learning model for the detection and analysis of COVID-19 patients. Appl Soft Comput 104:107184

    Article  Google Scholar 

  • Kermany DS et al (2018) Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5):1122-1131.e9

    Article  Google Scholar 

  • Khan AI, Shah JL, Bhat MM (2020) CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images. Comput Methods Programs Biomed 196:105581

    Article  Google Scholar 

  • Kumar A, Kim J, Lyndon D, Fulham M, Feng D (2016) An ensemble of fine-tuned convolutional neural networks for medical image classification. IEEE J Biomed Health Inform 21(1):31–40

    Article  Google Scholar 

  • Long C et al (2020) Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT? Eur J Radiol 126:108961

    Article  Google Scholar 

  • Marefat A, Marefat M, Joloudari JH, Nematollahi MA, Lashgari R (2022) CCTCOVID: COVID-19 detection from chest X-ray images using compact convolutional transformers. arXiv preprint arXiv:2209.13399

  • Ozturk T, Talo M, Yildirim EA, Baloglu UB, Yildirim O, Acharya UR (2020) Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput Biol Med 121:103792

    Article  Google Scholar 

  • Pan F et al (2020) Time course of lung changes on chest CT during recovery from 2019 novel coronavirus (COVID-19) pneumonia. Radiology 295:715–721

    Article  Google Scholar 

  • Panwar H, Gupta P, Siddiqui MK, Morales-Menendez R, Singh V (2020) Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet. Chaos, Solitons Fractals 138:109944

    Article  MathSciNet  Google Scholar 

  • Paul HY, Kim TK, Lin CT (2020) Generalizability of deep learning tuberculosis classifier to COVID-19 chest radiographs: new tricks for an old algorithm? J Thorac Imaging 35(4):W102–W104

    Article  Google Scholar 

  • Rahman T et al (2020) Reliable tuberculosis detection using chest X-ray with deep learning, segmentation and visualization. IEEE Access 8:191586–191601

    Article  Google Scholar 

  • Selvaraju RR, Das A, Vedantam R, Cogswell M, Parikh D, Batra D (2016) Grad-CAM: Why did you say that? arXiv preprint arXiv:1611.07450

  • Sethy PK, Behera SK (2020) Detection of coronavirus disease (covid-19) based on deep features. https://doi.org/10.20944/preprints202003.0300

  • Shastri S, Kansal I, Kumar S, Singh K, Popli R, Mansotra V (2022) CheXImageNet: a novel architecture for accurate classification of Covid-19 with chest x-ray digital images using deep convolutional neural networks. Heal Technol 12(1):193–204

    Article  Google Scholar 

  • Shin H-C et al (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298

    Article  Google Scholar 

  • Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  • Singh RK, Pandey R, Babu RN (2021) COVIDScreen: explainable deep learning framework for differential diagnosis of COVID-19 using chest X-rays. Neural Comput Appl 33:8871–8892

    Article  Google Scholar 

  • Singh S, Kumar M, Kumar A, Verma BK, Abhishek K, Selvarajan S (2024) Efficient pneumonia detection using Vision Transformers on chest X-rays. Sci Rep 14(1):2487

    Article  Google Scholar 

  • Song Y et al (2021) Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images. IEEE/ACM Trans Comput Biol Bioinf 18(6):2775–2780

    Article  Google Scholar 

  • Srivastava G, Pradhan N, Saini Y (2022a) Ensemble of Deep Neural Networks based on Condorcet’s Jury Theorem for screening Covid-19 and Pneumonia from radiograph images. Comput Biol Med 149:105979

    Article  Google Scholar 

  • Srivastava G, Chauhan A, Jangid M, Chaurasia S (2022b) CoviXNet: a novel and efficient deep learning model for detection of COVID-19 using chest X-Ray images. Biomed Signal Process Control 78:103848

  • Sverzellati N, Ryerson C, Milanese G, Renzoni E, Volpi A, Spagnolo P (2021) Chest x-ray or CT for COVID-19 pneumonia? Comparative study in a simulated triage setting. Eur Respir J 2004188:13993003.04188–2020

    Google Scholar 

  • Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, 2015, pp 1–9.

  • Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI Conference on artificial intelligence, 2017

  • Toraman S, Alakus TB, Turkoglu I (2020) Convolutional capsnet: A novel artificial neural network approach to detect COVID-19 disease from X-ray images using capsule networks. Chaos Solitons Fractals 140:110122

    Article  MathSciNet  Google Scholar 

  • Ucar F, Korkmaz D (2020) COVIDiagnosis-Net: Deep Bayes-SqueezeNet based diagnosis of the coronavirus disease 2019 (COVID-19) from X-ray images. Med Hypotheses 140:109761

    Article  Google Scholar 

  • Vellido A (2020) The importance of interpretability and visualization in machine learning for applications in medicine and health care. Neural Comput Appl 32(24):18069–18083

    Article  Google Scholar 

  • Wang L, Lin ZQ, Wong A (2020) Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images. Sci Rep 10(1):1–12

    Google Scholar 

  • Wang T et al (2023) PneuNet: deep learning for COVID-19 pneumonia diagnosis on chest X-ray image analysis using Vision Transformer. Med Biol Eng Comput 61:1–14

    Article  Google Scholar 

  • Wolpert DH (1992) Stacked generalization. Neural Netw 5(2):241–259

    Article  Google Scholar 

  • Xiao Z et al (2024) Deep contrastive representation learning with self-distillation. IEEE Trans Emerg Top Comput Intell 8(1):3–15. https://doi.org/10.1109/TETCI.2023.3304948

  • Xie X, Zhong Z, Zhao W, Zheng C, Wang F, Liu J (2020) Chest CT for typical coronavirus disease 2019 (COVID-19) pneumonia: relationship to negative RT-PCR testing. Radiology 296:E41–E45

    Article  Google Scholar 

  • Xing H, Xiao Z, Zhan D, Luo S, Dai P, Li K (2022a) SelfMatch: Robust semisupervised time-series classification with self-distillation. Int J Intell Syst 37(11):8583–8610

    Article  Google Scholar 

  • Xing H, Xiao Z, Qu R, Zhu Z, Zhao B (2022b) An efficient federated distillation learning system for multitask time series classification. IEEE Trans Instrum Meas 71:1–12

    Google Scholar 

  • Zhang Y-D, Zhang Z, Zhang X, Wang S-H (2021) MIDCAN: A multiple input deep convolutional attention network for Covid-19 diagnosis based on chest CT and chest X-ray. Pattern Recogn Lett 150:8–16

    Article  Google Scholar 

  • Zhao X, Liu L, Qi S, Teng Y, Li J, Qian W (2018) Agile convolutional neural network for pulmonary nodule classification using CT images. Int J Comput Assist Radiol Surg 13(4):585–595

    Article  Google Scholar 

  • Zhuang F et al (2020) A comprehensive survey on transfer learning. Proc IEEE 109(1):43–76

    Article  Google Scholar 

  • Zoph B, Vasudevan V, Shlens J, Le QV (2018) Learning transferable architectures for scalable image recognition. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, 2018, pp 8697–8710

  • Zou L, Zheng J, Miao C, Mckeown MJ, Wang ZJ (2017) 3D CNN based automatic diagnosis of attention deficit hyperactivity disorder using functional and structural MRI. Ieee Access 5:23626–23636

    Article  Google Scholar 

  • Zu ZY et al (2020) Coronavirus disease 2019 (COVID-19): a perspective from China. Radiol 296(2):E15–E25

Download references

Acknowledgements

The authors are thankful to the Deanship of Postgraduate Studies and Scientific Research at University of Bisha for supporting this work through the Fast-Track Research Support Program.

Funding

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Central South University, Changsha, Hunan, China

    Sohaib Asif, Omair Bilal & Raeed Al-Sabri

  2. School of Public Health, Central South University, Changsha, Hunan, China

    Qurrat-ul-Ain

  3. School of Minerals Processing and Bioengineering, Central South University, Changsha, Hunan, China

    Muhammad Awais

  4. School of Automation, Central South University, Changsha, Hunan, China

    Kamran Amjad

  5. Department of Computer Science, University of Bisha, Bisha, Saudi Arabia

    Monir Abdullah

Authors
  1. Sohaib Asif
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Qurrat-ul-Ain
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Muhammad Awais
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Kamran Amjad
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Omair Bilal
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Raeed Al-Sabri
    View author publications

    You can also search for this author inPubMed Google Scholar

  7. Monir Abdullah
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Sohaib Asif.

Ethics declarations

Conflicts of interest

The authors declare no conflict of interest.

Compliance with ethical standards

None.

Informed consent

None.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Asif, S., Qurrat-ul-Ain, Awais, M. et al. A deep ensemble learning framework for COVID-19 detection in chest X-ray images. Netw Model Anal Health Inform Bioinforma 13, 30 (2024). https://doi.org/10.1007/s13721-024-00466-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13721-024-00466-1

Keywords