MetaCOVID: A Siamese neural network framework with contrastive loss for n-shot diagnosis of COVID-19 patients

https://doi.org/10.1016/j.patcog.2020.107700Get rights and content

Highlights

  • A Siamese neural network framework for COVID-19 diagnosis from CXR images.

  • Benefit of using contrastive loss and n-shot learning in design of the framework.

  • A fine-tuned pre-trained CNN encoder to capture unbiased feature representations.

  • The diagnosis problem is formulated as a k-way n-shot classification problem.

  • Experimental results with a limited dataset to show efficacy of the framework.

Abstract

Various AI functionalities such as pattern recognition and prediction can effectively be used to diagnose (recognize) and predict coronavirus disease 2019 (COVID-19) infections and propose timely response (remedial action) to minimize the spread and impact of the virus. Motivated by this, an AI system based on deep meta learning has been proposed in this research to accelerate analysis of chest X-ray (CXR) images in automatic detection of COVID-19 cases. We present a synergistic approach to integrate contrastive learning with a fine-tuned pre-trained ConvNet encoder to capture unbiased feature representations and leverage a Siamese network for final classification of COVID-19 cases. We validate the effectiveness of our proposed model using two publicly available datasets comprising images from normal, COVID-19 and other pneumonia infected categories. Our model achieves 95.6% accuracy and AUC of 0.97 in diagnosing COVID-19 from CXR images even with a limited number of training samples.

Keywords

COVID-19 diagnosis
Multi-shot learning
Contrastive loss
CXR images
Siamese network

Cited by (0)

Mohammad Shorfuzzaman is an Associate Professor in the Department of Computer Science, College of Computers and Information Technology (CCIT) at Taif University, Taif, Saudi Arabia. He is a member of BDAAG (Big Data Analytics and Applications) research group in CCIT. His-primary research interests include applied artificial intelligence in the areas of computer vision and natural language processing, big data, and cloud computing.

M. Shamim Hossain is a Professor at the Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia. He is also an adjunct professor at the School of Electrical Engineering and Computer Science, University of Ottawa, Canada. He received his Ph.D. in Electrical and Computer Engineering from the University of Ottawa, Canada. His-research interests include cloud networking, smart environment (smart city, smart health), AI, deep learning, edge computing, Internet of Things (IoT), multimedia for health care, and multimedia big data. He has authored and coauthored more than 300 publications including refereed journals, conference papers, books, and book chapters. Recently, he co-edited a book on “Connected Health in Smart Cities”, published by Springer. He has served as cochair, general chair, workshop chair, publication chair, and TPC for over 20 IEEE and ACM conferences and workshops. He is the chair of IEEE Special Interest Group on Artificial Intelligence (AI) for Health with IEEE ComSoc eHealth Technical Committee. Currently, he is the Co-Chair of the special session “AI- Enabled technologies for smart health monitoring", to be held with IEEE I2MTC 2021. He was the co-chair of the 3rd IEEE ICME Workshop on Multimedia Services and Tools for smart-health (MUST-SH 2020). He is a recipient of a number of awards, including the Best Conference Paper Award and the 2016 ACM Transactions on Multimedia Computing, Communications and Applications (TOMM) Nicolas D. Georganas Best Paper Award, and the 2019 King Saud University Scientific Excellence Award (Research Quality). He is on the editorial board of the IEEE Transactions on Multimedia, IEEE Multimedia, IEEE Network, IEEE Wireless Communications, IEEE Access, Journal of Network and Computer Applications (Elsevier), International Journal of Multimedia Tools and Applications (Springer), Human-centric Computing and Information Sciences (Springer), Games for Health Journal, and International Journal of Information Technology, Communications and Convergence (Inderscience). He also presently serves as a lead guest editor of IEEE Network, ACM Transactions on Internet Technology, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) and Multimedia systems Journal. Previously, he served as a guest editor of IEEE Communications Magazine, IEEE Network, IEEE Transactions on Information Technology in Biomedicine (currently JBHI), IEEE Transactions on Cloud Computing, International Journal of Multimedia Tools and Applications (Springer), Cluster Computing (Springer), Future Generation Computer Systems (Elsevier), Computers and Electrical Engineering (Elsevier), Sensors (MDPI), and International Journal of Distributed Sensor Networks. He is a senior member of both the IEEE, and ACM.

View Abstract