Multi-modal image classification of COVID-19 cases using computed tomography and X-rays scans

Nasir, Nida, Kansal, Afreen, Barneih, Feras, Al-Shaltone, Omar, Bonny, Talal, Al-Shabi, Mohammad and Al Shammaa, Ahmed (2023) Multi-modal image classification of COVID-19 cases using computed tomography and X-rays scans. Intelligent Systems with Applications, 17. ISSN 2667-3053

Text (Multi-modal image classification of COVID-19 cases using computed tomography and X-rays scans) - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (8MB)

Abstract

COVID pandemic across the world and the emergence of new variants have intensified the need to identify COVID-19 cases quickly and efficiently. In this paper, a novel dual-mode multi-modal approach is presented to detect a covid patient. This has been done using the combination of image of the chest X-ray/CT scan and the clinical notes provided with the scan. Data augmentation techniques are used to extrapolate the dataset. Five different types of image and text models have been employed, including transfer learning. The binary cross entropy loss function and the adam optimizer are used to compile all of these models. The multi-modal is also tried out with existing pre-trained models such as: VGG16, ResNet50, InceptionResNetV2 and MobileNetV2. The final multi-modal gives an accuracy of 97.8% on the testing data. The study provides a different approach to identifying COVID-19 cases using just the scan images and the corresponding notes.

Item Type:	Article
Official URL:	https://www.sciencedirect.com/journal/intelligent-...
Additional Information:	© 2022 The Author(s).
Divisions:	LSE
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science H Social Sciences > HV Social pathology. Social and public welfare. Criminology R Medicine > RA Public aspects of medicine > RA0421 Public health. Hygiene. Preventive Medicine
Date Deposited:	20 Jan 2023 10:45
Last Modified:	25 Apr 2024 19:42
URI:	http://eprints.lse.ac.uk/id/eprint/117958

Actions (login required)

View Item