COVID-VIT: classification of Covid-19 from 3D CT chest images based on vision transformer model

Gao, Xiaohong W. ORCID logoORCID: https://orcid.org/0000-0002-8103-6624, Khan, Maleika Heenaye-Mamode, Hui, Rui, Tian, Zhengmeng, Qian, Yu, Gao, Alice and Baichoo, Sunilduth (2022) COVID-VIT: classification of Covid-19 from 3D CT chest images based on vision transformer model. 2022 3rd International Conference on Next Generation Computing Applications (NextComp). In: 3rd International Conference on Next Generation Computing Applications (NextComp), 06-08 Oct 2022, Mauritius. e-ISBN 9781665469548, e-ISBN 9781665469531, pbk-ISBN 9781665469555. [Conference or Workshop Item] (doi:10.1109/NextComp55567.2022.9932246)

[img] PDF - Final accepted version (with author's formatting)
Restricted to Repository staff and depositor only

Download (432kB)

Abstract

This paper presents an explainable deep learning network to classify COVID from non-COVID based on 3D CT lung images. It applies a subset of the data for MIA-COV19 challenge through the development of 3D form of Vision Transformer deep learning architecture. The data comprise 1924 subjects with 851 being diagnosed with COVID, among them 1,552 being selected for training and 372 for testing. While most of the data volume are in axial view, there are a number of subjects’ data are in coronal or sagittal views with 1 or 2 slices are in axial view. Hence, while 3D data based classification is investigated, in this competition, 2D axial-view images remains the main focus. Two deep learning methods are studied, which are vision transformer (ViT) based on attention models and DenseNet that is built upon conventional convolutional neural network (CNN). Initial evaluation results indicates that ViT performs better than DenseNet with F1 scores being 0.81 and 0.72 respectively. (Codes are available at GitHub at https://github.com/xiaohong1/COVID-ViT). This paper illustrates that vision transformer performs the best in comparison to the other current state of the art approaches in classification of COVID from CT lung images.

Item Type: Conference or Workshop Item (Paper)
Sustainable Development Goals:
Theme:
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 36334
Useful Links:
Depositing User: Xiaohong Gao
Date Deposited: 30 Sep 2022 12:52
Last Modified: 09 Dec 2022 04:38
URI: https://eprints.mdx.ac.uk/id/eprint/36334

Actions (login required)

View Item View Item

Statistics

Activity Overview
6 month trend
0Downloads
6 month trend
0Hits

Additional statistics are available via IRStats2.