- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Faculty Research and Publications /
- Biased Deep Learning Methods in Detection of COVID-19...
Open Collections
UBC Faculty Research and Publications
Biased Deep Learning Methods in Detection of COVID-19 Using CT Images: A Challenge Mounted by Subject-Wise-Split ISFCT Dataset Parsarad, Shiva; Saeedizadeh, Narges; Soufi, Ghazaleh Jamalipour; Shafieyoon, Shamim; Hekmatnia, Farzaneh; Zarei, Andrew Parviz; Soleimany, Samira; Yousefi, Amir; Nazari, Hengameh; Torabi, Pegah; Milani, Abbas S.; Madani Tonekaboni, Seyed Ali; Rabbani, Hossein; Hekmatnia, Ali; Kafieh, Rahele
Abstract
Accurate detection of respiratory system damage including COVID-19 is considered one of the crucial applications of deep learning (DL) models using CT images. However, the main shortcoming of the published works has been unreliable reported accuracy and the lack of repeatability with new datasets, mainly due to slice-wise splits of the data, creating dependency between training and test sets due to shared data across the sets. We introduce a new dataset of CT images (ISFCT Dataset) with labels indicating the subject-wise split to train and test our DL algorithms in an unbiased manner. We also use this dataset to validate the real performance of the published works in a subject-wise data split. Another key feature provides more specific labels (eight characteristic lung features) rather than being limited to COVID-19 and healthy labels. We show that the reported high accuracy of the existing models on current slice-wise splits is not repeatable for subject-wise splits, and distribution differences between data splits are demonstrated using t-distribution stochastic neighbor embedding. We indicate that, by examining subject-wise data splitting, less complicated models show competitive results compared to the exiting complicated models, demonstrating that complex models do not necessarily generate accurate and repeatable results.
Item Metadata
| Title |
Biased Deep Learning Methods in Detection of COVID-19 Using CT Images: A Challenge Mounted by Subject-Wise-Split ISFCT Dataset
|
| Creator | |
| Publisher |
Multidisciplinary Digital Publishing Institute
|
| Date Issued |
2023-08-08
|
| Description |
Accurate detection of respiratory system damage including COVID-19 is considered one of the crucial applications of deep learning (DL) models using CT images. However, the main shortcoming of the published works has been unreliable reported accuracy and the lack of repeatability with new datasets, mainly due to slice-wise splits of the data, creating dependency between training and test sets due to shared data across the sets. We introduce a new dataset of CT images (ISFCT Dataset) with labels indicating the subject-wise split to train and test our DL algorithms in an unbiased manner. We also use this dataset to validate the real performance of the published works in a subject-wise data split. Another key feature provides more specific labels (eight characteristic lung features) rather than being limited to COVID-19 and healthy labels. We show that the reported high accuracy of the existing models on current slice-wise splits is not repeatable for subject-wise splits, and distribution differences between data splits are demonstrated using t-distribution stochastic neighbor embedding. We indicate that, by examining subject-wise data splitting, less complicated models show competitive results compared to the exiting complicated models, demonstrating that complex models do not necessarily generate accurate and repeatable results.
|
| Subject | |
| Genre | |
| Type | |
| Language |
eng
|
| Date Available |
2023-10-06
|
| Provider |
Vancouver : University of British Columbia Library
|
| Rights |
CC BY 4.0
|
| DOI |
10.14288/1.0437079
|
| URI | |
| Affiliation | |
| Citation |
Journal of Imaging 9 (8): 159 (2023)
|
| Publisher DOI |
10.3390/jimaging9080159
|
| Peer Review Status |
Reviewed
|
| Scholarly Level |
Faculty; Researcher
|
| Rights URI | |
| Aggregated Source Repository |
DSpace
|
Item Media
Item Citations and Data
Rights
CC BY 4.0