VANT-GAN: adversarial learning for discrepancy-based visual attribution in medical imaging

Zia, Tehseen, Murtaza, Shakeeb ORCID: https://orcid.org/0000-0002-8066-6907, Bhatti, Nauman Bashir ORCID: https://orcid.org/0000-0003-0557-5244, Windridge, David ORCID: https://orcid.org/0000-0001-5507-8516 and Nisar, Zeeshan ORCID: https://orcid.org/0000-0001-6411-0207 (2022) VANT-GAN: adversarial learning for discrepancy-based visual attribution in medical imaging. Pattern Recognition Letters, 156 . pp. 112-118. ISSN 0167-8655 [Article] (doi:10.1016/j.patrec.2022.02.005)

Preview

PDF - Final accepted version (with author's formatting) Available under License Creative Commons Attribution-NonCommercial-NoDerivatives 4.0. Download (2MB) | Preview

Abstract

Visual attribution (VA) in relation to medical images is an essential aspect of modern automation-assisted diagnosis. Since it is generally not straightforward to obtain pixel-level ground-truth labelling of medical images, classification-based interpretation approaches have become the de facto standard for automated diagnosis, in which the ability of classifiers to make categorical predictions based on class-salient regions is harnessed within the learning algorithm. Such regions, however, typically constitute only a small subset of the full range of features of potential medical interest. They may hence not be useful for VA of medical images where capturing all of the disease evidence is a critical requirement. This hence motivates the proposal of a novel strategy for visual attribution that is not reliant on image classification. We instead obtain normal counterparts of abnormal images and find discrepancy maps between the two. To perform the abnormal-to-normal mapping in unsupervised way, we employ a Cycle-Consistency Generative Adversarial Network, thereby formulating visual attribution in terms of a discrepancy map that, when subtracted from the abnormal image, makes it indistinguishable from the counterpart normal image. Experiments are performed on three datasets including a synthetic, Alzheimer’s disease Neuro imaging Initiative and, BraTS dataset. We outperform baseline and related methods in both experiments.

Actions (login required)

View Item

Statistics

DownloadsShow export options

Export as CSVXMLJSON

Activity Overview

6 month trend

55Downloads

6 month trend

82Hits

Additional statistics are available via IRStats2.