An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy

Ali, Sharib, Zhou, Felix, Braden, Barbara, Bailey, Adam, Yang, Suhui, Cheng, Guanju, Zhang, Pengyi, Li, Xiaoqiong, Kayser, Maxime, Soberanis-Mukul, Roger D., Albarqouni, Shadi, Wang, Xiaokang, Wang, Chunqing, Watanabe, Seiryo, Oksuz, Ilkay, Ning, Qingtian, Yang, Shufan, Khan, Mohammad Azam, Gao, Xiaohong W. ORCID logoORCID:, Realdon, Stefano, Loshchenov, Maxim, Schnabel, Julia A., East, James E., Wagnieres, Georges, Loschenov, Victor B., Grisan, Enrico, Daul, Christian, Blondel, Walter and Rittscher, Jens (2020) An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy. Scientific Reports, 10 (1) , 2748. pp. 1-15. ISSN 2045-2322 [Article] (doi:10.1038/s41598-020-59413-5)

PDF - Published version (with publisher's formatting)
Available under License Creative Commons Attribution 4.0.

Download (2MB) | Preview


We present a comprehensive analysis of the submissions to the first edition of the Endoscopy Artefact Detection challenge (EAD). Using crowd-sourcing, this initiative is a step towards understanding the limitations of existing state-of-the-art computer vision methods applied to endoscopy and promoting the development of new approaches suitable for clinical translation. Endoscopy is a routine imaging technique for the detection, diagnosis and treatment of diseases in hollow-organs; the esophagus, stomach, colon, uterus and the bladder. However the nature of these organs prevent imaged tissues to be free of imaging artefacts such as bubbles, pixel saturation, organ specularity and debris, all of which pose substantial challenges for any quantitative analysis. Consequently, the potential for improved clinical outcomes through quantitative assessment of abnormal mucosal surface observed in endoscopy videos is presently not realized accurately. The EAD challenge promotes awareness of and addresses this key bottleneck problem by investigating methods that can accurately classify, localize and segment artefacts in endoscopy frames as critical prerequisite tasks. Using a diverse curated multi-institutional, multi-modality, multi-organ dataset of video frames, the accuracy and performance of 23 algorithms were objectively ranked for artefact detection and segmentation. The ability of methods to generalize to unseen datasets was also evaluated. The best performing methods (top 15%) propose deep learning strategies to reconcile variabilities in artefact appearance with respect to size, modality, occurrence and organ type. However, no single method outperformed across all tasks. Detailed analyses reveal the shortcomings of current training strategies and highlight the need for developing new optimal metrics to accurately quantify the clinical applicability of methods.

Item Type: Article
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 31034
Notes on copyright: © The Author(s) 2020
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit
Useful Links:
Depositing User: Xiaohong Gao
Date Deposited: 25 Sep 2020 17:10
Last Modified: 09 Feb 2022 10:38

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.