Gate-SBNet: gate semantic boundary network for colorectal polyp segmentation

Jun Wang; Jihong Sun; Xiaoyin Xu; Min Zhang

doi:10.1117/12.2653779

7 April 2023 Gate-SBNet: gate semantic boundary network for colorectal polyp segmentation

Jun Wang, Jihong Sun, Xiaoyin Xu, Min Zhang

Proceedings Volume 12465, Medical Imaging 2023: Computer-Aided Diagnosis; 124651K (2023) https://doi.org/10.1117/12.2653779
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Abstract

Accurate polyp segmentation from colonoscopy is essential for the early detection of colorectal cancer. However, the variety of polyps manifested in images and the blurry boundary between a polyp and its surrounding mucosa make segmentation challenging. Hence, it is crucial to accurately identify regional boundaries of polyps in colonoscopy. In this paper, we propose Gated Semantic Boundary Network (Gate-SBNet), which is a novel twostream CNN architecture based on an encoder-decoder framework to segment polyps in colonoscopy images. One stream of Gate-SBNet uses a pre-trained ConvNeXt-B model from the image classification task as the semantic encoder to obtain multi-level semantic features from colonoscopy images. Another branch uses the Semantic Boundary Learning Module (SBLM) to learn boundary features based on multi-level semantic features, which process information in parallel with the semantic encoder. By introducing the Gate Convolution Layer (GCLs) into the SBLM module, the semantic information is converted more accurately to boundary information. Therefore, only boundary-related information will be processed by the SBLM. Then, we merge semantic and boundary features as input to an Unet model to obtain the final segmentation result. Our proposed approach was evaluated on five benchmark datasets: Kvasir, CVC-ClinicDB, CVC-ColonDB, CVC-300, and ETIS-LaribPolypDB. Experiments have demonstrated that it is an efficient architecture and capable of making accurate predictions about object boundaries and significantly improving the performance of finding thin and small objects.

Citation Download Citation

Jun Wang, Jihong Sun, Xiaoyin Xu, and Min Zhang "Gate-SBNet: gate semantic boundary network for colorectal polyp segmentation", Proc. SPIE 12465, Medical Imaging 2023: Computer-Aided Diagnosis, 124651K (7 April 2023); https://doi.org/10.1117/12.2653779

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Semantics

Polyps

Image segmentation

Convolution

Performance modeling

Data modeling

Colorectal cancer

Show All Keywords

Keywords/Phrases

Search In:

Publication Years