收藏切换
Polyp detection network with multilevel and multiscale feature fusion enhancement based on Mamba architecture
收藏切换
Keli Hu1, 2, 3, Jie Huang1, Kangxin Fan1, Chen Wang1, *, Hancan Zhu2, Liping Zhao1, Haowei Ren2, Jianhao Hu2
Journal of Image and Graphics | 2026, 31(8) : 3060 - 3074
Less
收藏切换
Journal of Image and Graphics | 2026, 31(8): 3060-3074
• Medical Image Processing •
Polyp detection network with multilevel and multiscale feature fusion enhancement based on Mamba architecture
Full
Keli Hu1, 2, 3, Jie Huang1, Kangxin Fan1, Chen Wang1, *, Hancan Zhu2, Liping Zhao1, Haowei Ren2, Jianhao Hu2
Affiliations
  • 1 School of Intelligent Engineering,Shaoxing University,Shaoxing 312000,China
  • 2 Affiliated Hospital of Shaoxing University, Shaoxing 312000,China
  • 3 Information Technology R&D Innovation Center of Peking University,Shaoxing 312000,China
Published: 2026-08-16 doi: 10.11834/jig.250492
Outline
收藏切换
Objective

Accurate segmentation of colorectal polyps in colonoscopy images is essential for the early diagnosis and prevention of colorectal cancer. However,colonoscopy images often exhibit blurred boundaries,irregular shapes,and large-scale variations,making automated segmentation highly challenging. Conventional convolutional neural network (CNN)-based methods struggle to capture long-range dependencies,often leading to inaccurate boundary localization and missed detection of small lesions. Although Transformer-based models improve global context modeling,they present quadratic computational complexity and high memory consumption when processing high-resolution medical images. The Mamba architecture,built upon selective state space models,has recently shown strong potential for efficient sequence modeling with linear computational complexity. Despite its advantages,directly applying Mamba-based models to polyp segmentation remains challenging due to its limited capability to extract local features and insufficient multiscale feature interaction. Aiming to address these issues,this paper proposes a multilevel and multiscale feature fusion enhanced network based on the Mamba architecture (MMF-MambaNet),which intends to improve segmentation accuracy while maintaining computational efficiency.

Method

MMF-MambaNet adopts an encoder-decoder architecture and employs the visual state space model,a variant of Mamba,as the backbone to efficiently capture long-range contextual dependencies. Aiming to enhance feature diversity and robustness,a local sequence-wise style transformation augmentation module is integrated into the backbone. This module performs stochastic re-parameterization by perturbing the mean and variance of feature distributions,thereby improving model generalization under varying imaging conditions. Three specialized modules are also incorporated to strengthen multi-scale representation and boundary perception. First,a cross-scale aware self-attention (CASA) module is introduced to facilitate hierarchical feature interaction by using deep semantic features to refine shallow features. By combining channel and spatial attention mechanisms,CASA effectively fuses multilevel features while preserving fine boundary details. Second,an adaptive detail enhancing module (ADEM) is designed to improve structural representation across different scales. Using an anchor-scale fusion strategy,this module adaptively integrates information from different scales to construct highly comprehensive detail representations of polyps,thereby enhancing boundary structures and improving the segmentation of small lesions. Third,an adaptive global-local integration (AGLI) gating module is introduced in the decoder stage. This lightweight mechanism adaptively combines global semantic features with local detailed features from skip connections,enabling the model to emphasize reliable regions while suppressing background interference. Furthermore,MMF-MambaNet introduces a reverse feature fusion pathway that progressively combines deep semantic features with shallow spatial information through upsampling and feature aggregation. A pyramid pooling module is also employed to capture multiscale global contextual information,thereby improving semantic consistency in the segmentation results. The model is optimized using a hybrid binary cross-entropy and dice loss,which balances pixel-level classification accuracy with region-level overlap while alleviating class imbalance in medical image segmentation.

Result

Extensive experiments were conducted on five publicly available colorectal polyp segmentation datasets: CVC-300,CVC-ClinicDB,Kvasir-SEG,CVC-ColonDB,and ETIS-LaribPolypDB. The proposed MMF-MambaNet was compared with eight state-of-the-art segmentation methods,including PraNet,VM-UNetV2,and Polyp-Mamba. Experimental results demonstrate that MMF-MambaNet achieves competitive and stable performance across multiple datasets. Compared with the VM-UNet baseline,MMF-MambaNet improves the mean Dice coefficient (mDice) by 1.1%,5.0%,4.2%,9.1%,and 2.6% on the CVC-300,CVC-ClinicDB,Kvasir-SEG,CVC-ColonDB,and ETIS-LaribPolypDB datasets,respectively. On the challenging CVC-ColonDB dataset,the proposed model further outperforms VM-UNetV2,achieving improvements of 4.6% in mDice and 6.2% in mean intersection over union (mIoU). Visual comparisons show that MMF-MambaNet can accurately delineate polyp boundaries even under challenging cases,such as low contrast,irregular shapes,and small lesion sizes. In addition to segmentation accuracy,the model also demonstrates favorable computational efficiency. With 18.84 M parameters and 5.74 GFLOPs,MMF-MambaNet maintains a relatively lightweight architecture while achieving an inference speed of 57.58 frames per second. Ablation studies further confirm the effectiveness of the proposed modules,revealing that CASA,ADEM,and AGLI each contribute to enhanced segmentation accuracy and improved boundary preservation.

Conclusion

This study presents MMF-MambaNet,a Mamba-based network that integrates multilevel and multiscale feature fusion mechanisms designed for colorectal polyp segmentation. By combining efficient sequence modeling with adaptive feature interaction strategies,the proposed method effectively addresses the challenges such as blurred boundaries and scale variations in colonoscopy images. Experimental results demonstrate that MMF-MambaNet exhibits strong segmentation performance while maintaining lightweight computational complexity,making it a promising approach for computer-aided colonoscopy diagnosis and assisting the early detection of colorectal cancer.

Mamba  /  multi-scale  /  multi-level  /  polyp detection  /  deep learning
胡珂立, 黄杰, 范康鑫, 王臣, 祝汉灿, 赵利平, 任浩炜, 胡剑浩. Mamba架构下多级多尺度特征融合增强的息肉检测网络. 中国图象图形学报, 2026 , 31 (8) : 3060 -3074 . DOI: 10.11834/jig.250492
Keli Hu, Jie Huang, Kangxin Fan, Chen Wang, Hancan Zhu, Liping Zhao, Haowei Ren, Jianhao Hu. Polyp detection network with multilevel and multiscale feature fusion enhancement based on Mamba architecture[J]. Journal of Image and Graphics, 2026 , 31 (8) : 3060 -3074 . DOI: 10.11834/jig.250492
  • Natural Science Foundation of Zhejiang Province,China (LZ24F020006); Humanities and Social Sciences Youth Foundation of Ministry of Education of China (25YJCZH082); National Natural Science Foundation of China (62271321,61603258)
Year 2026 volume 31 Issue 8
28
14
Cite this Article
BibTeX
Article Info
doi: 10.11834/jig.250492
  • Receive Date:2025-10-15
  • Online Date:2026-10-30
  • Published:2026-08-16
Article Data
Affiliations
History
  • Received:2025-10-15
  • Revised:2026-03-18
Funding
Natural Science Foundation of Zhejiang Province,China (LZ24F020006); Humanities and Social Sciences Youth Foundation of Ministry of Education of China (25YJCZH082); National Natural Science Foundation of China (62271321,61603258)
Affiliations
    1 School of Intelligent Engineering,Shaoxing University,Shaoxing 312000,China
    2 Affiliated Hospital of Shaoxing University, Shaoxing 312000,China
    3 Information Technology R&D Innovation Center of Peking University,Shaoxing 312000,China
References
Share
https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.250492
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT