收藏切换
E-SegNet: E-Shaped Structure Networks for Accurate 2D and 3D Medical Image Segmentation
收藏切换
PDF
Wei Wu1, Xin Yang1, Chenggui Yao2, Ou Liu3, Qi Zhao1, *, Jianwei Shuai3, *
Research. Vol 8 Article ID 0869
Less
收藏切换
Research. Vol 8 Article ID 0869
• Research Article •
E-SegNet: E-Shaped Structure Networks for Accurate 2D and 3D Medical Image Segmentation
Full
Wei Wu1, Xin Yang1, Chenggui Yao2, Ou Liu3, Qi Zhao1, *, Jianwei Shuai3, *
Affiliations
  • 1School of Computer Science and Software Engineering, University of Science and Technology Liaoning, Anshan 114051, China.
  • 2College of Data Science, Jiaxing University, Jiaxing 314000, China.
  • 3Oujiang Laboratory (Zhejiang Lab for Regenerative Medicine, Vision and Brain Health), Wenzhou Institute, University of Chinese Academy of Sciences, Wenzhou 325001, China.
Published: 2025-09-20 doi: 10.34133/research.0869
Outline
收藏切换

U-structure has become a foundational approach in medical image segmentation, consistently demonstrating strong performance across various segmentation tasks. Most current models are based on this framework, customizing encoder–decoder components to achieve higher accuracy across various segmentation challenges. However, this often comes at the cost of increased parameter counts, which inevitably limit their practicality in real-world applications. In this study, we provide an E-shaped segmentation framework that discards the traditional step-by-step resolution recovery decoding process, instead directly aggregating multi-scale features extracted by the encoder at each stage for deep cross-level integration. Additionally, we propose an innovative multi-scale large-kernel convolution (MLKConv) module, designed to enhance high-level feature representation by effectively capturing both local and global contextual information. Compared to U-structure, the proposed E-structured approach substantially reduces parameters while delivering superior performance, especially in complex segmentation tasks. Based on this structure, we develop 2 segmentation networks specifically for 2-dimensional (2D) and 3D medical images. 2D E-SegNet is evaluated on four 2D segmentation benchmark datasets (Synapse multi-organ, ACDC, Kvasir-Seg, and BUSI), while 3D E-SegNet is assessed on four 3D segmentation benchmark datasets (Synapse, ACDC, NIH Pancreas, and Lung). Experimental results demonstrate that our approach outperforms the current leading U-shaped models across multiple datasets, achieving new state-of-the-art (SOTA) performance with fewer parameters. In summary, our research introduces a novel approach to medical image segmentation, offering potential improvements and contributing to ongoing advancements in the field. Our code is publicly available on https://github.com/zhaoqi106/E-SegNet.

Wei Wu, Xin Yang, Chenggui Yao, Ou Liu, Qi Zhao, Jianwei Shuai. E-SegNet: E-Shaped Structure Networks for Accurate 2D and 3D Medical Image Segmentation[J]. Research, 2025 , 8 (9) : 0869 - . DOI: 10.34133/research.0869
Image segmentation plays a crucial role in medical image processing and analysis, effectively assisting healthcare professionals in diagnosis. It significantly reduces the learning curve and time investment for medical personnel, providing faster and more precise diagnostic tools that accelerate workflows and enhance the efficiency and accuracy of clinical work. Traditional medical image segmentation relies on mathematical methods such as edge detection, thresholding, and machine learning [1], but these often fall short for complex medical images with diverse types and blurred boundaries. In recent years, deep learning approaches have gained popularity and have been widely applied in various fields of bioinformatics. These applications include prediction of miRNA–lncRNA interactions [2–4], computational toxicology [5–7], metabolite–disease association prediction [8,9], remote health monitoring [10–13], proteomics identification [14], and histopathological image analysis [15–17]. Because of the rapid advancements in deep learning, its performance in medical image segmentation has now far surpassed traditional methods. However, current segmentation algorithms often rely on stacking additional modules to enhance accuracy, leading to model expansion that is challenging to deploy in resource-constrained environments. Consequently, developing a versatile, lightweight, and precise segmentation algorithm has been a driving force in our research.
Since the advent of convolutional neural networks (CNNs) in 2010, they have dominated the field of computer vision. The convolution-based U-Net [18], with its encoder–decoder structure and skip connection technique, has demonstrated considerable advantages in semantic segmentation tasks. Influenced by U-Net, models such as U-Net++ [19], ResUnet [20], Attention U-Net [21], CE-Net [22], Unet3+ [23], and Kiu-Net [24] adopted similar U-structures, leading to significant progress in various medical segmentation tasks and further validating this architecture’s effectiveness. With the rise of Vision Transformer (ViT) [25] in 2020, it has gained widespread recognition in medical image segmentation due to its larger receptive field and powerful modeling capabilities. Following this trend, SwinUnet [26] and AgileFormer [27] leveraged various ViT adaptations, using an inverted encoder structure to construct decoders and forming purely ViT-based U-shaped segmentation networks. Models like UCTransNet [28], EMCAD [29], 2-dimensional (2D) D-LKA [30], and MIST [31] combine ViT encoders with CNN decoders, effectively enhancing both global and local feature modeling. These studies have promoted the rapid development of U-structure framework in 2D medical image segmentation. In 3D medical image segmentation, U-shaped structure is equally widely adopted. Models such as UNETR [32], UNETR++ [33], Swin UNETR [34], nnFormer [35], and D-LKA Net [30] have all utilized this architecture, achieving remarkable results in their respective segmentation tasks.
However, our research reveals that the symmetric encoder–decoder structure of U-shaped networks inherently demands a large number of parameters, and deeper network layers increase the risk of overfitting during training. For instance, leading models in 2D segmentation tasks on the Synapse dataset now exceed 100 million parameters, nearly 5 times the parameter count of state-of-the-art (SOTA) models from 2020, yet they yield only about a 5% improvement in DSC performance. Analyzing the outputs at each stage of a U-Net on an abdominal computed tomography (CT) image, we observe additional phenomena. Figure 1B presents stage outputs without skip connections, while Fig. 1C shows the standard U-Net output. Without shallow information from skip connections, the decoder’s output becomes overly abstract and lacks detail, prompting further exploration into the role of progressive stage information and skip connections in the decoder. In Fig. 1D, we remove the decoder structure and upsample multi-scale features from each stage of the skip connections to the same resolution, directly aggregating them. Feature map preserves global details more effectively than the traditional U-Net. Comparing the output images in Fig. 1C and D, the former exhibits more pronounced edge contours but loses internal organ details. As semantic segmentation is a pixel-wise classification task, it inherently prioritizes the preservation of fine-grained details, which is more effectively achieved in the latter. However, this focus also leads to the introduction of additional noise and irrelevant pixels. Therefore, a new refinement module is needed after aggregation to extract critical features and eliminate redundant information.
Based on these findings, we propose an E-shaped segmentation structure without conventional progressive decoder. This structure upsamples and aggregates multi-scale features from each encoder stage to the original resolution, and then applies an MLKConv module for fine feature extraction, improving interpixel and interchannel associations. This design enhances segmentation accuracy and feature representation, effectively capturing intricate details in complex scenes. Specifically, our key contributions are as follows:
1.

We introduce an E-shaped segmentation architecture that removes conventional step-by-step decoding process, differing from the U-structure and significantly reducing model parameters. A novel MLKConv module is designed, utilizing depthwise convolutions with varying scales and dilation rates to efficiently extract and fuse local and global information with minimal parameters.

2.

Based on this E-structure, we construct an efficient 2D segmentation model and evaluate it on 4 different types of public medical datasets. Our model surpasses most current U-structure methods in segmentation accuracy and achieves the lower parameter count and faster inference speed among models with comparable performance.

3.

Furthermore, we develop a 3D segmentation model based on this E-structure with ViT as the encoder, demonstrating the structure’s generality across 2D and 3D segmentation tasks. Testing on 4 public 3D medical segmentation datasets, we achieve leading results with fewer parameter count.

4.

We re-design several U-shaped networks, adapting them to E-structure, and perform comparative analyses with their original U-structure counterparts. This evaluation validates the extensibility of E-structure by assessing its advantages and limitations.

To comprehensively evaluate our method, we benchmark 2D E-SegNet on Synapse [36], ACDC [37], Kvasir-SEG [38], and BUSI [39] datasets, and 3D E-SegNet on Synapse, NIH Pancreas [40], ACDC, and the Medical Segmentation Decathlon-Lung [41] datasets against current leading methods. Additionally, we extend some methods to E-structure and conduct comparisons with their original structures.
The Synapse multi-organ dataset contains 30 clinical abdominal CT scans with a total of 3,779 axial images. Each CT volume consists of 85 to 198 slices with a resolution of 512 × 512, accompanied by segmentation masks of 13 organs. Our model is trained on 18 cases and evaluated on the remaining 12 cases. Consistent with previous work, we report segmentation performance on 8 abdominal organs: spleen, right kidney, left kidney, gallbladder, liver, stomach, aorta, and pancreas. The ACDC dataset consists of magnetic resonance imaging (MRI) images from various patients, with annotations for left ventricle (LV), right ventricle (RV), and myocardium (Myo). This dataset is divided into 70 training, 10 validation, and 20 testing samples. The NIH Pancreas-CT dataset comprises 82 contrast-enhanced 3D abdominal CT scans focusing on the pancreas region, with each scan manually annotated by experts to delineate pancreatic contours. Among them, 62 scans are used for training and the rest for testing. The Kvasir-SEG dataset focuses on the segmentation of colorectal polyps in endoscopic images, containing 1,000 polyp images along with their respective segmentation masks. The dataset is split into training, validation, and testing sets in an 8:1:1 ratio. The Lung dataset consists of 63 CT volumes for a 2-class segmentation task, aimed at distinguishing lung cancer from the background. The data are split into a 4:1 ratio for training and validation. The BUSI dataset comprises 780 breast ultrasound images annotated for binary segmentation tasks involving normal and tumor regions. These images are collected from 600 female patients and include samples of varying quality and diverse lesion characteristics. Due to the lack of a standardized dataset split or official partitioning protocol, we adopt a 5-fold cross-validation strategy to ensure a fair and robust evaluation. All datasets, except BUSI, follow the official and previously established partitioning protocols.
For the abovementioned datasets, we follow the evaluation metrics used in prior work, including average Dice similarity coefficient (DSC), mean intersection over union (IOU), Jaccard index, average surface distance (ASD), and 95% Hausdorff distance (HD95). DSC, IOU, and Jaccard index assess the overlap between segmentation results and ground truth annotations, where values closer to 1 indicate greater overlap. ASD and HD95 reflect the closeness between the predicted boundary and the true boundary, with smaller values indicating better accuracy. Their formulas are as follows:
DSC=2∣X∩Y∣∣X∣+∣Y∣,
IOU=Jaccard=∣X∩Y∣∣X∪Y∣,
ASD=1∣SX∣+∣SY∣∑a∈SxdaSY+∑b∈SYdbSX,
HD95=maxsupinfx∈Xy∈Ydxy,supinfy∈Yx∈Xd(y,x).
In these formulas, X and Y represent the sets of predicted and ground truth segmentation pixels, respectively, and SX ​and SY​ denote the sets of points on the predicted and ground truth segmentation boundaries. The term d(a,SY) indicates the shortest distance from a predicted boundary point a to the true boundary SY, and d(b,SX) represents the shortest distance from a ground truth boundary point b to the predicted boundary SX. The operators sup and inf denote the supremum (maximum) and infimum (minimum), respectively. HD95 calculates Hausdorff distance by excluding the largest 5% of distances, thereby reducing the impact of outliers.
Our model is implemented in Python 3.8 and PyTorch 2.0.1 and tested on an RTX 3090 GPU. For dataset splitting and evaluation metrics, we adhere strictly to the standards established in prior studies. 2D E-SegNet is trained for 400 epochs with a batch size of 8, a base learning rate of 1 × 10−4, and the AdamW optimizer. The loss function combines Dice loss Ldice and cross-entropy Lce, computed as follows:
Ltotal=0.6×Ldice+0.4×Lce.
For 3D E-SegNet, we adopt the training strategy used by nnFormer [35], with a batch size of 2 and a base learning rate of 1 × 10−4, using the AdamW optimizer. 3D E-SegNet is trained for 1,000 epochs using image patches of size 128 × 128 × 64, with 250 patches per epoch. The formula for calculating the loss function is as follows:
Ltotal=Ldice+Lce.
These configurations are slightly adjusted across different datasets to accommodate varying data characteristics. Appendix S1 provides the complete training configurations and an explanation of the different loss weightings applied in 2D and 3D models.
We conduct a comprehensive comparison of the superior performance achieved by our 2D method against other 2D models on the Synapse dataset. As shown in Table 1, 2D E-SegNet achieves DSC of 86.15% and HD95 of 14.60. This result indicates that 2D E-SegNet demonstrates a clear superiority over previously established leading models, outperforming AgileFormer by 0.41%. Compared to other methods, it exhibits a more substantial advantage. Notably, 2D E-SegNet achieves the best results in segmenting specific anatomical regions, such as the spleen, stomach, aorta, and pancreas. In particular, it improves pancreas segmentation by impressive 2.64% over the second-best method. These regions, characterized by blurred boundaries, irregular shapes, and large spans, have traditionally been challenging for SOTA methods. The significant improvements by our model in these complex target areas indicate its strong advantage in handling intricate segmentations. The qualitative comparison of different methods is shown in Fig. 2A. In the segmentation of the pancreas, liver, and stomach, 2D E-SegNet demonstrates cleaner and more accurate boundaries, significantly reducing misclassifications and better representing the true shape of organs. In contrast, AgileFormer and MERIT exhibit undersegmentation or misclassification in large organs such as the liver and stomach, and fail to accurately delineate small, irregularly shaped organs like the pancreas. SwinUnet performs noticeably worse, producing jagged and fragmented boundaries, particularly in these challenging regions.
The segmentation performance on the ACDC dataset is shown in Table 2. 2D E-SegNet achieves DSC of 92.53%, outperforming the second-best method by 0.21%, with the best performance on RV and Myo segmentations. A qualitative comparison, illustrated in Fig. 2B, shows that 2D E-SegNet more accurately tracks complex contours. For RV region, other methods tend to over- or undersegment, whereas our method provides a more precise segmentation.
The comparison with leading methods on the Kvasir-SEG dataset is shown in Table 3. 2D E-SegNet achieves DSC of 94.83% and mean IOU of 90.66%, outperforming the second-best method by 0.38% and 0.92%, respectively. The segmentation visualization results are shown in Fig. 2C. 2D E-SegNet produces more complete and accurate segmentation shapes, with sharper boundaries that better preserve the true morphology of polyps, even when lesion regions closely resemble surrounding tissues. In contrast, FCB Former and EMCAD display fragmented and noisy predictions near boundaries. FCB Former tends to undersegment the lesion area, while EMCAD suffers from both under- and oversegmentation, with predictions occasionally spilling into adjacent tissue.
The DSC distribution for test samples on Synapse, ACDC, and Kvasir-Seg datasets is shown in Fig. 2D to F, respectively, while the proportions of DSC values across different intervals are illustrated in Fig. 2G. A significant majority of samples achieve a DSC above 0.9, with 87% on Synapse, 92% on ACDC, and 93% on Kvasir-Seg. Notably, for the Kvasir-Seg dataset, which focuses on polyp pathology segmentation, all results are above 65%. This highlights the robustness and stability of 2D E-SegNet in producing accurate and reliable segmentation results across diverse datasets. These findings demonstrate the strong generalization ability of 2D E-SegNet, ensuring consistent and precise segmentation performance across various 2D tasks and datasets.
The comparison with other methods on the BUSI dataset is shown in Table 4. 2D E-SegNet achieves an average DSC of 81.91 ± 1.47% and a mean IOU of 74.45 ± 1.56%, surpassing the second-best method, AgileFormer, which obtains 78.63 ± 2.56% in average DSC and 70.47 ± 2.70% in mean IOU. Moreover, E-SegNet demonstrates better stability across the 5-fold cross-validation, as evidenced by its lower standard deviation in both metrics.
We compare our 3D method with previous SOTA methods on the Synapse dataset. As shown in Table 5, 3D E-SegNet achieves DSC of 87.76% and HD95 of 6.32, ranking first in both metrics. Compared to D-LKA Net (the previous leading method), it achieves a DSC improvement of 0.27% and an HD95 improvement of 3.25. Performance is slightly improved on left kidney and significantly enhanced on gallbladder and liver. The 3D segmentation visualizations on the Synapse dataset are shown in Fig. 3A. 3D E-SegNet demonstrates greater spatial consistency and volume fidelity, particularly in the segmentation of liver, pancreas, and inferior vena cava. In contrast, D-LKA Net and UNETR++ tend to produce volumetric inflation of liver, with visible overextension into surrounding regions. Meanwhile, nnFormer and UNETR++ underrepresent pancreas and inferior vena cava, leading to noticeable discontinuities in the reconstructed structures. While 3D E-SegNet, like other methods, also exhibits mild oversegmentation in the spleen, it better preserves the overall anatomical structure and continuity across adjacent organs.
The comparison of segmentation results on the NIH Pancreas dataset is shown in Table 6. 3D E-SegNet outperforms the current SOTA methods across all 4 metrics: DSC, Jaccard, HD95, and ASD. Notably, compared to the previous best results, 3D E-SegNet achieves remarkable improvements of 4%, 5.56%, 3.31, and 0.89 in these metrics, respectively. A qualitative comparison of different methods in Fig. 3B demonstrates that our model has a clear advantage in capturing the overall structure of the pancreas, accurately following the highly irregular shape of the organ.
The DSC distribution for test samples on Synapse (3D) and NIH Pancreas datasets is shown in Fig. 3C and D, respectively. All samples achieve a DSC above 60%, with most values concentrated around 80% to 90%, closely aligning with the average performance on both datasets. This highlights the strong capability of 3D E-SegNet to deliver accurate segmentation across multiple organs, demonstrating robustness and stability in handling the diverse anatomical and structural complexities inherent to 3D medical imaging.
The comparison of the segmentation results with advanced 3D models on larger datasets is shown in Table 7. On the Lung and ACDC datasets, 3D E-SegNet achieved average DSCs of 81.77% and 92.92%, respectively, outperforming the previous best method, UNETR++, by 1.09% and 0.09%.
We conduct a comprehensive evaluation of computational performance and resource utilization of E-SegNet and other advanced methods. As shown in Fig. 4, in 2D segmentation tasks, 2D E-SegNet achieves a high inference speed of 74.63 frames per second (FPS) with 30.88M parameters and 15.77 GFLOPs (giga floating-point operations per second). Compared to SwinUNet, which has similar computational performance (27.17M parameters, 24.56 GFLOPs, 73.71 FPS), 2D E-SegNet achieves 7.02% and 2.53% higher segmentation accuracy on Synapse and ACDC datasets, respectively. Compared to AgileFormer, which delivers comparable segmentation performance, 2D E-SegNet reduces parameters and FLOPs by 73% and 85%, respectively, and improves inference speed by 418%. In 3D segmentation tasks, 3D E-SegNet maintains good parameter efficiency (31.74M) and inference speed (78.62 FPS), representing improvements of 28.24% and 96.06%, respectively, compared to D-LKA Net (42.35M parameters, 40.10 FPS). Compared with UNETR (92.49M parameters, 88.96 FPS), which offers similar computational performance, E-SegNet achieves 9.41%, 7.8%, 8.48%, and 6.31% higher segmentation accuracy across 4 datasets. Nevertheless, its advantage in FLOPs is less pronounced, mainly due to the high-channel encoder structure and voxel-level operations. Additional details on computational efficiency and resource usage are provided in Appendix S2.
We further investigate the impact of multi-stage feature aggregation on segmentation performance within the E-structure by conducting additional tests on both 2D and 3D E-SegNet using the Synapse dataset. As shown in Table 8, stage 1 represents the output of stem layer in 2D E-SegNet and the patch embedding layer in 3D E-SegNet, while stages 2 to 5 refer to the outputs of each subsequent MobileNet block or Video Swin Transformer stage, respectively. For example, [1–5] indicates cross-scale aggregation across all stages, including the stem or patch embedding layer, whereas [4,5] represents aggregation of only the last 2 stages. Our evaluation reveals that aggregating all stages achieves the highest DSC in 2D E-SegNet model, while aggregating only stages 3, 4, and 5 results in the lowest HD95. In 3D E-SegNet, the best results for DSC and HD95 are achieved by aggregating all stages except for the patch embedding layer. However, when the patch embedding layer is included in the aggregation, segmentation performance significantly declines. This performance drop can be attributed to the fact that the initial feature representations from the patch embedding layer are relatively coarse and superficial, lacking the rich spatial details and semantic context learned in the later stages of the network. Therefore, including these early-stage features introduces noise into the aggregation, and their alignment with the outputs from the subsequent layers of the Transformer network is typically poor. This misalignment interferes with the finer, more advanced features from the later stages, weakening the model’s ability to capture fine-grained details, particularly in complex anatomical structures, thereby reducing segmentation performance.
The effect of different refinement strategies on the modeling capacity of aggregated features is also examined through a set of ablation experiments, where the default MLKConv module is replaced with alternative designs. The compared configurations include (a) the proposed MLKConv module; (b) a DoubleConv block consisting of 2 consecutive blocks of convolution (3 × 3), batch normalization (BN), and ReLU; (c) an SE-enhanced convolutional block (SE + BasicConv), consisting of an SE module and a 3 × 3 convolution with BN and ReLU; and (d) removal of the refinement module entirely (None). These replacements are applied only to the refinement path while maintaining a consistent backbone across all models. For 3D tasks, the modules are implemented using their corresponding 3D counterparts.
As shown in Table 9, removing the refinement module leads to a significant decline in model performance. Specifically, in 2D task, DSC drops by 15.8% and HD95 increases by 22.75; in 3D task, DSC drops by 2.44% and HD95 increases by 2.69. These results indicate that further modeling of aggregated features is critical for accurate detail restoration. Compared with conventional convolutional and attention-enhanced modules, MLKConv achieves superior performance in both 2D and 3D tasks, demonstrating its effective contribution to the model.
To validate the applicability of E-structure across different scenarios, we compare the segmentation performance of 5 models using both U-structure and E-structure variants on the Synapse dataset. Specifically, we select the most lightweight and effective EMCAD [29] and DConv decoders (the latter is a modification of UNet decoder and is still widely used) to extend 2D E-SegNet into U-shaped structures. Additionally, we adapt 4 well-known U-structure models (UNet, SwinUnet, EMCAD, and AgileFormer) to E-structure using our approach. As shown in Fig. 5, models with an “E” prefix indicate E-structure adaptation, such as E-UNet, representing UNet extended to E-structure. The results show that the adapted UNet, EMCAD, and SwinUnet have a reduction in parameters of 33%, 5%, and 22%, respectively, compared to their original versions, while their DSC improves by 1.75%, 0.43%, and 0.94%. Although AgileFormer shows a performance drop with a 1.77% decrease in DSC, 40% reduction in parameters makes this trade-off acceptable given the substantial reduction in model size. For 2D E-SegNet, U-structure configurations incorporating EMCAD and DConv decoders result in parameter increases of 4% and 12%, respectively, compared to E-structure configuration, with DSC values decreasing by 1.09% and 1.5%, respectively.
Deep learning has significantly improved the accuracy of medical image segmentation, yet more efficient, compact, and faster models remain highly advantageous for practical applications. This study proposes a novel architecture, E-SegNet, which establishes new SOTA benchmarks across multiple 2D and 3D medical image segmentation tasks. E-SegNet exhibits strong robustness in challenging scenarios, including blurred boundaries, substantial size variation, and complex anatomical shapes. It achieves lower parameter counts, faster inference speed, and stable performance under most common medical image disturbances (Appendix S3), demonstrating a well-balanced trade-off between performance, efficiency, and model complexity.
The outstanding performance of E-SegNet can be attributed to its innovative E-structured design. Unlike the conventional U-shaped paradigm, E-SegNet removes the progressive resolution recovery process in the decoder, which effectively reduces information loss during cross-layer feature propagation. The introduction of a multi-scale feature aggregation mechanism further enhances feature representation and retains more detailed information. Moreover, the novel MLKConv module, combining multi-scale depthwise separable convolutions and dilated convolutions, addresses the trade-off between parameter size and receptive field in conventional convolutions while optimizing interchannel feature similarity and associations to significantly enhance segmentation accuracy and boundary detail fidelity. Experimental results show that the E-shaped framework adapts well to both 2D and 3D segmentation tasks. Applying the E-structure to conventional U-shaped models further demonstrates its potential as a general design for medical image segmentation and provides valuable insights for future model development.
The performance of E-SegNet suggests broad translational potential in precision medicine. For example, in tumor detection, its accurate delineation of lesions with blurred boundaries can enhance the sensitivity and specificity of early recognition, thereby improving patient prognosis. In pathological biomarker assessment, its fine modeling capability for complex tissue structures helps improve the accuracy of quantitative analysis. In tissue morphology analysis, E-SegNet can assist pathologists in efficient morphological evaluations, significantly reducing the workload of manual annotation. To enable broader clinical applications, our model also needs to adapt to more imaging modalities [such as positron emission tomography (PET) and x-ray] to cope with their differing characteristics (e.g., high noise in PET and low contrast in x-ray). This diversity in imaging characteristics not only demands architectural flexibility but also imposes constraints on computational resources and real-time processing requirements in clinical environments. The inference speed and structural simplicity of E-SegNet provide a solid foundation for further model compression, hardware acceleration, and edge deployment. Translating E-SegNet into clinical practice also necessitates careful attention to ethical and regulatory constraints. Ensuring patient data privacy and compliance with medical data protection standards [such as Health Insurance Portability and Accountability Act (HIPAA) and General Data Protection Regulation (GDPR)] is fundamental, particularly when deploying artificial intelligence (AI) models in cross-institutional or cloud-based settings. Additionally, potential biases introduced by imbalanced training data could impact model generalizability and fairness across patient populations. To foster responsible adoption, interpretability and human oversight are essential, especially in high-stakes diagnostic scenarios. Continuously advancing in these directions will help translate laboratory research into clinical practice, thereby improving diagnostic efficiency and patient care quality.
Despite these advancements, E-SegNet still has certain limitations and areas for improvement. 3D E-SegNet uses a video Swin Transformer encoder, which faces high memory consumption and computational overhead during training. Although it achieves high throughput during inference, FLOPs and memory usage remain relatively large. Compared to its 2D counterpart, it processes voxel-level inputs with much higher dimensionality, resulting in reduced batch size and slower convergence, especially when combined with the self-attention operations in ViT-based encoders. This window-based attention lacks sufficient capacity for long-range spatial modeling. Although E-shaped structure alleviates this limitation through multi-scale feature aggregation, it may still affect global contextual representation in high-resolution scenarios. This could be particularly relevant in segmenting large-area anatomical regions, where maintaining spatial continuity across distant slices is often beneficial for accurate reconstruction. The performance of E-shaped structure heavily relies on the encoder quality and the effectiveness of feature aggregation module. When the encoder design is too simple or the feature fusion is insufficient, segmentation accuracy may decrease in low-contrast or noisy images. Most current 3D segmentation models focus more on the overall architecture rather than optimizing individual encoder–decoder components. As a result, features extracted by the encoder are often not sufficiently refined, leading to little improvement in segmentation performance when applying E-structure to existing U-shaped 3D models. Moreover, the current convolutional upsampling module is relatively basic in terms of feature alignment, and the use of fixed-size kernels in MLKConv module may limit the model’s focus on extremely small or large features.
To further enhance the generality and efficiency of E-SegNet, future research can proceed in multiple directions. Small organ segmentation (such as pancreas and gallbladder) remains a persistent challenge in medical image segmentation due to small voxel proportions. Small targets are highly sensitive to positional information and boundary details, while the current E-SegNet has not introduced dedicated mechanisms for such structures. Future improvements could involve multi-scale context guidance, object-aware loss functions, or saliency learning strategies based on structural priors to enhance the model’s ability to recognize and model small structures. In terms of encoder selection, more lightweight and hardware-friendly architectures can be explored, along with techniques such as model quantization and knowledge distillation to optimize training and deployment efficiency. To further address the limited long-range modeling capacity of encoders, attention mechanisms such as MaxViT or deformable attention could be considered, as they offer enhanced spatial dependency modeling across distant regions. For the upsampling strategy, stronger alignment methods such as attention mechanisms or feature offset strategies could be employed to improve feature fusion accuracy. Regarding MLKConv module, deformable or dynamically sized multi-scale convolution mechanisms could be explored to enable a more adaptive receptive field. In addition, training efficiency could be improved through techniques such as mixed-precision training and gradient checkpointing, which help reduce memory usage and speed up convergence during 3D model optimization. Exploring hybrid forms combining E-SegNet with other architectures also holds significant potential. For example, incorporating graph neural networks to model the topological relationships of anatomical structures could improve the modeling of connected regions such as vessels and nerves. Integrating diffusion models could enhance robustness against high-noise images by generating more reliable feature representations. The Kolmogorov–Arnold networks, through learnable activation functions, can improve nonlinear representation capability, which is suitable for complex tissue modeling. Fast Fourier transform can be used to capture texture information in the frequency domain, improving recognition of periodic structures such as myocardium. The Mamba architecture, with its linear-complexity state-space model, enables long-range dependency modeling while maintaining efficiency, making it suitable for high-resolution medical images.
In addition, the lack of publicly available cross-modal datasets currently restricts our ability to comprehensively evaluate the cross-modal generalization of E-SegNet (e.g., training on MRI and testing on ultrasound). To address this, constructing benchmark multi-modal datasets and developing cross-modal feature alignment mechanisms will be key to enabling reliable knowledge transfer across imaging domains. Other critical aspects of clinical translation include validating model robustness on multi-center datasets with heterogeneous imaging protocols and ensuring system-level compatibility with real-time clinical workflows and deployment hardware.
In conclusion, the structural concept and experimental validation of E-SegNet provide not only a new solution for medical image segmentation tasks but also a foundation for building practical and scalable medical image models. We hope that this study can offer theoretical reference and practical value for future work, further promoting the integration and application of medical AI models in clinical settings.
Over the past decade, with the advent of U-Net [18], CNN-based U-shaped networks have demonstrated significant potential in medical image segmentation. To address feature misalignment issues in skip connections, Attention U-Net [21] and UCTransNet [28] introduced attention mechanisms into the skip connections, while U-Net++ [19] and U-Net3+ [23] employed denser skip connections. Additionally, modifications to the original convolutional module were proposed, such as incorporating residual connections [20,42] and deformable convolutions [43], and KiU-Net [24] added an auxiliary branch to generate richer detail information to supplement U-Net.
Since the introduction of ViT in 2020, it has gained popularity in medical image segmentation due to its unrestricted receptive field and superior ability to capture long-range dependencies between image patches through multi-head self-attention mechanism, surpassing conventional convolutions. TransUNet [44] and TransBTS [45] adopted ViT to replace CNN encoder and bottleneck layer, but the high parameter count and computational overhead of ViT led to significant overfitting issues. With further exploration of ViT variants, models like SwinUnet [26], AgileFormer [27], and MISSFormer [46] have integrated and optimized these ViT modules to construct pure ViT-based U-shaped segmentation models. Additionally, hybrid models combining ViT and CNN (e.g., HiFormer [47,48]) have been progressively refined, while EMCAD [29] and MIST [31] introduced more efficient convolutional decoders paired with ViT encoders, effectively enhancing global information capture and local feature modeling capabilities. Furthermore, cascaded structures have proven particularly effective in refining multi-level features. DS-TransUNet [49] achieved cross-scale feature fusion through parallel Swin Transformer encoders [50] of different scales, enabling better multi-level information capture in medical images. MERIT [51], G-CASCADE [52], and PVT-CASCADE [53] introduced efficient cascaded decoders, achieving higher segmentation accuracy and finer detail restoration for complex images by progressively decoding and layer-wise feature refinement. Additionally, some studies have taken alternative approaches, optimizing loss functions [54] to improve boundary and multi-scale feature capture, and incorporating adaptive pruning strategies [55] to reduce computational costs, thereby better addressing the complexity and resource constraints inherent in medical image segmentation.
Medical images from MRI or CT scans are typically stored in 3D format. Compared to 2D models, 3D models can more comprehensively capture contextual information and maintain spatial coherence between slices, achieving a cohesive representation of overall structures.
3D U-Net [56], H-DenseUNet [57], and 3D Attention U-Net [58] extended 2D models into 3D space, enabling the capture of spatial information in medical images. Building on this, V-Net [59] introduced residual structures to enhance feature propagation, while LKAU-Net [60] incorporated large convolutional kernels to increase the spatial receptive field. nnFormer [35] designed a pure Transformer-based 3D segmentation architecture, focusing on global modeling of 3D volumetric data. Hybrid architectures like UNETR [32], Swin UNETR [34], and CoTr [61] adopted ViT + CNN combinations, effectively capturing long-range dependencies while preserving local detail. SegFormer3D [62] used a lightweight Transformer structure combined with convolutional layers to avoid the high computational complexity typically associated with traditional Transformers. nnU-Net [63] optimized model structure and training processes through an adaptive configuration mechanism, enhancing compatibility across various medical image segmentation tasks. UNETR++ [33] further improved upon UNETR by incorporating a lightweight Transformer encoder, multi-scale feature fusion, and an enhanced decoder design, achieving more efficient and accurate segmentation. D-LKA Net [30] introduced deformable large-kernel attention mechanisms to strengthen segmentation performance for complex anatomical structures.
Current research predominantly focuses on innovations at module level, often overlooking the impact of overall architecture design. In fact, an optimized model architecture can fundamentally address many persistent issues in medical image segmentation. Our experimental results suggest that the proposed E-structured segmentation network may offer advantages over conventional U-shaped architectures, particularly in capturing targets with diverse sizes and shapes in complex segmentation scenarios.
Multi-scale large-kernel convolution (MLKConv) comprises multi-scale depthwise separable convolutions (GConv) and dilated depthwise separable convolutions (DConv). This design enables efficient extraction and fusion of features across different receptive fields with minimal parameters and computation, enhancing the model’s ability to capture targets of irregular shapes and sizes, which is a crucial aspect in medical imaging. As shown in MLKConv of Fig. 6A, the input features (dimension H × W × C) first pass through 4 GConv modules with kernel sizes of 3, 5, 7, and 11, producing 4 feature maps of dimension H × W × C/4. These maps are then concatenated along the channel dimension to restore the original size, followed by a GConv module with kernel size of 1 to reinforce channel dependencies. Finally, a residual connection ensures effective feature propagation at deeper layers. Each GConv module consists of a 1 × 1 convolution (pointwise convolution, PWConv), a k × k group convolution (here, using depthwise convolution, DWConv), a BN layer, and a ReLU activation function. This process can be represented as:
GConvkf=ReLUBNDWConvkPWConvf,
f1=concatGConv3fGConv5fGConv7fGConv11f,
f2=f+GConv1f1,
where GConvk denotes a GConv module in which the depthwise convolution uses a kernel size of k. f represents the input feature. Specifically, f1 and f2 denote the feature concatenation captured under different receptive fields and the feature channel regularization with residual connections, respectively. In Eq. 2, 1 × 1 convolution in each GConv reduces the number of channels to 1/4 of the original, while in Eq. 3, 1 × 1 convolution in GConv maintains the number of channels unchanged.
To enhance the model’s long-range modeling capability for large targets in medical images, we introduce group convolutions with varying dilation rates in DConv module to replace standard depthwise convolutions. This approach, processed similarly to GConv, enables the capture of global information over a larger range. Notably, to maintain higher resolution and finer feature representation in the model output, we omit ReLU activation function in the final layer of GConv module. This process can be represented as:
DConvk,rf2=ReLUBNDWConvk,rPWConvf2,
f3=concatDConv3,3f2DConv3,5f2DConv3,7f2DConv3,11f2,
output=f2+GConv1f3,
where DConvk,r denotes a DConv module in which the depthwise convolution uses a kernel size of k and a dilation rate of r. Specifically, f3 denotes the feature concatenation captured under different, larger receptive fields via dilated convolutions, and output represents the final feature output of MLKConv module. In Eq. 5, 1 × 1 convolution in each DConv reduces the number of channels to 1/4​ of the original, while in Eq. 6, 1 × 1 convolution in GConv maintains the number of channels unchanged.
The parameter requirements for GConv and DConv can be expressed as follows:
PGConvk=CinCout+k2+2Cout,
PDConv3,r=CinCout+11Cout,
where Cin and Cout denote the input and output channels, respectively. Thus, the total parameter count for MLKConv is approximately 4C2 + 70C, which is notably lower than a conventional 3 × 3 convolution (with 9C2 parameters) in practical applications.
The 2D network structure is shown in Fig. 6B. We use MobileNet V4 as the encoder to achieve efficient and precise feature extraction. Formally, the encoder generates 5 multi-scale feature maps at each stage, progressively reducing the image resolution from H × W to H/32 × W/32. Each stage’s resolution is half of the previous one, with the shallow stages having higher resolution to capture local structures and edge details, while the deeper stages provide lower resolution but richer channel information, capturing global features such as semantics and overall object shape. These multi-scale features from each stage are adjusted to a uniform size using a convolutional upsampling (UpConv) module. This module first compresses the features with a 3 × 3 convolution, ReLU layer, and BN layer to remove redundant semantic information, preventing mismatch during feature aggregation. Next, nearest-neighbor interpolation restores the features to the original image resolution. The 5 processed features of the same size are then summed element-wise. To further enhance feature representation, we apply MLKConv module to strengthen interpixel relationships, followed by a 1 × 1 convolution to output the final segmentation map. This process can be represented as:
Uxi=NNIBNReluConv3×3xi,
Xout=Conv1×1MLKUx0+Ux1+Ux2+Ux3+Ux4,
where Convk×k denotes a k × k convolution operation, NNI denotes nearest-neighbor interpolation, U(xi) denotes convolutional upsampling operation applied to the output feature from the ith stage of encoder, and MLK denotes the MLKConv operation.
As shown in Fig. 6C, 3D E-SegNet uses video Swin Transformer as its encoder. Unlike 2D E-SegNet, 3D E-SegNet divides the input image into multiple 3D patches through a 3D patch embedding layer, mapping these patches into a lower-dimensional feature space, directly reducing the original spatial resolution from H × W × D to H/4 × W/4 × D/2. In the following 4 stages, the first stage keeps the feature shape constant, while the in-plane spatial resolution is progressively halved at each subsequent stage, with the slice-axis dimension remaining unchanged (from H/4 × W/4 × D/2 to H/32 × W/32 × D/2), effectively preserving interslice information, especially in medical images with limited slice counts. The multi-scale spatial features from the encoder’s 4 stages are restored to the original resolution H × W × D, using a 3D convolutional upsampling (3D UpConv) module and aggregated through element-wise addition. This is followed by a 3D MLKConv to further enhance feature representation. Notably, 3D UpConv and 3D MLKConv are 3D extensions of 2D UpConv and 2D MLKConv, adapted for the characteristics of 3D medical imaging. Finally, a 1 × 1 × 1 3D convolution transforms the features into the segmentation map format. This process can be represented as:
Txi=TNNIBN3DReluConv3×3×3xi,
Xout=Conv1×1×1MLK3DTx1+Tx2+Tx3+Tx4,
where TNNI ​​represents 3D nearest-neighbor interpolation, BN3D denotes a 3D BN layer, T(xi) indicates 3D convolutional upsampling operation applied to the output feature from the ith stage of encoder, and MLK3D denotes the 3D MLKConv operation.

U-shaped models: A class of encoder–decoder architectures (e.g., U-Net) designed for image segmentation tasks, characterized by symmetric downsampling and upsampling paths with skip connections to recover spatial resolution.

CNN: Convolution-based neural networks are widely used in visual recognition and segmentation tasks, capable of learning hierarchical spatial features through stacked convolutional layers and local receptive fields.

ViT: A transformer-based architecture that models image patches as sequences, enables effective global context capture without relying on convolutional operations.

SOTA: Refers to the best performance or most advanced approach reported in the literature for a given task at the time of evaluation.

Encoder: The downsampling path of a segmentation model is used to extract increasingly abstract and semantic features by reducing spatial dimensions and increasing receptive fields.

Decoder: The upsampling path of a segmentation model is responsible for progressively recovering spatial resolution and reconstructing the segmentation mask from encoded features.

Skip connections: Lateral links between corresponding encoder and decoder stages in U-shaped architectures are designed to fuse low-level spatial features with high-level semantic information.

Cascade structure: A parallel multi-branch design within the encoder or decoder, where each branch models features in different ways (e.g., using different resolutions or network architectures), enables richer feature representation in medical image segmentation.

2D medical image segmentation: Segmentation tasks perform on individual image slices (e.g., CT or MRI), treating each 2D slice independently.

3D medical image segmentation: Volumetric segmentation tasks consider spatial context across multiple slices (e.g., using 3D convolution or attention across depth, height, and width dimensions).

FPS: Indicates the speed at which a model processes input images or volumes, commonly used to evaluate inference efficiency in real-time or clinical settings.

Five-fold cross-validation: A model validation strategy divides the dataset into 5 subsets, using 4 for training and 1 for testing in rotation, thereby improving the robustness of performance estimates.

Backbone: The core feature extractor in a deep learning model, often composes of pretrained architectures (e.g., ResNet and Swin Transformer), which generates multi-level feature representations for downstream tasks like segmentation.

Stem (stem layer): The initial convolutional block of a neural network is responsible for basic spatial feature extraction from input images, typically before entering deeper stages of the encoder.

Video Swin Transformer: A hierarchical transformer-based backbone is originally designed for video action recognition, adapted here to capture long-range dependencies and spatiotemporal context in 3D medical volumes via shifted window self-attention.

Stages of aggregation: Refers to the module where multi-scale features (from all encoder levels) are spatially aligned (e.g., by upsampling) and fused to produce enhanced representations for segmentation. In E-SegNet, this replaces traditional decoder stages.

MaxVit: Combines convolutional operations with both block-wise and grid-wise attention to effectively capture spatial dependencies across scales, offering a unified and efficient architecture for vision tasks.

  • Ministry of Science and Technology of the People’s Republic of China(2021ZD0201900)
  • National Natural Science Foundation of China(12090052)
  • National Natural Science Foundation of China(U24A2014)
  • Natural Science Foundation of Liaoning Province(2023-MS-288)
  • Fundamental Research Funds for the Liaoning Universities(LJ212410146026)
  • Natural Science Foundation of Zhejiang Province(LY24A050003)
1.
Azad R, Aghdam EK, Rauland A, Jia Y, Avval AH, Bozorgpour A, Karimijafarbigloo S, Cohen JP, Adeli E, Merhof D. Medical image segmentation review: The success of U-Net. IEEE Trans Pattern Anal Mach Intell. 2022;46(12):10076–10095.
2.
Xie J, Xu P, Lin Y, Zheng M, Jia J, Tan X, Sun J, Zhao Q. LncRNA–miRNA interactions prediction based on meta-path similarity and Gaussian kernel similarity. J Cell Mol Med. 2024;28(19):Article e18590.
3.
Wang W, Zhang L, Sun J, Zhao Q, Shuai J. Predicting the potential human lncRNA–miRNA interactions based on graph convolution network with conditional random field. Brief Bioinform. 2022;23(6):Article bbac463.
4.
Liu H, Ren G, Chen H, Liu Q, Yang Y, Zhao Q. Predicting lncRNA–miRNA interactions based on logistic matrix factorization with neighborhood regularized. Knowl-Based Syst. 2020;191:Article 105261.
5.
Yang X, Sun J, Jin B, Lu Y, Cheng J, Jiang J, Zhao Q, Shuai J. Multi-task aquatic toxicity prediction model based on multi-level features fusion. J Adv Res. 2024;68:477–489.
6.
Yang X, Wang Y, Lin Y, Zhang M, Liu O, Shuai J, Zhao Q. A multi-task self-supervised strategy for predicting molecular properties and FGFR1 inhibitors. Adv Sci. 2025;12(13):Article 2412987.
7.
Hu J, Yang X, Yao C, Zhang M, Shen S, Na L, Zhao Q. AMPred-MFG: Investigating the mutagenicity of compounds using motif-based graph combined with molecular fingerprints and graph attention mechanism. Interdiscip Sci Comput Life Sci. 2025.
8.
Gao H, Sun J, Wang Y, Lu Y, Liu L, Zhao Q, Shuai J. Predicting metabolite–disease associations based on auto-encoder and non-negative matrix factorization. Brief Bioinform. 2023;24(5):Article bbad259.
9.
Sun F, Sun J, Zhao Q. A deep learning method for predicting metabolite–disease associations via graph neural network. Brief Bioinform. 2022;23(4):Article bbac266.
10.
Zhu F, Niu Q, Li X, Zhao Q, Su H, Shuai J. FM-FCN: A neural network with filtering modules for accurate vital signs extraction. Research. 2024;7:Article 0361.
11.
Zhu F, Shuai Z, Lu Y, Su H, Yu R, Li X, Zhao Q, Shuai J. oBABC: A one-dimensional binary artificial bee colony algorithm for binary optimization. Swarm Evol Comput. 2024;87:Article 101567.
12.
Cheng M, Wang J, Liu X, Wang Y, Wu Q, Wang F, Li P, Wang B, Zhang X, Xie W. Development and validation of a deep-learning network for detecting congenital heart disease from multi-view multi-modal transthoracic echocardiograms. Research. 2024;7:Article 0319.
13.
Yao S, Shen P, Dai F, Deng L, Qiu X, Zhao Y, Gao M, Zhang H, Zheng X, Yu X, et al.Thyroid cancer central lymph node metastasis risk stratification based on homogeneous positioning deep learning. Research. 2024;7:Article 0432.
14.
He Q, Li X, Zhong J, Yang G, Han J, Shuai J. Dear-PSM: A deep learning-based peptide search engine enables full database search for proteomics. Smart Med. 2024;3(3):Article e20240014.
15.
Nemati N, Samet R, Hancer E, Yildirim Z, Akkas EE. A hybridized deep learning methodology for mitosis detection and classification from histopathology images. J Mach Intell Data Sci. 2023;4(1):35–43.
16.
Nemati N, Samet R, Hancer E, Yildirim Z, Traore M. A mitosis detection and classification methodology with yolov5 and fuzzy classifiers. Paper presented at: Proceedings of the 9th World Congress on Electrical Engineering and Computer Systems and Sciences (EECSS); 2023; London, UK.
17.
Samet R, Nemati N, Hançer E, Sak S, Kırmızı BA. Histopatolojik Görüntülerde Dogru Mitoz Tespiti için Geliştirilmiş Renk Normalleştirme Yöntemi: Enhanced stain normalization method for accurate mitosis detection in histopathological images. Paper presented at: 2024 9th International Conference on Computer Science and Engineering (UBMK); 2024; Antalya, Türkiye.
18.
Ronneberger O, Fischer P, Brox T. U-Net: Convolutional networks for biomedical image segmentation. In: Medical image computing and computer-assisted intervention (MICCAI). Cham: Springer; 2015. p. 234–241.
19.
Zhou Z, Rahman Siddiquee MM, Tajbakhsh N, Liang J. UNet++: A nested U-Net architecture for medical image segmentation. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Cham: Springer; 2018. p. 3–11.
20.
Diakogiannis FI, Waldner F, Caccetta P, Wu C. ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data. ISPRS J Photogramm Remote Sens. 2020;162:94–114.
21.
Oktay O, Schlemper J, Folgoc LL, Lee MJ, Heinrich MP, Misawa K, Mori K, McDonagh SG, Hammerla NY, Kainz B, et al. Attention U-Net: Learning where to look for the pancreas. arXiv. 2018. https://doi.org/10.48550/arXiv.1804.03999
22.
Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Zhang T, Gao S, Liu J. CE-Net: Context encoder network for 2D medical image segmentation. IEEE Trans Med Imaging. 2019;38(10):2281–2292.
23.
Huang H, Lin L, Tong R, Hu H, Zhang Q, Iwamoto Y, Han X, Chen YW, Wu J. UNet 3+: A full-scale connected UNet for medical image segmentation. Paper presented at: ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); 2020; Barcelona, Spain.
24.
Valanarasu JMJ, Sindagi VA, Hacihaliloglu I, Patel VM. KiU-Net: Towards accurate segmentation of biomedical images using over-complete representations. In: Medical image computing and computer assisted intervention (MICCAI). Cham: Springer; 2020. p. 363–373.
25.
Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv. 2020. https://doi.org/10.48550/arXiv.2010.11929
26.
Cao H, Wang Y, Chen J, Jiang D, Zhang X, Tian Q, Wang M. Swin-Unet: Unet-like pure transformer for medical image segmentation. Paper presented at: European Conference on Computer Vision (ECCV); 2023; Milan, Italy.
27.
Qiu P, Yang J, Kumar S, Ghosh SS, Sotiras A. AgileFormer: Spatially agile transformer UNet for medical image segmentation. arXiv. 2024. https://doi.org/10.48550/arXiv.2404.00122
28.
Wang HN, Cao P, Wang JQ, Zaiane OR, Assoc Advancement Artificial I. UCTransNet: Rethinking the skip connections in U-Net from a channel-wise perspective with transformer. Paper presented at: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI); 2022; Virtual.
29.
Rahman MM, Munir M, Marculescu R. EMCAD: Efficient multi-scale convolutional attention decoding for medical image segmentation. Paper presented at: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2024; Seattle, WA, USA.
30.
Azad R, Niggemeier L, Huttemann M, Kazerouni A, Aghdam EK, Velichko Y, Bagci U, Merhof D. Beyond self-attention: Deformable large kernel attention for medical image segmentation. Paper presented at: 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); 2024; Waikoloa, HI, USA.
31.
Rahman MM, Shokouhmand S, Bhatt S, Faezipour M. MIST: Medical image segmentation transformer with convolutional attention mixing (CAM) decoder. Paper presented at: 2023: IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); 2024; Waikoloa, HI, USA.
32.
Hatamizadeh A, Yang D, Roth HR, Xu D. UNETR: Transformers for 3D medical image segmentation. Paper presented at: 2021 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); 2022; Waikoloa, HI, USA.
33.
Shaker A, Maaz M, Rasheed H, Khan S, Yang MH, Khan FS. UNETR++: Delving into efficient and accurate 3D medical image segmentation. IEEE Trans Med Imaging. 2024;43(9):3377–3390.
34.
Tang Y, Yang D, Li W, Roth HR, Landman B, Xu D, Nath V, Hatamizadeh A. Self-supervised pre-training of Swin transformers for 3D medical image analysis. IEEE/CVF Conf Comput Vision Pattern Recogn. 2022;2022:20698–20708.
35.
Zhou HY, Guo J, Zhang Y, Han X, Yu L, Wang L, Yu Y. nnFormer: Volumetric medical image segmentation via a 3D transformer. IEEE Trans Image Process. 2023;32:4036–4045.
36.
Landman B, Xu Z, Igelsias J, Styner M, Langerak T, Klein A. Miccai multi-atlas labeling beyond the cranial vault–workshop and challenge. Paper presented at: Proceedings of the MICCAI Multi-Atlas Labeling Beyond Cranial Vault—Workshop Challenge; 2015; Munich, Germany.
37.
Bernard O, Lalande A, Zotti C, Cervenansky F, Yang X, Heng PA, Cetin I, Lekadir K, Camara O, Ballester MAG, et al.Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: Is the problem solved? IEEE Trans Med Imaging. 2018;37(11):2514–2525.
38.
Jha D, Smedsrud PH, Riegler MA, Halvorsen P, de Lange T, Johansen D, Johansen HD. Kvasir-SEG: A segmented polyp dataset. In: MultiMedia modeling. Cham: Springer; 2020. p. 451–462.
39.
Al-Dhabyani W, Gomaa M, Khaled H, Fahmy A. Dataset of breast ultrasound images. Data Brief. 2020;28:Article 104863.
40.
Roth HR, Lu L, Farag A, Shin H-C, Liu J, Turkbey EB, Summers RM. DeepOrgan: Multi-level deep convolutional networks for automated pancreas segmentation. In: Medical image computing and computer-assisted intervention (MICCAI). Cham: Springer; 2015. p .556–564.
41.
Simpson AL, Antonelli M, Bakas S, Bilello M, Farahani K, Van Ginneken B, Kopp-Schneider A, Landman BA, Litjens G, Menze B. A large annotated medical image dataset for the development and evaluation of segmentation algorithms. arXiv. 2024. https://doi.org/10.48550/arXiv.1902.09063
42.
Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH. Brain tumor segmentation and radiomics survival prediction: Contribution to the BRATS 2017 Challenge. In: Brainlesion: Glioma, multiple sclerosis, stroke and traumatic brain injuries. Cham: Springer; 2018. p. 287–297.
43.
Li Z, Pan H, Zhu Y, Qin AK. PGD-UNet: A position-guided deformable network for simultaneous segmentation of organs and tumors. Paper presented at: 2020 International Joint Conference on Neural Networks (IJCNN); 2020; Glasgow, UK.
44.
Chen J, Lu Y, Yu Q, Luo X, Adeli E, Wang Y, Lu L, Yuille AL, Zhou Y. TransUNet: Transformers make strong encoders for medical image segmentation. arXiv. 2021. https://doi.org/10.48550/arXiv.2102.04306
45.
Wang W, Chen C, Ding M, Yu H, Zha S, Li J. TransBTS: Multimodal brain tumor segmentation using transformer. In: Medical image computing and computer assisted intervention (MICCAI). Cham: Springer; 2021. p. 109–119.
46.
Huang X, Deng Z, Li D, Yuan X, Fu Y. MISSFormer: An effective transformer for 2D medical image segmentation. IEEE Trans Med Imaging. 2023;42(5):1484–1494.
47.
Heidari M, Kazerouni A, Soltany M, Azad R, Aghdam EK, Cohen-Adad J, Merhof D. HiFormer: Hierarchical multi-scale representations using transformers for medical image segmentation. Paper presented at: 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); 2023; Waikoloa, HI, USA.
48.
Wu W, Huang J, Zhang M, Li Y, Yu Q, Zhao Q. MSA-MaxNet: Multi-scale attention enhanced multi-Axis vision transformer network for medical image segmentation. J Cell Mol Med. 2024;28(24):Article e70315.
49.
Lin A, Chen B, Xu J, Zhang Z, Lu G, Zhang D. DS-TransUNet: Dual Swin transformer U-Net for medical image segmentation. IEEE Trans Instrum Meas. 2022;71:1–15.
50.
Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Lin S, Guo B. Swin Transformer: Hierarchical vision transformer using shifted windows. Paper presented at: 2021 IEEE/CVF International Conference on Computer Vision (ICCV); 2021; Virtual.
51.
Rahman MM, Marculescu R. Multi-scale hierarchical vision transformer with cascaded attention decoding for medical image segmentation. Paper presented at: 6th International Conference on Medical Imaging with Deep Learning (MIDL); 2023; Nashville, TN, USA.
52.
Rahman MM, Marculescu R. G-CASCADE: Efficient cascaded graph convolutional decoding for 2D medical image segmentation. Paper presented at: 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); 2024; Waikoloa, HI, USA.
53.
Rahman MM, Marculescu R: Medical image segmentation via cascaded attention decoding. Paper presented at: 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); 2023; Waikoloa, HI, USA.
54.
Kato S, Hotta K. Adaptive t-vMF dice loss: An effective expansion of dice loss for medical image segmentation. Comput Biol Med. 2024;168:Article 107695.
55.
Lin X, Yu L, Cheng KT, Yan ZQ. The lighter the better: Rethinking transformers in medical image segmentation through adaptive pruning. IEEE Trans Med Imaging. 2023;42(8):2325–2337.
56.
Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3D U-Net: Learning dense volumetric segmentation from sparse annotation. In: Medical image computing and computer-assisted intervention (MICCAI). Cham: Springer; 2016. p. 424–432.
57.
Li X, Chen H, Qi X, Dou Q, Fu CW, Heng PA. H-DenseUNet: Hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging. 2018;37(12):2663–2674.
58.
Su Z, Jia Y, Liao W, Lv Y, Dou J, Sun Z, Li X. 3D attention U-Net with pretraining: A solution to CADA-aneurysm segmentation challenge. In: Cerebral aneurysm detection and analysis. Cham: Springer; 2021. p. 58–67.
59.
Milletari F, Navab N, Ahmadi SA. V-Net: Fully convolutional neural networks for volumetric medical image segmentation. Paper presented at: 2016 Fourth International Conference on 3D Vision (3DV); 2016; Stanford, CA, USA.
60.
Li H, Nan Y, Yang G. LKAU-Net: 3D large-kernel attention-based U-Net for automatic MRI brain tumor segmentation. In: Medical image understanding and analysis. Cham: Springer; 2022. p. 313–327.
61.
Xie Y, Zhang J, Shen C, Xia Y. CoTr: Efficiently bridging CNN and transformer for 3D medical image segmentation. In: Medical image computing and computer assisted intervention (MICCAI). Cham: Springer; 2021. p. 171–180.
62.
Perera S, Navard P, Yilmaz A. SegFormer3D: An efficient transformer for 3D medical image segmentation. Paper presented at: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); 2024; Seattle, WA, USA.
63.
Isensee F, Jaeger PF, Kohl SAA, Petersen J, Maier-Hein KH. nnU-Net: A self-configuring method for deep learning-based biomedical image segmentation. Nat Methods. 2021;18(2):203–211.
64.
Pan Y, Zhang S, Gernand AD, Goldstein JA, Wang JZ. AI-SAM: Automatic and interactive segment anything model. arXiv. 2023. https://doi.org/10.48550/arXiv.2312.03119
65.
Li F, Zhang H, Xu H, Liu S, Zhang L, Ni LM, Shum HY. Mask DINO: Towards a unified transformer-based framework for object detection and segmentation. Paper presented at: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2023; Vancouver, Canada.
66.
Zhou L. Spatially exclusive pasting: A general data augmentation for the polyp segmentation. Paper presented at: 2023 International Joint Conference on Neural Networks (IJCNN); 2023; Gold Coast, Queensland, Australia.
67.
Wang J, Huang Q, Tang F, Meng J, Su J, Song S. Stepwise feature fusion: Local guides global. IN: Medical image computing and computer assisted intervention (MICCAI). Cham: Springer; 2022. p. 110–120.
68.
Zhang Y, Liu H, Hu Q. TransFuse: Fusing transformers and CNNs for medical image segmentation. IN: Medical image computing and computer assisted intervention (MICCAI). Cham: Springer; 2021. p. 14–24.
69.
Zhou ZW, Siddiquee MMR, Tajbakhsh N, Liang JM. UNet plus plus : Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging. 2020;39(6):1856–1867.
70.
Lin TY, Dollár P, Girshick R, He KM, Hariharan B, Belongie S. Feature pyramid networks for object detection. Paper presented at: 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017; Honolulu, HI, USA.
Year 2025 volume 8 Issue 9
PDF
14
8
Cite this Article
BibTeX
Article Info
doi: 10.34133/research.0869
  • Receive Date:2025-02-16
  • Online Date:2026-11-01
  • Published:2025-09-20
Article Data
Affiliations
History
  • Received:2025-02-16
  • Revised:2025-08-07
  • Accepted:2025-08-08
Funding
Ministry of Science and Technology of the People’s Republic of China(2021ZD0201900)
National Natural Science Foundation of China(12090052)
National Natural Science Foundation of China(U24A2014)
Natural Science Foundation of Liaoning Province(2023-MS-288)
Fundamental Research Funds for the Liaoning Universities(LJ212410146026)
Natural Science Foundation of Zhejiang Province(LY24A050003)
Affiliations
    1School of Computer Science and Software Engineering, University of Science and Technology Liaoning, Anshan 114051, China.
    2College of Data Science, Jiaxing University, Jiaxing 314000, China.
    3Oujiang Laboratory (Zhejiang Lab for Regenerative Medicine, Vision and Brain Health), Wenzhou Institute, University of Chinese Academy of Sciences, Wenzhou 325001, China.

Corresponding:

* Address correspondence to: (Q.Z.);
References
Share
https://castjournals.cast.org.cn/joweb/research/EN/10.34133/research.0869
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT