收藏切换
Deep unfolding network for brain image registration
收藏切换
Jiaying Sun1, Shuangyan Yang2, *, Shihui Ying3
Journal of Image and Graphics | 2026, 31(7) : 2538 - 2552
Less
收藏切换
Journal of Image and Graphics | 2026, 31(7): 2538-2552
• Foundation Models for Medical Image Analysis •
Deep unfolding network for brain image registration
Full
Jiaying Sun1, Shuangyan Yang2, *, Shihui Ying3
Affiliations
  • 1 Department of Mathematics,College of Sciences,Shanghai University,Shanghai 200444,China
  • 2 Department of Radiation Oncology ,Shanghai Pulmonary Hospital Affiliated to Tongji University,Shanghai 200433,China
  • 3 Shanghai Institute of Applied Mathematics and Mechanics,Shanghai University,Shanghai 200072,China
Published: 2026-07-16 doi: 10.11834/jig.250283
Outline
收藏切换
Objective

Medical image registration plays an important role in clinical applications such as surgical navigation,disease progression monitoring,and multimodal diagnosis. The accuracy of image registration is critical to ensuring the reliability of subsequent image analysis. Traditional methods formulate the registration process as an optimization problem by maximizing the similarity between the fixed and warped moving images and employ iterative optimization strategies to update the deformation field gradually. While such approaches provide clear theoretical interpretability,their high computational costs fail to meet real-time clinical demands. By contrast,deep learning-based methods leverage large-scale datasets to learn the deformation field directly. Although these data-driven approaches have demonstrated remarkable improvements in registration speed and accuracy,they operate as black-box models with limited interpretability. Moreover,most current approaches continue to depend on manually designed regularization terms,which may lack adaptability to diverse anatomical structures. To address these challenges,we propose an unfolding-based registration network that combines the theoretical guarantees of traditional optimization with the high efficiency and adaptive learning capabilities of deep neural networks.

Method

Specifically,by introducing variable splitting,we first decouple the registration problem into two subproblems: a similarity-constraint subproblem and a deformation-regularization subproblem. This decomposition reduces optimization complexity and allows each subproblem to be addressed separately. Inspired by deep unfolding networks,the method maps the alternating update process between the two subproblems to a multistage cascaded architecture. Each stage corresponds to one complete iteration of the optimizer,providing clear physical and mathematical foundations and enhancing interpretability compared with traditional end-to-end models. Within this framework,two specialized modules are designed to address each subproblem. The fidelity module (FM) is employed to solve the similarity-constraint subproblem. Convolutional neural networks (CNN) are widely used in deep learning-based registration. However,the limited receptive field of the convolution kernel leads the network to focus on local feature information,while the Transformer uses the self-attention mechanism to capture global dependencies effectively. By integrating the strengths of these two architectures,the FM is designed on the basis of the TransUnet framework. This hybrid design allows the FM to combine local features with global context. The denoising module (DM) is designed to solve the deformation-regularization subproblem. Instead of using handcrafted regularization terms,we approximate the regularization term using a trainable neural network. Concretely,the DM adopts the denoising convolutional neural network architecture and incorporates residual connections,allowing the model to learn priors adaptively in a data-driven manner and thus improving generalization across different anatomical structures. These two modules jointly complete a single alternating iteration and are cascaded to form the deep unfolding network. The overall network is trained with a loss function that balances image similarity,deformation consistency between the outputs of the FM and DM,and smoothness of the deformation field. The proposed network is implemented using the PyTorch framework and trained on an NVIDIA Tesla V100 GPU with 32 GB of memory. The model is optimized using the Adam optimizer with a learning rate of 1E-4,a batch size of 1,and is trained for 500 epochs. The Transformer component in the FM was configured with four attention heads,eight encoder layers,and an MLP dimension of 96. The unfolding network was constructed with three cascaded stages.

Result

Experiments were conducted on two publicly available brain magnetic resonance imaging (MRI) datasets: LPBA40 and OASIS. We compared our method with a range of state-of-the-art models,including traditional registration methods (i.e.,large deformation diffeomorphic metric mapping and symmetric normalization) and learning-based methods (e.g.,VoxelMorph,TransMorph,UTSRMorph and H-SGANet). The quantitative evaluation metrics contained a dice similarity coefficient (Dice),the percentage of nonpositive Jacobian determinants,and inference time. The proposed method achieved an average Dice of 70.1% on LPBA40 and 79.9% on OASIS,while the percentage of nonpositive Jacobian determinants remained at a low level of 0.01% on both datasets,and the inference time was 0.55 s on LPBA40 and 0.37 s on OASIS. Although slightly higher than some deep learning-based models due to the cascaded unfolding architecture and Transformer modules,the time remained clinically feasible. Visualized results also indicated that the deformation fields produced by the proposed method was smoother and more consistent with anatomical priors. Additionally,we conducted a set of ablation studies and reported corresponding quantitative results. These ablation studies explicitly demonstrated the effectiveness of individual modules in our proposed model,including the variable splitting strategy,the TransUnet-based fidelity module,and the residual connection-based denoising module and assessed the influence of key hyperparameters.

Conclusion

In this study,we proposed a deep unfolding network for medical image registration that effectively combines the interpretability of traditional iterative methods with the efficiency and adaptability of deep learning. By unrolling a decoupled optimization model into a trainable network with fidelity and denoising modules,the proposed approach strictly corresponds to a specific step in iterative algorithms. Experiments demonstrate that the proposed method remarkably enhances interpretability while maintaining high efficiency and accuracy.

medical image registration  /  unfolding network  /  model decoupling  /  regularization learning  /  brain image
孙嘉颖, 杨双燕, 应时辉. 面向脑影像配准的深度展开网络研究. 中国图象图形学报, 2026 , 31 (7) : 2538 -2552 . DOI: 10.11834/jig.250283
Jiaying Sun, Shuangyan Yang, Shihui Ying. Deep unfolding network for brain image registration[J]. Journal of Image and Graphics, 2026 , 31 (7) : 2538 -2552 . DOI: 10.11834/jig.250283
  • National Key R&D Program of China(2021YFA1003004);Bethune Young and Middle-aged Physicians Oncology Research Fund(YDTR-008)
Year 2026 volume 31 Issue 7
17
8
Cite this Article
BibTeX
Article Info
doi: 10.11834/jig.250283
  • Receive Date:2025-07-14
  • Online Date:2026-10-30
  • Published:2026-07-16
Article Data
Affiliations
History
  • Received:2025-07-14
  • Revised:2025-12-29
Funding
National Key R&D Program of China(2021YFA1003004);Bethune Young and Middle-aged Physicians Oncology Research Fund(YDTR-008)
Affiliations
    1 Department of Mathematics,College of Sciences,Shanghai University,Shanghai 200444,China
    2 Department of Radiation Oncology ,Shanghai Pulmonary Hospital Affiliated to Tongji University,Shanghai 200433,China
    3 Shanghai Institute of Applied Mathematics and Mechanics,Shanghai University,Shanghai 200072,China
References
Share
https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.250283
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT