收藏切换
A Phase Recovery Method for Fringe Projection Profilometry Based on Multi-task Networks
收藏切换
Guijie LIU1, Wulang LIU1, Mingfeng LI1, Chaoguang HUANG2, Wenbin HUANG3, Jianpin MA1, Wenjie LI1, 3
Acta Photonica Sinica | 2026, 55(3) : 273 - 287
Less
收藏切换
Acta Photonica Sinica | 2026, 55(3): 273-287
• Imaging Systems •
A Phase Recovery Method for Fringe Projection Profilometry Based on Multi-task Networks
Full
Guijie LIU1, Wulang LIU1, Mingfeng LI1, Chaoguang HUANG2, Wenbin HUANG3, Jianpin MA1, Wenjie LI1, 3
Affiliations
  • 1Guangxi Key Laboratory of Manufacturing System & Advanced Manufacturing Technology, School of Mechanical and Electrical Engineering, Guilin University of Electronic Technology, Guilin 541004, China
  • 2Guilin Kevin Peter Technology Co., Ltd., Guilin 541001, China
  • 3Engineering Research Center of Digital Imaging and Display, Ministry of Education, Soochow University,Suzhou 215006, China
Published: 2026-03-25 doi: 10.3788/gzxb20265503.0311001
Outline
收藏切换

3D reconstruction techniques have been extensively applied across a wide range of fields in recent years, including medical imaging, robotic navigation, virtual and augmented reality, 3D animation modeling, and online product inspection. Among these techniques, Fringe Projection Profilometry (FPP) has attracted significant attention owing to its non-contact measurement capability, full-field acquisition, and high spatial resolution. These advantages have led to its widespread adoption in industrial inspection, cultural heritage preservation, biomedical applications, and reverse engineering. Within an FPP system, phase recovery constitutes a fundamental and indispensable step, as both the accuracy and computational efficiency of phase estimation directly determine the quality of the reconstructed 3D surface and the overall system performance. Consequently, the development of fast, accurate, and robust phase recovery methods remains a central research topic in fringe projection profilometry.

Traditional phase retrieval techniques mainly include Fourier Transform Profilometry (FTP) and multi-step Phase-Shifting Profilometry (PSP). Multi-step phase-shifting methods achieve high phase accuracy by projecting and capturing multiple phase-shifted fringe patterns; however, their reliance on multiple frames significantly restricts their applicability in dynamic scenes or high-speed measurement scenarios. In contrast, Fourier transform-based methods can extract phase information from a single fringe image, offering improved measurement efficiency. Nevertheless, their performance tends to degrade considerably when dealing with complex surface geometries, depth discontinuities, severe noise, or strong surface reflectivity, resulting in reduced accuracy and robustness. In recent years, researchers have increasingly integrated deep learning with phase extraction and phase unwrapping processes, achieving high reconstruction accuracy while significantly reducing the number of required projection patterns. Compared with conventional analytical approaches, deep learning-based methods exhibit superior capability in handling noise, nonlinear distortions, and surface discontinuities. Despite these advantages, existing deep learning-based absolute phase recovery methods still suffer from several limitations. Existing deep learning-based absolute phase recovery methods mainly fall into two categories. The first predicts the numerator and denominator terms of wrapped phase at three different frequencies separately, then computes the absolute phase using multi-frequency or number-theoretic methods. The second employs either a dual-network or dual-decoding architecture to separately predict the numerator and denominator terms of the high-frequency wrapped phase along with the fringe order, thereby obtaining the absolute phase. The former suffers from error accumulation during multi-frequency unwrapping, leading to significant inaccuracies and poor stability. The latter incurs high computational complexity and low inference efficiency due to the multi-network or dual-decoder design.

Aiming to address the issues of error accumulation and high model complexity inherent in existing methods, this paper proposes a novel multi-task phase recovery framework based on GD-UNet (UNet with an Information Gather-and-Distribute Mechanism). The proposed method enables simultaneous prediction of the wrapped phase and fringe order within a single network, thereby allowing direct recovery of the absolute phase. Built upon the classical UNet architecture, the proposed model incorporates residual modules to enhance feature extraction capability and improve training stability. In addition, by integrating an information gather-and-distribute mechanism, the network supports multi-task learning and directly outputs the numerator and denominator of the wrapped phase as well as the corresponding fringe order. This unified design eliminates the need for multiple networks, effectively reducing computational complexity and inference time. Furthermore, to enhance the robustness of fringe order prediction-particularly in challenging regions such as object boundaries, sharp depth discontinuities, and highly reflective surfaces-a fringe order correction strategy based on Connected Domain Segmentation (CDS) of the wrapped phase is introduced. The proposed CDS-based correction method exploits the spatial continuity of the wrapped phase, under the assumption that all pixels within the same connected domain theoretically share an identical fringe order. Since prediction errors tend to occur more frequently near domain boundaries, the final fringe order for each connected region is determined through majority voting, thereby effectively suppressing local misclassifications. This strategy significantly improves the stability and accuracy of fringe order estimation without introducing additional computational burden. Extensive experiments are conducted to evaluate the performance of the proposed method under various conditions, including different surface materials, complex geometries, and discontinuous scenes. Both quantitative and qualitative comparisons with state-of-the-art methods demonstrate that the proposed GD-UNet-based framework achieves superior phase recovery accuracy while maintaining lower model complexity and faster inference speed.

The experimental results indicate that the proposed approach effectively mitigates error accumulation, enhances robustness against noise and surface reflectivity, and exhibits strong generalization capability across diverse measurement scenarios. In conclusion, this paper aims to achieve stable and high-precision phase recovery from a single fringe image in complex scenes containing large surface discontinuities or isolated objects through a unified network model. A single-frame phase extraction method is presented, in which only one fringe image is required, and a single network simultaneously predicts the numerator and denominator of the wrapped phase as well as the fringe order map. The proposed approach demonstrates clear advantages in both accuracy and efficiency. Comprehensive experimental evaluations confirm that the method achieves excellent measurement accuracy and strong robustness in challenging scenarios, including complex surface reconstruction, high noise interference, and multi-material object measurement.

Fringe projection profilometry  /  GD-UNet network  /  Information Gather and Distribute Mechanism  /  Phase recovery  /  Connected domain segmentation
刘规杰, 刘伍浪, 李明枫, 黄朝光, 黄文彬, 马建平, 李文杰. 一种基于多任务网络的条纹投影轮廓术相位恢复方法. 光子学报, 2026 , 55 (3) : 273 -287 . DOI: 10.3788/gzxb20265503.0311001
Guijie LIU, Wulang LIU, Mingfeng LI, Chaoguang HUANG, Wenbin HUANG, Jianpin MA, Wenjie LI. A Phase Recovery Method for Fringe Projection Profilometry Based on Multi-task Networks[J]. Acta Photonica Sinica, 2026 , 55 (3) : 273 -287 . DOI: 10.3788/gzxb20265503.0311001
Year 2026 volume 55 Issue 3
116
54
Cite this Article
BibTeX
Article Info
doi: 10.3788/gzxb20265503.0311001
  • Receive Date:2025-11-04
  • Online Date:2026-10-10
  • Published:2026-03-25
Article Data
Affiliations
History
  • Received:2025-11-04
  • Accepted:2025-12-31
Affiliations
    1Guangxi Key Laboratory of Manufacturing System & Advanced Manufacturing Technology, School of Mechanical and Electrical Engineering, Guilin University of Electronic Technology, Guilin 541004, China
    2Guilin Kevin Peter Technology Co., Ltd., Guilin 541001, China
    3Engineering Research Center of Digital Imaging and Display, Ministry of Education, Soochow University,Suzhou 215006, China
References
Share
https://castjournals.cast.org.cn/joweb/gzxb/EN/10.3788/gzxb20265503.0311001
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT