收藏切换
Face retouching restoration based on a diffusion model
收藏切换
Jiaxin Liu, Sheng Li*, Zhenxing Qian, Xinpeng Zhang, Qichao Ying
Journal of Image and Graphics | 2026, 31(8) : 2868 - 2881
Less
收藏切换
Journal of Image and Graphics | 2026, 31(8): 2868-2881
• Image Processing and Coding •
Face retouching restoration based on a diffusion model
Full
Jiaxin Liu, Sheng Li*, Zhenxing Qian, Xinpeng Zhang, Qichao Ying
Affiliations
  • Computation and Artificial Intelligence Innovative College,Fudan University,Shanghai 200082,China
Published: 2026-08-16 doi: 10.11834/jig.250242
Outline
收藏切换
Objective

The widespread use of face-retouching techniques across social media platforms has generated significant societal concerns that extend beyond aesthetics,giving rise to psychological consequences,such as body dysmorphic disorder,undermining trust in digital imagery and reinforcing pervasive cultural norms surrounding beauty standards. Face-retouching is widely perceived as more convenient than face swapping and has been integrated into numerous social network applications. Although existing research has made substantial progress in detecting retouched faces using a range of computational approaches,the critical task of reversing these modifications to reconstruct original facial features and restore authenticity in digital images remains largely unexplored. This disparity highlights a significant gap between detection capabilities and the development of practical restoration solutions. This study formally introduces face retouching restoration (FRR) as a novel computer vision task,distinguished from related problems,such as makeup restoration and general image restoration,by its explicit focus on subtle textural modifications and extreme structural alterations characteristic of retouched facial images. The primary objective is to accurately recover authentic facial characteristics from heavily manipulated images by addressing two key technical challenges: restoring fine-grained textures,such as skin smoothing,and reconstructing facial geometry,including eye enlargement and jaw reshaping. This dual focus on texture and structure advances beyond existing methods that typically address only a single aspect of facial modification. Furthermore,this study aims to establish standardized evaluation protocols and datasets for this emerging research direction,recognizing that existing benchmarks designed for retouching detection are inadequate for assessing restoration quality. The proposed approach advances digital media forensics by providing practical tools for content authentication while simultaneously contributing to the broad discussions on image manipulation in the digital age. This study aims to shift from passive detection to active restoration,with potential applications in forensic analysis,psychological counseling,and digital media literacy initiatives.

Method

The proposed retouching-guided diffusion model for FRR (RT-FRR) introduces a novel dual-component architecture that synergistically integrates diffusion-based generation modeling with targeted retouching artifact analysis. The framework incorporates a face retouching estimation module (FREM) that utilizes constrained BayarConv layers with 5 × 5 × 3 kernels,specifically designed to amplify manipulation artifacts while suppressing authentic facial features. This preprocessing stage extracts multi-scale retouching traces through four successive ResNet blocks,capturing local pixel-level inconsistencies and global structural alterations. These hierarchical features serve as conditional guidance for the second component—a denoising diffusion probabilistic model configured with 1 000 timesteps that learns to predict the precise residual between retouched and original facial images. The model’s U-Net backbone incorporates innovative cross-attention mechanisms at four distinct network depths,allowing progressive integration of retouching traces with diffusion priors throughout the denoising process. This multi-scale attention strategy facilitates simultaneous recovery of high-frequency textural details,such as skin pores and fine wrinkles,and macroscopic structural features,including facial contours and organ geometry. Training optimization utilizes the Adam algorithm across 100 000 iterations with a fixed learning rate of 10-4 using a composite loss function that balances pixel-wise reconstruction accuracy with perceptual quality metrics. The authors created the extreme retouched face dataset (ExRF) comprising 1 000 high-resolution image pairs with severe yet plausible retouching operations,manually generated using professional editing software with consistent extreme parameter settings,for a comprehensive evaluation. This dataset complements the existing RetouchingFFHQ benchmark,ensuring robust validation across the full spectrum of retouching intensities from subtle enhancements to dramatic transformations. The framework operates on 512 × 512 resolution images,maintaining architectural consistency with state-of-the-art diffusion models while being specifically optimized for facial feature recovery tasks.

Result

Experimental evaluation demonstrates that RT-FRR achieves state-of-the-art performance in face retouching restoration,significantly outperforming existing methods across multiple quantitative and qualitative metrics. On the ExRF dataset,which features significantly retouched faces,RT-FRR achieves a PSNR of 25.23 dB,surpassing the second-best method ResDiff by 1.9 dB,along with superior scores in SSIM at 0.806,FID at 48.802,and LPIPS at 0.241. These results highlight the model’s effectiveness in recovering subtle textural details and major structural modifications,such as eye enlargement,nose reshaping,and facial contour adjustments. Comparative analysis against nine baseline methods,including makeup removal techniques,such as CSD-MIT and BeautyGAN,as well as general image restoration approaches,such as Restormer and SR3,demonstrates that RT-FRR consistently delivers high-fidelity reconstructions,particularly in cases of significant retouching where prior methods frequently fail. On the RetouchingFFHQ dataset,which features mild retouching,RT-FRR maintains strong performance with a PSNR of 25.39 dB,demonstrating robustness across different retouching intensities. Qualitative assessments reinforce these findings,with feature similarity heatmaps and t-SNE visualizations confirming that RT-FRR more accurately recovers facial identity characteristics than competing approaches. The model successfully reconstructs fine-grained skin textures while correcting exaggerated structural changes,such as unnaturally thinned jawlines or enlarged eyes,without introducing artifacts common in GAN-based or transformer-based methods. Ablation studies underscore the importance of key design choices,where the face residual generation strategy alone contributes a 4 dB PSNR improvement,while the FREM module adds an additional 2 dB by localizing retouching traces. Visual comparisons further demonstrate RT-FRR’s ability to restore natural facial proportions and skin details,even in cases where retouching has heavily distorted the original appearance. These results establish RT-FRR as a comprehensive solution for face retouching restoration,effectively addressing textural and structural recovery with unprecedented accuracy.

Conclusion

In this study,we focus on FRR,a novel task focused on recovering original facial features from retouched ones,particularly those that are significantly retouched. We propose RT-FRR to recover the textural and structural face features from a retouched face,where a face retouching estimation module is designed and incorporated to extract the retouching trace to guide the FRR. The retouching traces are integrated with the denoising U-Net of the DDPM through an attention mechanism for an accurate face residual generation. We evaluate the performance of RT-FRR on an existing face retouching dataset and the newly constructed ExRF. On both datasets,our RF-FRR outperforms existing makeup removal and image restoration schemes in the task of FRR.

image restoration  /  face retouching restoration(FRR)  /  diffusion model  /  attention mechanism  /  residual prediction
刘佳欣, 李晟, 钱振兴, 张新鹏, 应祺超. 基于扩散模型的美颜人脸图像复原. 中国图象图形学报, 2026 , 31 (8) : 2868 -2881 . DOI: 10.11834/jig.250242
Jiaxin Liu, Sheng Li, Zhenxing Qian, Xinpeng Zhang, Qichao Ying. Face retouching restoration based on a diffusion model[J]. Journal of Image and Graphics, 2026 , 31 (8) : 2868 -2881 . DOI: 10.11834/jig.250242
  • National Natural Science Foundation of China (62572125,U22B2047,62450067); Shanghai Municipal Natural Science Foundation(25ZR1401019); China Postdoctoral Science Foundation (2025M771574)
Year 2026 volume 31 Issue 8
12
5
Cite this Article
BibTeX
Article Info
doi: 10.11834/jig.250242
  • Receive Date:2025-06-11
  • Online Date:2026-10-30
  • Published:2026-08-16
Article Data
Affiliations
History
  • Received:2025-06-11
  • Revised:2026-01-13
Funding
National Natural Science Foundation of China (62572125,U22B2047,62450067); Shanghai Municipal Natural Science Foundation(25ZR1401019); China Postdoctoral Science Foundation (2025M771574)
Affiliations
    Computation and Artificial Intelligence Innovative College,Fudan University,Shanghai 200082,China
References
Share
https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.250242
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT