收藏切换
Survey of Audio-Driven Talking Face Video Generation and Identification
收藏切换
Zheng Le, Yongting Hu, Yong Xu*
Journal of Computer Research and Development | 2025, 62(10) : 2523 - 2544
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(10): 2523-2544
• Artificial Intelligence •
Survey of Audio-Driven Talking Face Video Generation and Identification
Full
Zheng Le, Yongting Hu, Yong Xu*
Affiliations
  • School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, Shenzhen, Guangdong 518055
  • Shenzhen Key Laboratory of Visual Object Detection and Recognition (Harbin Institute of Technology, Shenzhen), Shenzhen, Guangdong 518055
  • born in 2002. Master candidate. His main research interests include computer vision and video generation

    born in 1999. PhD candidate. Her main research interest includes unsupervised video anomaly detection

    born in 1972. PhD, professor. Member of CCF. His research interests include pattern recognition, computer vision, deep learning, and video analysis

About Author:

born in 2002. Master candidate. His main research interests include computer vision and video generation

born in 1999. PhD candidate. Her main research interest includes unsupervised video anomaly detection

born in 1972. PhD, professor. Member of CCF. His research interests include pattern recognition, computer vision, deep learning, and video analysis

Published: 2025-10-01 doi: 10.7544/issn1000-1239.202440207
Outline
收藏切换

With the rapid advancement of artificial intelligence generation models and deepfakes, the techniques for generating talking face videos using various methods have become increasingly mature. Among them, audio-driven talking face video generation methods have attracted significant attention due to their remarkably realistic and natural output. Such methods utilize audio as a driving source to synthesize videos where the target character’s mouth movements synchronize with the audio, often combining image or video materials. Currently, these technologies are widely applied in fields such as virtual anchors, gaming animation, and film and television production, demonstrating vast prospects for development. However, the potential negative impacts of this technology are also becoming apparent. Improper or abusive use could lead to serious political and economic consequences. In this context, research on identifying various types of facial forgery videos has emerged. Our research primarily assesses the authenticity of videos by detecting the veracity of individual video frames or the spatio-temporal consistency of video sequences. Firstly, we systematically analyze the classic algorithms and latest advancements in audio-driven talking face video generation tasks based on the timeline and the development history of foundational models. Secondly, we exhaustively list the commonly used datasets and evaluation criteria for this task, conducting comprehensive comparisons across multiple dimensions. Subsequently, we meticulously analyze and summarize the forgery facial video identification task, categorizing it based on whether the discrimination technology focuses on individual video frames or multiple frames, and also summarize its commonly used datasets and evaluation criteria. Finally, we outline the challenges and future directions in this research field, aiming to provide valuable references and support for subsequent related research.

deep learning  /  deepfake  /  audio-driven  /  talking face video generation  /  forgery facial video identification
乐铮, 胡永婷, 徐勇. 音频驱动的说话人面部视频生成与鉴别综述. 计算机研究与发展, 2025 , 62 (10) : 2523 -2544 . DOI: 10.7544/issn1000-1239.202440207
Zheng Le, Yongting Hu, Yong Xu. Survey of Audio-Driven Talking Face Video Generation and Identification[J]. Journal of Computer Research and Development, 2025 , 62 (10) : 2523 -2544 . DOI: 10.7544/issn1000-1239.202440207
Year 2025 volume 62 Issue 10
145
58
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440207
  • Receive Date:2024-03-21
  • Online Date:2026-11-10
  • Published:2025-10-01
Article Data
Affiliations
History
  • Received:2024-03-21
  • Revised:2025-01-07
  • Accepted:2025-01-26
Affiliations
    School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, Shenzhen, Guangdong 518055
    Shenzhen Key Laboratory of Visual Object Detection and Recognition (Harbin Institute of Technology, Shenzhen), Shenzhen, Guangdong 518055
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440207
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT