收藏切换
Elastic Orthogonal Weight Modification Continual Learning Algorithm in the Context of Synthetic Speech Detection
收藏切换
Xiaohui Zhang1, 2, Jiangyan Yi1, *, Jianhua Tao3, Junzuo Zhou1
Journal of Computer Research and Development | 2025, 62(2) : 336 - 345
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(2): 336-345
• Artificial Intelligence •
Elastic Orthogonal Weight Modification Continual Learning Algorithm in the Context of Synthetic Speech Detection
Full
Xiaohui Zhang1, 2, Jiangyan Yi1, *, Jianhua Tao3, Junzuo Zhou1
Affiliations
  • 1Institute of Automation, Chinese Academy of Sciences, Beijing 100190
  • 2School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044
  • 3Department of Automation, Tsinghua University, Beijing 100084
  • born in 1998. Master candidate. His main research interests include deep fake audio detection and continual learning

    born in 1984. PhD, Master supervisor. Her main research interests include speech information processing, speech generation and identification, and continuous learning

    born in 1972. PhD, PhD supervisor. His main research interests include intelligent information fusion and processing, speech processing, affective computing, and big data analysis

    born in 2000. Master candidate. His main research interest includes text-to-speech

About Author:

born in 1998. Master candidate. His main research interests include deep fake audio detection and continual learning

born in 1984. PhD, Master supervisor. Her main research interests include speech information processing, speech generation and identification, and continuous learning

born in 1972. PhD, PhD supervisor. His main research interests include intelligent information fusion and processing, speech processing, affective computing, and big data analysis

born in 2000. Master candidate. His main research interest includes text-to-speech

Published: 2025-02-01 doi: 10.7544/issn1000-1239.202330311
Outline
收藏切换

Currently, deep learning has achieved significant success in the field of synthetic speech detection. However, deep models commonly attain high accuracy on test sets that closely match their training distribution but exhibit a substantial drop in accuracy in cross-dataset scenarios. To enhance the generalization capability of models on new datasets, they are often fine-tuned with new data, but this leads to catastrophic forgetting, where the model’s knowledge learned from old data is impaired, resulting in deteriorated performance on the old data. Continuous learning is a prevalent approach to mitigate catastrophic forgetting. In this paper, we propose a continuous learning algorithm called elastic orthogonal weight modification (EOWM) to address catastrophic forgetting for synthetic speech detection. EOWM mitigates knowledge degradation by adjusting the direction and magnitude of parameter updates when the model learns new knowledge. Specifically, it enforces the updates’ direction to be orthogonal to the data distribution of the old tasks while constraining the magnitude of updates for important parameters in the old tasks. Our proposed algorithm demonstrates promising results in cross-dataset experiments within the domain of synthetic speech detection. Compared with fine-tuning, EOWM reduces the equal error rate (EER) on the old dataset from 7.334% to 0.821%, representing a relative improvement of 90%, and on the new dataset, it decreases EER from 0.513% to 0.315%, corresponding to a relative improvement of 40%.

synthetic speech detection  /  continual learning  /  elastic orthogonal weight modification  /  pre-trained model  /  deep neural network
张晓辉, 易江燕, 陶建华, 周俊佐. 面向合成语音检测的弹性正交权重修正连续学习算法. 计算机研究与发展, 2025 , 62 (2) : 336 -345 . DOI: 10.7544/issn1000-1239.202330311
Xiaohui Zhang, Jiangyan Yi, Jianhua Tao, Junzuo Zhou. Elastic Orthogonal Weight Modification Continual Learning Algorithm in the Context of Synthetic Speech Detection[J]. Journal of Computer Research and Development, 2025 , 62 (2) : 336 -345 . DOI: 10.7544/issn1000-1239.202330311
Year 2025 volume 62 Issue 2
101
47
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330311
  • Receive Date:2023-04-10
  • Online Date:2026-11-10
  • Published:2025-02-01
Article Data
Affiliations
History
  • Received:2023-04-10
  • Revised:2024-01-08
Affiliations
    1Institute of Automation, Chinese Academy of Sciences, Beijing 100190
    2School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044
    3Department of Automation, Tsinghua University, Beijing 100084
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330311
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT