收藏切换
Multiscale feature fusion and dynamic enhancement for voice source identification
收藏切换
Zhaopin Su1, 2, 3, Zhen Fang1, Guofu Zhang1, 3, 4, *, Yaofei Wang1, 2, 3, Huaijuan Zang1, 2, 3
Journal of Image and Graphics | 2026, 31(10) : 3606 - 3617
Less
收藏切换
Journal of Image and Graphics | 2026, 31(10): 3606-3617
• Image Analysis and Recognition •
Multiscale feature fusion and dynamic enhancement for voice source identification
Full
Zhaopin Su1, 2, 3, Zhen Fang1, Guofu Zhang1, 3, 4, *, Yaofei Wang1, 2, 3, Huaijuan Zang1, 2, 3
Affiliations
  • 1 School of Computer and Information Technology,Hefei University of Technology,Hefei 230601,China
  • 2 Intelligent Interconnected System Anhui Laboratory (Hefei University of Technology),Hefei 230009,China
  • 3 Anhui Province Key Laboratory of Industry Safety and Emergency Technology(Hefei University of Technology),Hefei 230009,China
  • 4 Joint Laboratory of Intelligent Prevention and Recognition of Voice and Video,Hefei 230000,China
Published: 2026-10-16 doi: 10.11834/jig.250570
Outline
收藏切换
Objective

In the field of multimedia forensics,identifying the source of voice evidence is crucial for judicial applications and information security. Voice recordings often serve as key evidence in legal investigations,yet their evidential value is limited by the capabilities of current analytical techniques. Most existing approaches focus on identifying the mobile phone model but lack the precision to differentiate between individual devices of the same model. This limitation considerably reduces the utility of voice evidence because it cannot be uniquely linked to a specific device. As a result,such evidence is often treated as supplementary in court proceedings rather than being considered direct and legally valid proof. Fine-grained device identification inability hinders digital forensics effectiveness and highlights the need for advanced methodologies.

Method

To address this challenge,this study proposes a novel voice source identification (VSI) model based on multiscale feature fusion and dynamic enhancement. The model is designed to capture and amplify the subtle hardware-specific fingerprints embedded in speech signals. These fingerprints arise from variations in microphone and circuit components,making them unique to each device. The proposed framework consists of several interconnected modules. First,a residual-attention collaborative network is employed to enhance feature representation. This network combines the strengths of residual learning and attention mechanisms,enabling the model to focus on device-related characteristics while suppressing irrelevant speech content and environmental noise. The residual connections facilitate training stability,while the attention mechanism dynamically weights important features,improving discriminability. Second,a dual-path feature extraction structure is implemented. The overall feature extraction module uses an expression-enhanced time delay neural network to capture broad,context-rich device characteristics. This module processes long-term temporal dependencies,which are essential for identifying model-level attributes. Simultaneously,a local feature extraction module based on a multilevel residual SE-Res2Net architecture is used to capture fine-grained,high-frequency details. This component excels at identifying minute differences between individual devices by leveraging hierarchical residual connections and channel-wise attention,enabling multiscale feature learning within a unified framework. Third,a feature enhancement module incorporating feature recalibration and dynamic global filtering is applied. This module refines the fused multiscale features by emphasizing task-relevant information and filtering out noise. Feature recalibration adjusts channel-wise feature responses adaptively,while dynamic global filtering performs content-aware smoothing and enhancement,further strengthening the device-specific representations. Finally,a fine-grained classification model is constructed to achieve cross-level device identification. This classifier is trained to distinguish devices at multiple hierarchical levels,from brand and model down to the individual unit,improving accuracy and generalization. The entire architecture is optimized end-to-end,ensuring seamless integration of all components.

Result

To evaluate the effectiveness of the proposed VSI model comprehensively,a large-scale voice dataset comprising 14 mobile phone brands and 121 different individual devices was constructed. This dataset is designed to cover a wide range of scenarios and conditions,thereby providing a rigorous testbed for assessing the model's performance. The VSI model was evaluated using three key metrics: equal error rate (EER),accuracy (ACC),and minimum detection cost function (minDCF). Results demonstrate the superior performance of the VSI model compared with existing methods. Specifically,the VSI model achieved an EER of 7.50%,an ACC of 89.97%,and a minDCF of 0.38. These results are remarkably better than those obtained by four other state-of-the-art methods reported in the literature. Compared with these methods,the EER was reduced by 4.75%,4.71%,5.44% and 3.46%,respectively. The ACC was increased by 3.98%,2.20%,4.90%,and 2.52% respectively,and the minDCF was decreased by 0.04,0.04,0.30,and 0.03,respectively. These improvements highlight the effectiveness of the VSI model in accurately identifying individual devices from voice signals. Moreover,the VSI model demonstrated robustness under varying conditions of voice duration,sampling rate,and encoding format. This robustness is crucial for practical applications because voice signals in real-world scenarios often exhibit variations in these parameters. The ability of the VSI model to maintain high performance across different conditions indicates its potential for widespread adoption in forensic and security-related applications.

Conclusion

The findings demonstrate that the proposed VSI model remarkably advances the field of voice source identification by enabling precise,individual-level device recognition. By effectively extracting and enhancing hardware-specific fingerprints from speech signals,the model provides a reliable means of linking voice recordings to specific mobile devices. This capability enhances the evidentiary value of voice data in judicial contexts,allowing it to serve as direct and valid evidence. Furthermore,the model’s robustness to real-world variations ensures its practical applicability in diverse scenarios. These contributions offer strong technical support for judicial forensics,intelligent terminal authentication,and broader domains of multimedia security. Future work will focus on extending the model to handle more complex audio manipulations and integrating it with complementary forensic techniques.

multimedia forensics  /  voice source identification  /  multi-scale feature fusion  /  dynamic enhancement  /  individual mobile identification
苏兆品, 方振, 张国富, 王垚飞, 臧怀娟. 多尺度特征融合与动态增强的语音来源识别. 中国图象图形学报, 2026 , 31 (10) : 3606 -3617 . DOI: 10.11834/jig.250570
Zhaopin Su, Zhen Fang, Guofu Zhang, Yaofei Wang, Huaijuan Zang. Multiscale feature fusion and dynamic enhancement for voice source identification[J]. Journal of Image and Graphics, 2026 , 31 (10) : 3606 -3617 . DOI: 10.11834/jig.250570
  • National Natural Science Foundation of China(62302146);MOE (Ministry of Education in China) Project of Humanities and Social Sciences(24YJA870011);Fundamental Research Funds for the Central Universities of China(PA2025IISL0104,PA2025GDSK0078)
Year 2026 volume 31 Issue 10
16
7
Cite this Article
BibTeX
Article Info
doi: 10.11834/jig.250570
  • Receive Date:2025-11-12
  • Online Date:2026-10-30
  • Published:2026-10-16
Article Data
Affiliations
History
  • Received:2025-11-12
  • Revised:2026-02-11
Funding
National Natural Science Foundation of China(62302146);MOE (Ministry of Education in China) Project of Humanities and Social Sciences(24YJA870011);Fundamental Research Funds for the Central Universities of China(PA2025IISL0104,PA2025GDSK0078)
Affiliations
    1 School of Computer and Information Technology,Hefei University of Technology,Hefei 230601,China
    2 Intelligent Interconnected System Anhui Laboratory (Hefei University of Technology),Hefei 230009,China
    3 Anhui Province Key Laboratory of Industry Safety and Emergency Technology(Hefei University of Technology),Hefei 230009,China
    4 Joint Laboratory of Intelligent Prevention and Recognition of Voice and Video,Hefei 230000,China
References
Share
https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.250570
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT