收藏切换
Dual-Branch Speech Enhancement Neural Network with Convolutional Enhancement Window Attention
收藏切换
Chenhui Zhang, Zhi'an Yuan, Yuhua Qian*
Journal of Computer Research and Development | 2025, 62(4) : 852 - 862
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(4): 852-862
• Artificial Intelligence •
Dual-Branch Speech Enhancement Neural Network with Convolutional Enhancement Window Attention
Full
Chenhui Zhang, Zhi'an Yuan, Yuhua Qian*
Affiliations
  • Institute of Big Data Science and Industry, Shanxi university, Taiyuan 030006
  • Shanxi Machine Vision and data Mining Engineering Research Center (Shanxi university), Taiyuan 030006
  • born in 1999. Master candidate. Student member of CCF. His main research interest includes speech enhancement

    born in 1998. PhD candidate. Student member of CCF. His main research interests include signal enhancement and machine learning

    born in 1976. PhD, professor, PhD supervisor. Member of CCF. His main research interests include artificial intelligence, big data, machine learning and data mining

About Author:

born in 1999. Master candidate. Student member of CCF. His main research interest includes speech enhancement

born in 1998. PhD candidate. Student member of CCF. His main research interests include signal enhancement and machine learning

born in 1976. PhD, professor, PhD supervisor. Member of CCF. His main research interests include artificial intelligence, big data, machine learning and data mining

Published: 2025-04-01 doi: 10.7544/issn1000-1239.202330751
Outline
收藏切换

In complex environments and under sudden background noise conditions, speech enhancement tasks are extremely challenging due to the limited capturing of spectrogram features by existing methods, especially in capturing local information of the spectrogram. Previous work on Transformer models primarily focused on global information of the audio while neglecting the importance of local information. Many models only utilized the magnitude information and ignored the phase information after the audio underwent short-time Fourier transform (STFT), resulting in suboptimal capturing of spectrogram features and unsatisfactory speech enhancement results. Based on this, we propose a dual-branch speech enhancement neural network with convolutional enhancement window attention. The model adopts a U-NET architecture and simultaneously models the magnitude and phase information of the audio through the dual-branch structure. A complex computation module is introduced for information interaction between the two branches. The convolutional enhancement window attention module is employed in the skip-connection part between the encoder and decoder layers. It performs self-attention based on non-overlapping windows, significantly reducing the computational complexity of the speech enhancement model while capturing local contextual information. The proposed model is evaluated on the publicly available Voicebank-Demand dataset. Compared with the baseline models DCUNET 16 and DCUNET20, the proposed model achieves improvements of 0.51 and 0.47, respectively, in PESQ (perceptual evaluation of speech quality) metric. Other evaluation metrics also show significant enhancements. Compared with various existing speech enhancement models, the proposed model outperforms them in various metrics, particularly demonstrating remarkable improvements in PESQ scores.

speech enhancement  /  dual-branch network  /  spectrogram features  /  convolutional enhancement window attention  /  global information  /  local information
张晨辉, 原之安, 钱宇华. 结合卷积增强窗口注意力的双分支语音增强神经网络. 计算机研究与发展, 2025 , 62 (4) : 852 -862 . DOI: 10.7544/issn1000-1239.202330751
Chenhui Zhang, Zhi'an Yuan, Yuhua Qian. Dual-Branch Speech Enhancement Neural Network with Convolutional Enhancement Window Attention[J]. Journal of Computer Research and Development, 2025 , 62 (4) : 852 -862 . DOI: 10.7544/issn1000-1239.202330751
Year 2025 volume 62 Issue 4
111
52
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330751
  • Receive Date:2023-09-20
  • Online Date:2026-11-10
  • Published:2025-04-01
Article Data
Affiliations
History
  • Received:2023-09-20
  • Revised:2024-11-19
  • Accepted:2025-01-08
Affiliations
    Institute of Big Data Science and Industry, Shanxi university, Taiyuan 030006
    Shanxi Machine Vision and data Mining Engineering Research Center (Shanxi university), Taiyuan 030006
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330751
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT