基于多尺度感受野与频域通道时频特征融合的语音增强方法
DOI:
CSTR:
作者:
作者单位:

桂林电子科技大学信息与通信学院

作者简介:

通讯作者:

中图分类号:

TN912.35

基金项目:

国家自然科学基金(62064003、60961009);认知无线电与信息处理教育部重点实验室项目(CRKL230103);桂林电子科技大学研究生教育创新计划项目(项目编号:2025YCXS040)。


A speech enhancement method based on multi-scale receptive field and time-frequency feature fusion of frequency-domain channels
Author:
Affiliation:

College of Information and Communication, Guilin University of Electronic Science and Technology

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对复杂噪声环境下语音时频特征易受干扰、局部细节保持不足及长程依赖建模不充分等问题,本文提出一种基于多尺度感受野与频域通道时频特征融合的语音增强方法。首先,针对仅依赖固定卷积核容易造成感受野单一,难以兼顾局部细节和较大范围上下文的问题,该模型引入渐进式多阶段特征感知(Progressive Multi-stage Feature Perception, PMFP)模块,通过多感受野结构聚合不同尺度的局部上下文信息,增强网络对语音细节和噪声形态变化的感知能力。其次,针对全局建模不足以及相位恢复依赖含噪相位的问题,通过全局频域卷积(Global Frequency-Domain Convolution, GFDC)模块、并行双注意力聚合(Parallel Dual Attention Aggregation, PDAA)模块,在频域直接进行全局卷积建模,补足局部特征的不足;同时,增强对关键时频区域的关注,并有助于建模长距离依赖关系。在解码阶段采用相位直接预测策略,通过并行回归实部与虚部并结合atan2运算获得相位估计,降低对含噪相位信息的依赖,从而有助于减少相位伪影。在VoiceBank+DEMAND数据集上进行测试,实验结果表明,所提网络的语音质量感知评估达3.52,短时客观可懂度达96%,表明该网络能够有效地改善语音信号的整体质量,具有较好的降噪能力;选取未参与训练的TIMIT语音及多种未见噪声开展跨数据集泛化实验,结果表明模型具有良好的泛化能力与鲁棒性;此外,基于AISHELL-1干净中文语音与RealMAN真实环境噪声构建的跨域测试集,进一步验证了所提方法面向国内实际声学场景的适用性。

    Abstract:

    A speech enhancement method is proposed in this paper to address the issues of susceptible time-frequency features and insufficient local detail retention in complex noise environments. The proposed method is based on multi-scale receptive field and frequency-domain channel time-frequency feature fusion. To overcome the limitation of a single receptive field caused by fixed convolution kernels, a progressive multi-stage feature awareness module is introduced. This module aggregates contextual information from different scales, enhancing the perception of speech details and noise variations. Subsequently, a global frequency domain convolution module and parallel dual attention aggregation module are utilized to perform global convolution in the frequency domain. This compensates for the lack of global modeling and avoids dependence on noisy phases for reconstruction. At the same time, enhance the focus on key time-frequency areas and help to model long-distance dependencies. In the decoding phase, the phase direct prediction strategy is adopted, and the phase estimation is obtained through parallel regression of the real part and the imaginary part, combined with atan2 operation, to reduce the dependence on noisy phase information, thus helping to reduce phase artifacts. Finally, experiments were conducted on the VoiceBank+DEMAND dataset. The results show that the proposed network achieves a PESQ score of 3.52 and a STOI of 96%. It shows that the network can effectively improve the overall quality of voice signals, and has good noise reduction ability. We selected TIMIT speech that did not participate in the training and a variety of non noise to conduct cross dataset generalization experiments. The results show that the model has good generalization ability and robustness.In addition, a cross-domain test set constructed using clean Mandarin speech from AISHELL-1 and real-world environmental noise from RealMAN further validates the applicability of the proposed method to practical real-world acoustic scenarios.

    参考文献
    相似文献
    引证文献
引用本文

郑展恒,李巍,王健,等. 基于多尺度感受野与频域通道时频特征融合的语音增强方法[J]. 科学技术与工程, , ():

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-06-16
  • 最后修改日期:2026-08-31
  • 录用日期:2026-09-14
  • 在线发布日期:
  • 出版日期:
×
关于抵制伪造参考文献学术不端行为的声明
关于规范使用生成式人工智能的声明
喜报|《科学技术与工程》3篇论文成功入选 “第二十八届中国科协年会影响力提名论文”
2026年会通知 | “技术经济学驱动智能经济生态构建与治理变革”——中国技术经济学会第三十三届学术年会(2026)会议通知暨征文启事(第一轮)
亟待确认版面费归属稿件,敬请作者关注