融合多头注意力的Wav-MHA民航飞行员语音情感识别模型
DOI:
作者:
作者单位:

中国民用航空飞行学院航空工程学院

作者简介:

通讯作者:

中图分类号:

TP391 TN912.34

基金项目:

国家自然科学基金(52172387);民航局安全能力(ASSA2022/17);中央高校基本科研业务费基金(25CAFUC03097)


A Wav-MHA Model Integrating Multi-Head Attention for Civilian Pilot Speech Emotion Recognition
Author:
Affiliation:

College of aviation engineering,Civil Aviation Flight University of China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对驾驶舱高噪声、低资源环境下飞行员情感识别困难问题,提出一种融合多头注意力的Wav-MHA模型。首先,采用基于信噪比调节的高斯白噪声注入和音高转换进行数据增强,扩充样本并提高泛化能力。其次,以预训练Wav2vec 2.0为骨干,通过分层冻结策略减少参数量,缓解过拟合。随后,引入任务导向型多头注意力模块,聚焦情感关键时序片段,增强特征判别力。最后,在自建六类情感驾驶舱语音数据集PSED上,所提Wav-MHA模型加权准确率达74.89%,尤其对中性和疲劳识别突出。对比实验和消融实验分别验证了模型有效性以及各模块的必要性。跨领域测试中,模型在RAVDESS和EMO-DB上分别取得95 %和87.83%准确率,展现出优异的跨语言迁移与复杂环境适应能力。

    Abstract:

    To address the challenge of recognizing pilot emotions in high-noise, low-resource cockpit environments, this paper proposes Wav-MHA, a model integrating multi-head attention mechanisms. First, data augmentation is performed using Gaussian white noise injection with signal-to-noise ratio adjustment and pitch shifting to expand sample size and improve generalization. Next, a pre-trained Wav2vec 2.0 model serves as the backbone, with a layer-wise freezing strategy applied to reduce parameters and mitigate overfitting. A task-oriented multi-head attention module is then introduced to focus on emotionally salient temporal segments, enhancing feature discriminability. Finally, on the self-constructed six-emotion cockpit speech dataset PSED, the proposed Wav-MHA model achieves a weighted accuracy of 74.89%, with particularly strong performance in recognizing neutral and fatigue states. Comparative and ablation experiments validate the model’s effectiveness and the necessity of each module. In cross-domain tests, the model attains accuracies of 95% and 87.83% on the RAVDESS and EMO-DB datasets, respectively, demonstrating superior cross-linguistic transferability and adaptability to complex environments.

    参考文献
    相似文献
    引证文献
引用本文

陈农田,李琳琳,郭旺旺,等. 融合多头注意力的Wav-MHA民航飞行员语音情感识别模型[J]. 科学技术与工程, , ():

复制
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-03-24
  • 最后修改日期:2026-06-09
  • 录用日期:2026-07-27
  • 在线发布日期:
  • 出版日期:
×
2026年会通知 | “技术经济学驱动智能经济生态构建与治理变革”——中国技术经济学会第三十三届学术年会(2026)会议通知暨征文启事(第一轮)
亟待确认版面费归属稿件,敬请作者关注