基于DCNN的管制员疲劳状态检测
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

V355.1;TP391.41

基金项目:

中国民用航空飞行学院科研基金(J2018-60);2020年民航教育培训项目“省级教学实验平台提升建设”(2052036);中国民用航空飞行学院大学生创新创业训练计划项目(编号:S202010624094)资助


Controller Fatigue State Detection Based on DCNN
Author:
Affiliation:

Fund Project:

Scientific research fund of Civil Aviation Flight College of China (j2018-60); 2020 civil aviation education and training project "provincial teaching experiment platform promotion construction" (2052036); Supported by the innovation and entrepreneurship training program of Civil Aviation Flight College of China (No.: s202010624094)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    空中交通管制员疲劳工作势必会严重威胁空中交通安全,通过对眼睛睁闭状态判定是现阶段对管制员疲劳检测的一种主要方式。为检测管制员疲劳状态,提出了一种基于迁移学习的DCNN眼睛状态识别模型。首先,利用深度级联神经网络的MTCNN算法检测出管制员面部区域,并实现对面部5个关键点标定和眼睛的定位;然后将检测到的眼睛图像传入到预训练的DCNN眼睛状态分类模型,识别眼睛的睁闭眼状态;最后结合PERCLOSE 80指标检测管制员疲劳状态。分别在ZJU、CEW和ATCE数据集上,对DCNN、VGG16、InceptionV3、ResNet50四种模型的准确率、损失率和F1分数指标进行对比实验。实验结果表明:在ZJU和CEW数据集上,DCNN眼睛状态分类模型检测准确率为97%,较VGG16、InceptionV3、ResNet50等模型进行眼部状态分类任务,DCNN模型的F1分数有3%至7%的提高。在ATCE数据集上DCNN模型检测准确率达到98.35%,F1分数达到98.06%,验证了DCNN模型的有效性与准确性。

    Abstract:

    The fatigue work of air traffic controllers is bound to seriously threaten the air traffic safety. It is a main way to detect the fatigue of air traffic controllers by judging the state of eyes open and closed. In order to detect the controller's fatigue state, a DCNN eye state recognition model based on transfer learning is proposed. Firstly, the MTCNN algorithm of deep cascaded neural network is used to detect the controller's face area. The five key points of the face are calibrated and the eyes are located. Secondly, the detected eye images are transferred to the pre trained DCNN eye state classification model for recognizing the open and closed eyes. Finally, the controller's fatigue state is detected combined with PERCLOSE 80 index. The accuracy, loss rate and F1 score of DCNN, VGG16, InceptionV3 and ResNet50 models were compared on ZJU, CEW and ATCE datasets. Experimental results show that on ZJU and CEW datasets, the detection accuracy of DCNN eye state classification model is 97%, compared with VGG16, InceptionV3, ResNet50 models for eye state classification tasks, DCNN model F1 score has been improved by 3% to 7%. The accuracy of DCNN model detection reached 98.35 percent and the accuracy of F1 score reached 98.06 percent, which verified the validity and accuracy of DCNN model.

    参考文献
    相似文献
    引证文献
引用本文

梁海军,刘长炎,陈宽明,等. 基于DCNN的管制员疲劳状态检测[J]. 科学技术与工程, 2021, 21(35): 15277-15283.
Liang Haijun, Liu Changyan, Chen Kuanming, et al. Controller Fatigue State Detection Based on DCNN[J]. Science Technology and Engineering,2021,21(35):15277-15283.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2021-06-30
  • 最后修改日期:2021-12-02
  • 录用日期:2021-08-26
  • 在线发布日期: 2021-12-20
  • 出版日期:
×
律回春渐,新元肇启|《科学技术与工程》编辑部恭祝新岁!
亟待确认版面费归属稿件,敬请作者关注