基于双目视觉的物料三维空间定位算法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391.9

基金项目:

江西省新能源工艺及装备工程技术研究中心开放基金(JXNE2019-04) ; 江西省科技厅科技计划项目( 20181BBE58006); 科技合作专项项目(20212BDH80008)


Research on three-dimensional Material Positioning Algorithm Based on Binocular Vision
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对移动机械臂抓取物料过程中的三维空间定位问题,提出一种适用于双目视觉的物料定位算法。首先基于双目视觉成像原理,构建手眼矩阵,完成双目相机坐标系到机器人坐标系的转换;其次将注意力机制嵌入到主干网络的CSP结构中,采用一种YOLOv5s+CBAM改进网络结构,在自制的物料数据集上mAP达到99.1%,FPS为71,可实现物料抓取点位置的准确检测;最后针对抓取点立体匹配错误导致深度信息获取错误的问题,提出一种基于灰度值测距的SGBM改进算法获取深度信息。经实验检测,平均测距误差5.16mm,结合目标检测,可实现物料抓取点三维坐标的定位。

    Abstract:

    A material positioning algorithm for binocular vision is proposed.,aiming at the problem of three-dimensional spatial positioning in the process of grasping materials by mechanical?arm. Firstly, based on the principle of binocular vision imaging, the hand eye matrix is constructed to complete the transformation from binocular camera coordinate system to robot coordinate system; Secondly, the attention mechanism is embedded into the CSP structure of the backbone network, and a yolov5s + CBAM is used to improve the network structure. On the self-made material data set, the map is 99.1% and the FPS is 71, which can realize the accurate detection of the position of material grab point; Finally, aiming at the problem of depth information acquisition error caused by grab point stereo matching error, an improved sgbm algorithm based on gray value ranging is proposed to obtain depth information. Through experimental detection, the average ranging error is 5.16mm. Combined with target detection, the three-dimensional coordinate positioning of material grab point can be realized.

    参考文献
    相似文献
    引证文献
引用本文

赵杰,汪志成,黄南海,等. 基于双目视觉的物料三维空间定位算法[J]. 科学技术与工程, 2023, 23(18): 7861-7867.
Zhao Jie, Wang Zhicheng, Huang Nnanhai, et al. Research on three-dimensional Material Positioning Algorithm Based on Binocular Vision[J]. Science Technology and Engineering,2023,23(18):7861-7867.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-09-19
  • 最后修改日期:2023-04-14
  • 录用日期:2022-12-02
  • 在线发布日期: 2023-07-04
  • 出版日期:
×
律回春渐,新元肇启|《科学技术与工程》编辑部恭祝新岁!
亟待确认版面费归属稿件,敬请作者关注