融合D*启发价值场与自适应搜索域的Double Q-learning移动机器人路径规划
DOI:
CSTR:
作者:
作者单位:

内蒙古工业大学机械工程学院

作者简介:

通讯作者:

中图分类号:

TP242

基金项目:

内蒙古自治区自然科学基金(2025MS05094,2025MS06034);国家自然科学基金(52465003);内蒙古自治区教育厅一流学科科研专项项目(YLXKZX-NGD-022),内蒙古自治区直属高校基本科研业务费项目(JY20250077),自治区重点研发和成果转化计划项目(2025YFDZ0057,2025YFHH0118),内蒙古自治区“英才兴蒙”工程创新团队(2025TEL02),


A Double Q-learning Path Planning Method for Mobile Robots Based on D*-Guided Heuristic Value Field and Adaptive Search Domain
Author:
Affiliation:

School of Mechanical Engineering,Inner Mongolia University of Technology

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了解决移动机器人在三维非结构地形中规划路线时,未能充分考虑地面实际限制、强化学习初期探索盲目以及Q-learning易产生价值过估计等问题,本文提出一种融合D*启发价值场与自适应搜索域的Double Q-learning路径规划方法。首先利用地形数据构建可通行性指数,将地形可通行性惩罚,障碍物安全风险惩罚,最大坡度约束引入D*代价函数,生成全局基准路径、D*启发价值场和推荐动作场;依据D*基准路径和局部地形复杂度构建自适应搜索域,并将D*启发价值场与推荐动作嵌入Double Q-learning的Q表初始化、三分支动作选择和奖励函数设计中,以降低无效探索并提高策略收敛稳定性,最后对路径进行平滑。仿真结果表明,所提方法在两组地图中的路径长度相较其他对比算法整体较优,最大坡度均低于安全阈值;消融实验中,完整方法相较无D*引导和搜索域约束的基准方法,地形累计代价和探索栅格数分别降低69.5%和73.1%;综合结果表明,所提方法能够兼顾路径长度、地形通行风险、坡度约束和搜索效率。

    Abstract:

    In order to address the problems of insufficient consideration of terrain constraints, blind exploration in the early stage of reinforcement learning, and value overestimation in Q-learning for mobile robot path planning in three-dimensional unstructured terrain, a Double Q-learning path planning method integrating a D* heuristic value field and an adaptive search domain was proposed. First, a terrain traversability index was constructed from terrain data. The terrain traversability penalty, obstacle safety risk penalty, and maximum slope constraint were incorporated into the D* cost function. A global reference path, a D* heuristic value field, and a recommended action field were then generated. An adaptive search domain was constructed according to the D* reference path and local terrain complexity. The D* heuristic value field and recommended actions were incorporated into Q-table initialization, three-branch action selection, and reward function design. Finally, the planned path was smoothed. Simulation results show that the path lengths obtained by the proposed method on the two maps are generally better than those obtained by the comparison algorithms, and the maximum slopes remain below the safety threshold. In the ablation experiments, the cumulative terrain cost and the number of explored grid cells are reduced by 69.5% and 73.1%, respectively, compared with the baseline method without D* guidance and search-domain constraints. It is concluded that the proposed method can achieve a balance among path length, terrain traversal risk, slope constraints, and search efficiency.

    参考文献
    相似文献
    引证文献
引用本文

唐术锋,黄周平,王鑫,等. 融合D*启发价值场与自适应搜索域的Double Q-learning移动机器人路径规划[J]. 科学技术与工程, , ():

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-06-02
  • 最后修改日期:2026-08-25
  • 录用日期:2026-09-09
  • 在线发布日期:
  • 出版日期:
×
关于抵制伪造参考文献学术不端行为的声明
关于规范使用生成式人工智能的声明
喜报|《科学技术与工程》3篇论文成功入选 “第二十八届中国科协年会影响力提名论文”
2026年会通知 | “技术经济学驱动智能经济生态构建与治理变革”——中国技术经济学会第三十三届学术年会(2026)会议通知暨征文启事(第一轮)
亟待确认版面费归属稿件,敬请作者关注