基于Q学习参数辨识的动物学习能力评价方法
DOI:
作者:
作者单位:

郑州大学电气工程学院

作者简介:

通讯作者:

中图分类号:

Q811.211

基金项目:

国家自然科学基金项目(面上项目,重点项目,重大项目)


A Method of Evaluating Animal Learning Ability Based on Q-learning Parameter Identification
Author:
Affiliation:

School of Electrical Engineering, Zhengzhou University

Fund Project:

The National Natural Science Foundation of China (General Program, Key Program, Major Research Plan)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 文章评论
    摘要:

    动物在特定环境下对行为决策的学习能力是其生存的重要基础,因此,如何准确地评价动物在马尔科夫决策任务中利用过去经验与重视未来奖励的学习能力,对于动物行为学与心理学研究至关重要。设置了含有状态转移概率的马尔科夫决策任务,训练家鸽在不同状态下从两个选项中做出选择,并考虑未来收益,以最大化累计奖励。实验结束后,对家鸽的行为决策进行Q-learning建模,用学习率α评估其利用过去积累经验做出选择的能力,用折扣因子γ评估其对未来奖励的重视程度。结果表明,家鸽在马尔科夫决策任务中利用过去经验与重视未来奖励的学习能力可以通过Q-learning模型参数进行评价。

    Abstract:

    The ability of animals to learn behavioral decisions in a specific environment is an important basis for their survival, therefore,how to accurately evaluate the learning ability between using past experience and valuing future reward of animals in Markov decision-making tasks is important for animal behavior and psychology. A Markov decision task with state transition probability was designed, Pigeons were trained to choose between two options in different states and consider future benefits to maximize cumulative rewards. At the end of the experiment, Q-learning model of pigeons’ behavioral decision-making was modeled, and the learning rate was used to evaluate their ability to make choices based on past experience, and the discount factor was used to evaluate their emphasis on future rewards. The results shows that the learning ability between using past experience and valuing future reward of pigeons in Markov decision-making tasks could be evaluated by Q-learning model parameters.

    参考文献
    相似文献
    引证文献
引用本文

冯浩然. 基于Q学习参数辨识的动物学习能力评价方法[J]. 科学技术与工程, , ():

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-01-14
  • 最后修改日期:2022-05-09
  • 录用日期:2022-05-13
  • 在线发布日期:
  • 出版日期:
×
关于近期《科学技术与工程》编辑部居家办公的说明
亟待确认的版面费信息