参数并行:一种基于群启发式算法的机器学习参数寻优方法
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP399

基金项目:


Parallel Parameters: A Method for Optimizing Machine Learning Parameters Based on Swarm Heuristic Alogorithm
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对机器学习算法超参数寻优效率低的问题和参数寻优主流算法的特点,提出了一种基于参数并行机制的机器学参数寻优方法。该方法利用群启发式算法来进行机器学习算法的参数寻优,将种群转换为Spark平台特有的弹性分布式数据集,针对参数寻优耗时特点并行计算种群中个体适应度。选取随机森林和遗传算法作为实验算法设计了多组实验对所提出的学习训练方法进行验证。实验结果表明,在20万条以下的小数据量下,文中提出的基于参数并行机制的机器学习参数寻优方法与基于数据并行机制的机器学习参数寻优方法相比,运行时间最多能够减少2个小时,并具有良好的可扩展性。

    Abstract:

    Aiming at the low efficiency of hyperparameter optimization of machine learning algorithms and the characteristics of mainstream parameter optimization algorithms, a machine learning parameter optimization method based on parameter parallel mechanism is proposed. This method uses the swarm heuristic algorithm to optimize the parameters of the machine learning algorithm, converts the population into a flexible distributed data set unique to the Spark platform, and calculates the fitness of individuals in the population in parallel. The IC card data of Guangzhou buses are selected as experimental data, random forest and genetic algorithm are used as experimental algorithms, and multiple sets of experiments are designed to verify the proposed learning and training method. The experimental results show that, under the small amount of data, the machine learning parameter optimization method based on the parameter parallel mechanism proposed in this paper can reduce the running time by up to 2 hours and has good scalability compared with the machine learning training method based on the data parallel mechanism.

    参考文献
    相似文献
    引证文献
引用本文

杨艳艳,李雷孝,林浩,等. 参数并行:一种基于群启发式算法的机器学习参数寻优方法[J]. 科学技术与工程, 2022, 22(5): 1972-1980.
Yang Yanyan, Li Leixiao, Lin Hao, et al. Parallel Parameters: A Method for Optimizing Machine Learning Parameters Based on Swarm Heuristic Alogorithm[J]. Science Technology and Engineering,2022,22(5):1972-1980.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2021-06-02
  • 最后修改日期:2021-09-17
  • 录用日期:2021-10-11
  • 在线发布日期: 2022-02-10
  • 出版日期:
×
律回春渐,新元肇启|《科学技术与工程》编辑部恭祝新岁!
亟待确认版面费归属稿件,敬请作者关注