• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Zuo, Guoyu (Zuo, Guoyu.) (学者:左国玉) | Zhao, Qishen (Zhao, Qishen.) | Huang, Shuai (Huang, Shuai.) | Li, Jiangeng (Li, Jiangeng.) | Gong, Daoxiong (Gong, Daoxiong.)

收录:

SCIE

摘要:

The aim of generative adversarial imitation learning (GAIL) is to allow an agent to learn an optimal policy from demonstrations via an adversarial training process. However, previous works have not considered a realistic setting for complex continuous control tasks such as robot manipulation, in which the available demonstrations are imperfect and possibly originate from different policies. Such a setting poses significant challenges for the application of the GAIL-related methods. This paper proposes a novel imitation learning (IL) algorithm, MD2-GAIL, to enable an agent to learn effectively from imperfect demonstrations by multiple demonstrators. Instead of training the policy from scratch, unsupervised pretraining is used to speed up the adversarial learning process. Confidence scores representing the quality of the demonstrations are utilized to reconstruct the objective function for off-policy adversarial training, making the policy match the optimal occupancy measure. Based on the Soft Actor Critic (SAC) algorithm, MD2-GAIL incorporates the idea of maximum entropy into the process of optimizing the objective function. Meanwhile, a reshaped reward function is adopted to update the agent policy to avoid falling into local optima.Experiments were conducted based on robotic simulation tasks, and the results show that our method can efficiently learn from the available demonstrations and achieves better performance than other state-of-the-art methods. (c) 2021 Elsevier B.V. All rights reserved.

关键词:

Adversarial imitation learning Imperfect demonstrations Multiple demonstrators Robot learning

作者机构:

  • [ 1 ] [Zuo, Guoyu]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Zuo, Guoyu]Beijing Key Lab Comp Intelligence & Intelligent S, Beijing 100124, Peoples R China

通讯作者信息:

  • 左国玉

    [Zuo, Guoyu]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

NEUROCOMPUTING

ISSN: 0925-2312

年份: 2021

卷: 457

页码: 365-376

6 . 0 0 0

JCR@2022

ESI学科: COMPUTER SCIENCE;

ESI高被引阀值:11

被引次数:

WoS核心集被引频次: 2

SCOPUS被引频次: 7

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 3

归属院系:

在线人数/总访问数:2762/2974112
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司