• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Ha, Mingming (Ha, Mingming.) | Wang, Ding (Wang, Ding.) (学者:王鼎) | Liu, Derong (Liu, Derong.)

收录:

EI Scopus SCIE

摘要:

In this work, the generalized value iteration with a discount factor is developed for optimal control of discrete-time nonlinear systems, which is initialized with a positive definite value function rather than zero. The convergence analysis of the discounted value function sequence is provided. The condition for the discount factor is given to guarantee the stability of the controlled plants. With this operation, the iterative control policy that asymptotically stabilizes the closed-loop system can be determined. The introduction of a discount factor has eased some conditions that the system dynamics and the initialization of the generalized value iteration need to fulfill. It is not required that the initial control policy is stabilizing. In the iteration process, under some conditions, if the system is asymptotically stable at the current iteration, then it can be guaranteed that the iterative control policies after this current iteration step also are stabilizing. It is convenient and practical to evaluate the asymptotic stability of the closed-loop system using the iterative control policy. A numerical example with physical background is carried out to validate the present results. (C) 2020 Elsevier B.V. All rights reserved.

关键词:

Nonlinear systems Adaptive dynamic programming Generalized value iteration Admissible control policy Discounted optimal control Reinforcement learning

作者机构:

  • [ 1 ] [Ha, Mingming]Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
  • [ 2 ] [Wang, Ding]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Wang, Ding]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 4 ] [Liu, Derong]Univ Illinois, Dept Elect & Comp Engn, Chicago, IL 60607 USA

通讯作者信息:

  • 王鼎

    [Wang, Ding]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China

查看成果更多字段

相关关键词:

来源 :

SYSTEMS & CONTROL LETTERS

ISSN: 0167-6911

年份: 2021

卷: 147

2 . 6 0 0

JCR@2022

ESI学科: ENGINEERING;

ESI高被引阀值:87

JCR分区:2

被引次数:

WoS核心集被引频次: 5

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:439/4968653
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司