• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索
高影响力成果及被引频次趋势图 关键词云图及合作者关系图
排序方式:
默认
  • 默认
  • 标题
  • 年份
  • WOS被引数
  • 影响因子
  • 正序
  • 倒序
< 页,共 2 >
Generalized value iteration for discounted optimal control with stability analysis EI
期刊论文 | 2021 , 147 | Systems and Control Letters
摘要&关键词 引用

摘要 :

In this work, the generalized value iteration with a discount factor is developed for optimal control of discrete-time nonlinear systems, which is initialized with a positive definite value function rather than zero. The convergence analysis of the discounted value function sequence is provided. The condition for the discount factor is given to guarantee the stability of the controlled plants. With this operation, the iterative control policy that asymptotically stabilizes the closed-loop system can be determined. The introduction of a discount factor has eased some conditions that the system dynamics and the initialization of the generalized value iteration need to fulfill. It is not required that the initial control policy is stabilizing. In the iteration process, under some conditions, if the system is asymptotically stable at the current iteration, then it can be guaranteed that the iterative control policies after this current iteration step also are stabilizing. It is convenient and practical to evaluate the asymptotic stability of the closed-loop system using the iterative control policy. A numerical example with physical background is carried out to validate the present results. © 2020 Elsevier B.V.

关键词 :

Asymptotic stability Asymptotic stability Closed loop systems Closed loop systems Discrete time control systems Discrete time control systems

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Ha, Mingming , Wang, Ding , Liu, Derong . Generalized value iteration for discounted optimal control with stability analysis [J]. | Systems and Control Letters , 2021 , 147 .
MLA Ha, Mingming 等. "Generalized value iteration for discounted optimal control with stability analysis" . | Systems and Control Letters 147 (2021) .
APA Ha, Mingming , Wang, Ding , Liu, Derong . Generalized value iteration for discounted optimal control with stability analysis . | Systems and Control Letters , 2021 , 147 .
导入链接 NoteExpress RIS BibTex
Neural-network-based discounted optimal control via an integrated value iteration with accuracy guarantee SCIE
期刊论文 | 2021 , 144 , 176-186 | NEURAL NETWORKS
WoS核心集被引次数: 15
摘要&关键词 引用

摘要 :

A data-based value iteration algorithm with the bidirectional approximation feature is developed for discounted optimal control. The unknown nonlinear system dynamics is first identified by establishing a model neural network. To improve the identification precision, biases are introduced to the model network. The model network with biases is trained by the gradient descent algorithm, where the weights and biases across all layers are updated. The uniform ultimate boundedness stability with a proper learning rate is analyzed, by using the Lyapunov approach. Moreover, an integrated value iteration with the discounted cost is developed to fully guarantee the approximation accuracy of the optimal value function. Then, the effectiveness of the proposed algorithm is demonstrated by carrying out two simulation examples with physical backgrounds. (C) 2021 Elsevier Ltd. All rights reserved.

关键词 :

Adaptive dynamic programming Adaptive dynamic programming Data-based discounted optimal control Data-based discounted optimal control Lyapunov method Lyapunov method Uniformly ultimately bounded stability Uniformly ultimately bounded stability Value iteration Value iteration

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Ha, Mingming , Wang, Ding , Liu, Derong . Neural-network-based discounted optimal control via an integrated value iteration with accuracy guarantee [J]. | NEURAL NETWORKS , 2021 , 144 : 176-186 .
MLA Ha, Mingming 等. "Neural-network-based discounted optimal control via an integrated value iteration with accuracy guarantee" . | NEURAL NETWORKS 144 (2021) : 176-186 .
APA Ha, Mingming , Wang, Ding , Liu, Derong . Neural-network-based discounted optimal control via an integrated value iteration with accuracy guarantee . | NEURAL NETWORKS , 2021 , 144 , 176-186 .
导入链接 NoteExpress RIS BibTex
Adaptive-critic-based hybrid intelligent optimal tracking for a class of nonlinear discrete-time systems SCIE
期刊论文 | 2021 , 105 | ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE
WoS核心集被引次数: 18
摘要&关键词 引用

摘要 :

In this paper, a hybrid intelligent tracking control approach is developed to address optimal tracking problems for a class of nonlinear discrete-time systems. The generalized value iteration algorithm is utilized to attain the admissible tracking control with off-line training, while the on-line near-optimal control method is established to enhance the control performance. It is emphasized that the value iteration performance is improved by introducing the acceleration factor. By collecting the input-output data of the unknown system plant, the model neural network is constructed to provide the partial derivative of the system state with respect to the control law as the approximate control matrix. A novel computational strategy is introduced to obtain the steady control of the reference trajectory. The critic and action neural networks are utilized to approximate the cost function and the tracking control, respectively. Considering approximation errors of neural networks, the stability analysis of the specific systems is provided via the Lyapunov approach. Finally, two numerical examples with industrial application backgrounds are involved for verifying the effectiveness of the proposed approach.

关键词 :

Accelerated generalized value iteration Accelerated generalized value iteration Adaptive critic Adaptive critic Industrial applications Industrial applications Intelligent optimal tracking control Intelligent optimal tracking control Neural networks Neural networks

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Wang, Ding , Zhao, Mingming , Ha, Mingming et al. Adaptive-critic-based hybrid intelligent optimal tracking for a class of nonlinear discrete-time systems [J]. | ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE , 2021 , 105 .
MLA Wang, Ding et al. "Adaptive-critic-based hybrid intelligent optimal tracking for a class of nonlinear discrete-time systems" . | ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 105 (2021) .
APA Wang, Ding , Zhao, Mingming , Ha, Mingming , Hu, Lingzhi . Adaptive-critic-based hybrid intelligent optimal tracking for a class of nonlinear discrete-time systems . | ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE , 2021 , 105 .
导入链接 NoteExpress RIS BibTex
Data-Driven Iterative Adaptive Critic Control Toward an Urban Wastewater Treatment Plant SCIE
期刊论文 | 2021 , 68 (8) , 7362-7369 | IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
WoS核心集被引次数: 134
摘要&关键词 引用

摘要 :

The wastewater treatment is an important avenue of resources cyclic utilization when coping with the modern urban diseases. However, there always exist obvious nonlinearities and uncertainties within wastewater treatment systems, such that it is difficult to accomplish proper optimization objectives toward these complex unknown platforms. In this article, a data-driven iterative adaptive critic (IAC) strategy is developed to address the nonlinear optimal control problem. The iterative algorithm is constructed with a general framework, followed by convergence analysis and neural network implementation. Remarkably, the derived IAC control policy with an additional steady control input is also applied to a typical wastewater treatment plant, rendering that the dissolved oxygen concentration and the nitrate level are maintained at desired setting points. When compared with the incremental proportional-integral-derivative method, it is found that faster response and less oscillation can be obtained during the IAC control process.

关键词 :

Adaptive systems Adaptive systems Cost function Cost function Data-driven control Data-driven control iterative adaptive critic (IAC) iterative adaptive critic (IAC) Iterative methods Iterative methods learning systems learning systems Optimal control Optimal control optimal regulation optimal regulation Recycling Recycling Wastewater Wastewater wastewater treatment wastewater treatment Wastewater treatment Wastewater treatment

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Wang, Ding , Ha, Mingming , Qiao, Junfei . Data-Driven Iterative Adaptive Critic Control Toward an Urban Wastewater Treatment Plant [J]. | IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS , 2021 , 68 (8) : 7362-7369 .
MLA Wang, Ding et al. "Data-Driven Iterative Adaptive Critic Control Toward an Urban Wastewater Treatment Plant" . | IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS 68 . 8 (2021) : 7362-7369 .
APA Wang, Ding , Ha, Mingming , Qiao, Junfei . Data-Driven Iterative Adaptive Critic Control Toward an Urban Wastewater Treatment Plant . | IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS , 2021 , 68 (8) , 7362-7369 .
导入链接 NoteExpress RIS BibTex
Discounted near-optimal regulation of constrained nonlinear systems via generalized value iteration SCIE
期刊论文 | 2021 , 31 (17) , 8481-8503 | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL
WoS核心集被引次数: 8
摘要&关键词 引用

摘要 :

In this article, a generalized value iteration algorithm is developed to address the discounted near-optimal control problem for discrete-time systems with control constraints. The initial cost function is permitted to be an arbitrary positive semi-definite function without being zero. First, a nonquadratic performance functional is utilized to overcome the challenge caused by saturating actuators. Then, the monotonicity and convergence of the iterative cost function sequence with the discount factor are analyzed. For facilitating the implementation of the iterative algorithm, two neural networks with Levenberg-Marquardt training algorithm are constructed to approximate the cost function and the control law. Furthermore, the initial control law is obtained by employing the fixed point iteration approach. Finally, two simulation examples are provided to validate the feasibility of the present strategy. It is emphasized that the established control laws are successfully constrained for randomly given initial state vectors.

关键词 :

adaptive critic adaptive critic control constraints control constraints convergence analysis convergence analysis discounted optimal control discounted optimal control generalized value iteration generalized value iteration

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Wang, Ding , Zhao, Mingming , Ha, Mingming et al. Discounted near-optimal regulation of constrained nonlinear systems via generalized value iteration [J]. | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL , 2021 , 31 (17) : 8481-8503 .
MLA Wang, Ding et al. "Discounted near-optimal regulation of constrained nonlinear systems via generalized value iteration" . | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL 31 . 17 (2021) : 8481-8503 .
APA Wang, Ding , Zhao, Mingming , Ha, Mingming , Qiao, Junfei . Discounted near-optimal regulation of constrained nonlinear systems via generalized value iteration . | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL , 2021 , 31 (17) , 8481-8503 .
导入链接 NoteExpress RIS BibTex
Neural optimal tracking control of constrained nonaffine systems with a wastewater treatment application SCIE
期刊论文 | 2021 , 143 , 121-132 | NEURAL NETWORKS
WoS核心集被引次数: 38
摘要&关键词 引用

摘要 :

In this paper, we aim to solve the optimal tracking control problem for a class of nonaffine discrete-time systems with actuator saturation. First, a data-based neural identifier is constructed to learn the unknown system dynamics. Then, according to the expression of the trained neural identifier, we can obtain the steady control corresponding to the reference trajectory. Next, by involving the iterative dual heuristic dynamic programming algorithm, the new costate function and the tracking control law are developed. Two other neural networks are used to estimate the costate function and approximate the tracking control law. Considering approximation errors of neural networks, the stability analysis of the proposed algorithm for the specific systems is provided by introducing the Lyapunov approach. Finally, via conducting simulation and comparison, the superiority of the developed optimal tracking method is confirmed. Moreover, the trajectory tracking performance of the wastewater treatment application is also involved for further verifying the proposed approach. (C) 2021 Elsevier Ltd. All rights reserved.

关键词 :

Actuator saturation Actuator saturation Adaptive critic Adaptive critic Neural networks Neural networks Optimal tracking control Optimal tracking control Wastewater treatment Wastewater treatment

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Wang, Ding , Zhao, Mingming , Ha, Mingming et al. Neural optimal tracking control of constrained nonaffine systems with a wastewater treatment application [J]. | NEURAL NETWORKS , 2021 , 143 : 121-132 .
MLA Wang, Ding et al. "Neural optimal tracking control of constrained nonaffine systems with a wastewater treatment application" . | NEURAL NETWORKS 143 (2021) : 121-132 .
APA Wang, Ding , Zhao, Mingming , Ha, Mingming , Ren, Jin . Neural optimal tracking control of constrained nonaffine systems with a wastewater treatment application . | NEURAL NETWORKS , 2021 , 143 , 121-132 .
导入链接 NoteExpress RIS BibTex
Intelligent optimal tracking with asymmetric constraints of a nonlinear wastewater treatment system SCIE
期刊论文 | 2021 , 31 (14) , 6773-6787 | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL
WoS核心集被引次数: 30
摘要&关键词 引用

摘要 :

The wastewater treatment is an effective method for alleviating the shortage of water resources. In this article, a data-driven iterative adaptive tracking control approach is developed to improve the control performance of the dissolved oxygen concentration and the nitrate nitrogen concentration in the nonlinear wastewater treatment plant. First, the model network is established to obtain the steady control and evaluate the new system state. Then, a nonquadratic performance functional is provided to handle asymmetric control constraints. Moreover, the new costate function and the tracking control policy are derived by using the dual heuristic dynamic programming algorithm. In the present control scheme, two neural networks are constructed to approximate the costate function and the tracking control law. Finally, the feasibility of the proposed algorithm is confirmed by applying the designed strategy to the wastewater treatment plant.

关键词 :

adaptive critic adaptive critic asymmetric control constraints asymmetric control constraints intelligent optimal tracking intelligent optimal tracking nonlinear control nonlinear control wastewater treatment wastewater treatment

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Wang, Ding , Zhao, Mingming , Qiao, Junfei . Intelligent optimal tracking with asymmetric constraints of a nonlinear wastewater treatment system [J]. | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL , 2021 , 31 (14) : 6773-6787 .
MLA Wang, Ding et al. "Intelligent optimal tracking with asymmetric constraints of a nonlinear wastewater treatment system" . | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL 31 . 14 (2021) : 6773-6787 .
APA Wang, Ding , Zhao, Mingming , Qiao, Junfei . Intelligent optimal tracking with asymmetric constraints of a nonlinear wastewater treatment system . | INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL , 2021 , 31 (14) , 6773-6787 .
导入链接 NoteExpress RIS BibTex
Improved Adaptive Critic for Neural Optimal Control of Constrained Nonlinear Discrete-Time Systems CPCI-S
会议论文 | 2020 , 1934-1939 | 39th Chinese Control Conference (CCC)
摘要&关键词 引用

摘要 :

There always exist approximation errors during neural network control processes, which may cause the estimation value to exceed the control constraint when the optimal control input reaches to a neighborhood of the constraint. In this paper, through a new neural network training approach, the near-optimal control problem for a class of nonlinear discrete-time systems with control constraints is solved. Based on the nonquadratic performance index and the dual heuristic dynamic programming scheme, the iterative algorithm is developed with convergence guarantee and is also implemented by using three neural networks. At last, two examples are given to demonstrate the effectiveness of the proposed optimal control scheme.

关键词 :

iterative adaptive critic iterative adaptive critic control constraints control constraints neural networks neural networks Adaptive dynamic programming Adaptive dynamic programming nonlinear discrete-time systems nonlinear discrete-time systems

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Zhao, Mingming , Wang, Ding , Ha, Mingming . Improved Adaptive Critic for Neural Optimal Control of Constrained Nonlinear Discrete-Time Systems [C] . 2020 : 1934-1939 .
MLA Zhao, Mingming et al. "Improved Adaptive Critic for Neural Optimal Control of Constrained Nonlinear Discrete-Time Systems" . (2020) : 1934-1939 .
APA Zhao, Mingming , Wang, Ding , Ha, Mingming . Improved Adaptive Critic for Neural Optimal Control of Constrained Nonlinear Discrete-Time Systems . (2020) : 1934-1939 .
导入链接 NoteExpress RIS BibTex
A Neural Policy Learning Method for Robust Stabilization of Uncertain Nonlinear Systems CPCI-S
会议论文 | 2020 , 987-992 | Chinese Automation Congress (CAC)
摘要&关键词 引用

摘要 :

In this paper, a neural-network-based policy learning method is established to solve robust stabilization for a class of continuous-time nonlinear systems with both internal dynamic uncertainties and input matrix uncertainties. First, the robust stabilization problem is converted to an optimal control problem by choosing an appropriate cast function and proving system stability. Then, in order to solve the Hamilton-Jacobi-Bellman equation, a policy iteration algorithm is employed by constructing and training a critic neural network. The approximate optimal control policy can be obtained by this algorithm, and the solution of the robust stabilization can he derived as well. Finally, a numerical example and an experimental simulation are provided to verify the availability of the proposed strategy.

关键词 :

intelligent control intelligent control Neural critic learning Neural critic learning uncertain nonlinear systems uncertain nonlinear systems robust stabilization robust stabilization adaptive dynamic programming adaptive dynamic programming

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Xu, Xin , Wang, Ding . A Neural Policy Learning Method for Robust Stabilization of Uncertain Nonlinear Systems [C] . 2020 : 987-992 .
MLA Xu, Xin et al. "A Neural Policy Learning Method for Robust Stabilization of Uncertain Nonlinear Systems" . (2020) : 987-992 .
APA Xu, Xin , Wang, Ding . A Neural Policy Learning Method for Robust Stabilization of Uncertain Nonlinear Systems . (2020) : 987-992 .
导入链接 NoteExpress RIS BibTex
Value-Iteration-Based Neuro-Optimal Tracking Control for Affine Systems with Completely Unknown Dynamics CPCI-S
会议论文 | 2020 , 1951-1956 | 39th Chinese Control Conference (CCC)
WoS核心集被引次数: 4
摘要&关键词 引用

摘要 :

In this paper, the versatile value-iteration-based control method, aimed at affine systems with unknown dynamics, is proposed to deal with the optimal tracking control problem. Neural networks are adopted to approximate system dynamics and a novel approach is presented to estimate the steady state control input based on the established identifier. Additionally, two other neural networks, called the critic network and the action network, are used to implement the optimal tracking control algorithm. Finally, based on the proposed method, the tracking controller is designed to control a specific simulation example. It is shown that, for any randomly given initial state vector, the controller is able to make the affine system track the reference trajectory without knowing the system dynamics.

关键词 :

Adaptive Dynamic Programming Adaptive Dynamic Programming Affine Systems with Unknown Dynamics Affine Systems with Unknown Dynamics Neuro-Optimal Tracking Control Neuro-Optimal Tracking Control Value Iteration Value Iteration

引用:

复制并粘贴一种已设定好的引用格式,或利用其中一个链接导入到文献管理软件中。

GB/T 7714 Ha, Mingming , Wang, Ding , Liu, Derong . Value-Iteration-Based Neuro-Optimal Tracking Control for Affine Systems with Completely Unknown Dynamics [C] . 2020 : 1951-1956 .
MLA Ha, Mingming et al. "Value-Iteration-Based Neuro-Optimal Tracking Control for Affine Systems with Completely Unknown Dynamics" . (2020) : 1951-1956 .
APA Ha, Mingming , Wang, Ding , Liu, Derong . Value-Iteration-Based Neuro-Optimal Tracking Control for Affine Systems with Completely Unknown Dynamics . (2020) : 1951-1956 .
导入链接 NoteExpress RIS BibTex
每页显示 10| 20| 50 条结果
< 页,共 2 >

导出

数据:

选中

格式:
在线人数/总访问数:421/2884212
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司