Global Adaptive Dynamic Programming for Continuous-Time Nonlinear Systems
Yu Jiang,Zhong-Ping Jiang +1 more
255
TL;DR: In this article, a novel method of global adaptive dynamic programming (ADP) for the adaptive optimal control of nonlinear polynomial systems is presented, which consists of relaxing the problem of solving the Hamilton-Jacobi-Bellman (HJB) equation to an optimization problem, which is solved via a new policy iteration method.
read more
Abstract: This paper presents a novel method of global adaptive dynamic programming (ADP) for the adaptive optimal control of nonlinear polynomial systems. The strategy consists of relaxing the problem of solving the Hamilton-Jacobi-Bellman (HJB) equation to an optimization problem, which is solved via a new policy iteration method. The proposed method distinguishes from previously known nonlinear ADP methods in that the neural network approximation is avoided, giving rise to significant computational improvement. Instead of semiglobally or locally stabilizing, the resultant control policy is globally stabilizing for a general class of nonlinear polynomial systems. Furthermore, in the absence of the a priori knowledge of the system dynamics, an online learning method is devised to implement the proposed policy iteration technique by generalizing the current ADP theory. Finally, three numerical examples are provided to validate the effectiveness of the proposed method.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Adaptive Dynamic Programming for Control: A Survey and Recent Advances
TL;DR: In this article, the adaptive dynamic programming (ADP) with applications in control is reviewed, and the use of ADP to solve game problems, mainly nonzero-sum game problems is elaborated.
500
Observer-Based Adaptive Fuzzy Decentralized Optimal Control Design for Strict-Feedback Nonlinear Large-Scale Systems
TL;DR: It is shown that the proposed adaptive fuzzy decentralized optimal control approach can guarantee that all the signals in the closed-loop system are bounded, and the tracking errors converge to a small neighborhood of zero.
465
Adaptive Critic Nonlinear Robust Control: A Survey
Ding Wang,Haibo He,Derong Liu +2 more
TL;DR: This survey reviews the recent main results of adaptive-critic-based robust control design of continuous-time nonlinear systems and promotes the development of adaptive critic control methods with robustness guarantee and the construction of higher level intelligent systems.
375
Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems
Weinan Gao,Zhong-Ping Jiang +1 more
TL;DR: This note studies the adaptive optimal output regulation problem for continuous-time linear systems, which aims to achieve asymptotic tracking and disturbance rejection by minimizing some predefined costs by employing reinforcement learning and adaptive dynamic programming techniques.
358
Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control
F. Sapuppo,Florinda Schembri,Luigi Fortuna,Maide Bucolo +3 more
- 01 Jan 2009
TL;DR: A transversal view through microfluidics theory and applications, covering different kinds of phenomena, from continuous to multiphase flow, and a vision of two phasemicrofluidic phenomena is given through nonlinear analyses applied to experimental time series.
266
References
•Book
Reinforcement Learning: An Introduction
Richard S. Sutton,Andrew G. Barto +1 more
- 01 Jan 1988
TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
Multilayer feedforward networks are universal approximators
TL;DR: It is rigorously established that standard multilayer feedforward networks with as few as one hidden layer using arbitrary squashing functions are capable of approximating any Borel measurable function from one finite dimensional space to another to any desired degree of accuracy, provided sufficiently many hidden units are available.
23.1K
•Book
Dynamic Programming and Optimal Control
Dimitri P. Bertsekas
- 01 May 1995
TL;DR: The leading and most up-to-date textbook on the far-ranging algorithmic methododogy of Dynamic Programming, which can be used for optimal control, Markovian decision problems, planning and sequential decision making under uncertainty, and discrete/combinatorial optimization.
•Book
Nonlinear and adaptive control design
Miroslav Krstic,Petar V. Kokotovic,Ioannis Kanellakopoulos +2 more
- 01 Jan 1995
TL;DR: In this paper, the focus is on adaptive nonlinear control results introduced with the new recursive design methodology -adaptive backstepping, and basic tools for nonadaptive BackStepping design with state and output feedbacks.
10.2K