Adaptive dynamic programming and optimal control of nonlinear nonaffine systems

Tao Bian, Yu Jiang, Zhong Ping Jiang

Research output: Contribution to journalArticlepeer-review


In this paper, a novel optimal control design scheme is proposed for continuous-time nonaffine nonlinear dynamic systems with unknown dynamics by adaptive dynamic programming (ADP). The proposed methodology iteratively updates the control policy online by using the state and input information without identifying the system dynamics. An ADP algorithm is developed, and can be applied to a general class of nonlinear control design problems. The convergence analysis for the designed control scheme is presented, along with rigorous stability analysis for the closed-loop system. The effectiveness of this new algorithm is illustrated by two simulation examples.

Original languageEnglish (US)
Pages (from-to)2624-2632
Number of pages9
Issue number10
StatePublished - Oct 1 2014


  • Adaptive dynamic programming
  • Adaptive optimal control
  • Nonaffine systems

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering


Dive into the research topics of 'Adaptive dynamic programming and optimal control of nonlinear nonaffine systems'. Together they form a unique fingerprint.

Cite this