Adaptive Optimal Control of Linear Periodic Systems: An Off-Policy Value Iteration Approach

Research output: Contribution to journalArticlepeer-review


This article studies the infinite-horizon adaptive optimal control of continuous-time linear periodic (CTLP) systems. A novel value iteration (VI) based off-policy adaptive dynamic programming (ADP) algorithm is proposed for a general class of CTLP systems, so that approximate optimal solutions can be obtained directly from the collected data, without the exact knowledge of system dynamics. Under mild conditions, the proofs on uniform convergence of the proposed algorithm to the optimal solutions are given for both the model-based and model-free cases. The VI-based ADP algorithm is able to find suboptimal controllers without assuming the knowledge of an initial stabilizing controller. Application to the optimal control of a triple inverted pendulum subjected to a periodically varying load demonstrates the feasibility and effectiveness of the proposed method.

Original languageEnglish (US)
Article number9069169
Pages (from-to)888-894
Number of pages7
JournalIEEE Transactions on Automatic Control
Issue number2
StatePublished - Feb 2021


  • Adaptive dynamic programming
  • linear periodic systems
  • optimal control
  • value iteration

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Adaptive Optimal Control of Linear Periodic Systems: An Off-Policy Value Iteration Approach'. Together they form a unique fingerprint.

Cite this