Value iteration and adaptive optimal control for linear continuous-time systems

Tao Bian; Zhong Ping Jiang

doi:10.1109/ICCIS.2015.7274547

Value iteration and adaptive optimal control for linear continuous-time systems

Tao Bian, Zhong Ping Jiang

Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.

Original language	English (US)
Title of host publication	Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	53-58
Number of pages	6
ISBN (Electronic)	9781467373364
DOIs	https://doi.org/10.1109/ICCIS.2015.7274547
State	Published - Sep 23 2015
Event	7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015 - Siem Reap, Cambodia Duration: Jul 15 2015 → Jul 17 2015

Publication series

Name	Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015

Other

Other	7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015
Country/Territory	Cambodia
City	Siem Reap
Period	7/15/15 → 7/17/15

ASJC Scopus subject areas

Artificial Intelligence
Control and Systems Engineering

Access to Document

10.1109/ICCIS.2015.7274547

Cite this

Bian, T., & Jiang, Z. P. (2015). Value iteration and adaptive optimal control for linear continuous-time systems. In Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015 (pp. 53-58). Article 7274547 (Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCIS.2015.7274547

Value iteration and adaptive optimal control for linear continuous-time systems. / Bian, Tao; Jiang, Zhong Ping.
Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 53-58 7274547 (Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Bian, T & Jiang, ZP 2015, Value iteration and adaptive optimal control for linear continuous-time systems. in Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015., 7274547, Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015, Institute of Electrical and Electronics Engineers Inc., pp. 53-58, 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015, Siem Reap, Cambodia, 7/15/15. https://doi.org/10.1109/ICCIS.2015.7274547

Bian T, Jiang ZP. Value iteration and adaptive optimal control for linear continuous-time systems. In Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 53-58. 7274547. (Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015). doi: 10.1109/ICCIS.2015.7274547

Bian, Tao ; Jiang, Zhong Ping. / Value iteration and adaptive optimal control for linear continuous-time systems. Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 53-58 (Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015).

@inproceedings{929746ce98fa465694c19432de86140d,

title = "Value iteration and adaptive optimal control for linear continuous-time systems",

abstract = "In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.",

author = "Tao Bian and Jiang, {Zhong Ping}",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015 ; Conference date: 15-07-2015 Through 17-07-2015",

year = "2015",

month = sep,

day = "23",

doi = "10.1109/ICCIS.2015.7274547",

language = "English (US)",

series = "Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "53--58",

booktitle = "Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015",

}

TY - GEN

T1 - Value iteration and adaptive optimal control for linear continuous-time systems

AU - Bian, Tao

AU - Jiang, Zhong Ping

PY - 2015/9/23

Y1 - 2015/9/23

N2 - In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.

AB - In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.

UR - http://www.scopus.com/inward/record.url?scp=84960889867&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84960889867&partnerID=8YFLogxK

U2 - 10.1109/ICCIS.2015.7274547

DO - 10.1109/ICCIS.2015.7274547

M3 - Conference contribution

AN - SCOPUS:84960889867

T3 - Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015

SP - 53

EP - 58

BT - Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015

Y2 - 15 July 2015 through 17 July 2015

ER -

Value iteration and adaptive optimal control for linear continuous-time systems

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this