Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty

Meng Zhang, Ming Gang Gan, Jie Chen, Zhong-Ping Jiang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper focuses on the optimal control of continuous-time linear time-varying uncertain systems with completely unknown internal dynamics and proposes a novel approach which leads to an optimal controller with guaranteed stability. A model-free algorithm of adaptive dynamic programming is employed to deal with the uncertainty of system parameters, yielding an optimal feedback controller for the system subject to a predefined cost. Then the stability of the system in time-varying uncertain situation which may undergo parameter changes or jumps is analyzed from the perspective of finite-time stability. On the basis of these results, a switching control strategy is presented to ensure the stability of the time-varying uncertain system with desired optimality properties in the long run. The effectiveness of the strategy is verified by simulations on a DC torque motor servo system.

Original languageEnglish (US)
Title of host publication2017 Asian Control Conference, ASCC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1228-1233
Number of pages6
Volume2018-January
ISBN (Electronic)9781509015733
DOIs
StatePublished - Feb 7 2018
Event2017 11th Asian Control Conference, ASCC 2017 - Gold Coast, Australia
Duration: Dec 17 2017Dec 20 2017

Other

Other2017 11th Asian Control Conference, ASCC 2017
CountryAustralia
CityGold Coast
Period12/17/1712/20/17

Fingerprint

Adaptive Dynamics
Dynamic Programming
Time-varying
Stabilization
Time-varying Systems
Linear Systems
Uncertain Systems
Uncertainty
Finite-time Stability
Controller
Switching Control
Servo System
Long-run
Torque
Control Strategy
Linear Time
Continuous Time
Optimality
Optimal Control
Jump

ASJC Scopus subject areas

  • Control and Optimization

Cite this

Zhang, M., Gan, M. G., Chen, J., & Jiang, Z-P. (2018). Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty. In 2017 Asian Control Conference, ASCC 2017 (Vol. 2018-January, pp. 1228-1233). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ASCC.2017.8287346

Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty. / Zhang, Meng; Gan, Ming Gang; Chen, Jie; Jiang, Zhong-Ping.

2017 Asian Control Conference, ASCC 2017. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. p. 1228-1233.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhang, M, Gan, MG, Chen, J & Jiang, Z-P 2018, Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty. in 2017 Asian Control Conference, ASCC 2017. vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 1228-1233, 2017 11th Asian Control Conference, ASCC 2017, Gold Coast, Australia, 12/17/17. https://doi.org/10.1109/ASCC.2017.8287346
Zhang M, Gan MG, Chen J, Jiang Z-P. Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty. In 2017 Asian Control Conference, ASCC 2017. Vol. 2018-January. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1228-1233 https://doi.org/10.1109/ASCC.2017.8287346
Zhang, Meng ; Gan, Ming Gang ; Chen, Jie ; Jiang, Zhong-Ping. / Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty. 2017 Asian Control Conference, ASCC 2017. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1228-1233
@inproceedings{d3cc33e192f44a82877b99f022c1f63f,
title = "Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty",
abstract = "This paper focuses on the optimal control of continuous-time linear time-varying uncertain systems with completely unknown internal dynamics and proposes a novel approach which leads to an optimal controller with guaranteed stability. A model-free algorithm of adaptive dynamic programming is employed to deal with the uncertainty of system parameters, yielding an optimal feedback controller for the system subject to a predefined cost. Then the stability of the system in time-varying uncertain situation which may undergo parameter changes or jumps is analyzed from the perspective of finite-time stability. On the basis of these results, a switching control strategy is presented to ensure the stability of the time-varying uncertain system with desired optimality properties in the long run. The effectiveness of the strategy is verified by simulations on a DC torque motor servo system.",
author = "Meng Zhang and Gan, {Ming Gang} and Jie Chen and Zhong-Ping Jiang",
year = "2018",
month = "2",
day = "7",
doi = "10.1109/ASCC.2017.8287346",
language = "English (US)",
volume = "2018-January",
pages = "1228--1233",
booktitle = "2017 Asian Control Conference, ASCC 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Adaptive dynamic programming and optimal stabilization for linear systems with time-varying uncertainty

AU - Zhang, Meng

AU - Gan, Ming Gang

AU - Chen, Jie

AU - Jiang, Zhong-Ping

PY - 2018/2/7

Y1 - 2018/2/7

N2 - This paper focuses on the optimal control of continuous-time linear time-varying uncertain systems with completely unknown internal dynamics and proposes a novel approach which leads to an optimal controller with guaranteed stability. A model-free algorithm of adaptive dynamic programming is employed to deal with the uncertainty of system parameters, yielding an optimal feedback controller for the system subject to a predefined cost. Then the stability of the system in time-varying uncertain situation which may undergo parameter changes or jumps is analyzed from the perspective of finite-time stability. On the basis of these results, a switching control strategy is presented to ensure the stability of the time-varying uncertain system with desired optimality properties in the long run. The effectiveness of the strategy is verified by simulations on a DC torque motor servo system.

AB - This paper focuses on the optimal control of continuous-time linear time-varying uncertain systems with completely unknown internal dynamics and proposes a novel approach which leads to an optimal controller with guaranteed stability. A model-free algorithm of adaptive dynamic programming is employed to deal with the uncertainty of system parameters, yielding an optimal feedback controller for the system subject to a predefined cost. Then the stability of the system in time-varying uncertain situation which may undergo parameter changes or jumps is analyzed from the perspective of finite-time stability. On the basis of these results, a switching control strategy is presented to ensure the stability of the time-varying uncertain system with desired optimality properties in the long run. The effectiveness of the strategy is verified by simulations on a DC torque motor servo system.

UR - http://www.scopus.com/inward/record.url?scp=85047559263&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85047559263&partnerID=8YFLogxK

U2 - 10.1109/ASCC.2017.8287346

DO - 10.1109/ASCC.2017.8287346

M3 - Conference contribution

VL - 2018-January

SP - 1228

EP - 1233

BT - 2017 Asian Control Conference, ASCC 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -