Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning

Weinan Gao; Yiyang Liu; Adedapo Odekunle; Zhong Ping Jiang; Yunjun Yu; Pingli Lu

doi:10.1109/RCAR.2018.8621852

Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning

Weinan Gao, Yiyang Liu, Adedapo Odekunle, Zhong Ping Jiang, Yunjun Yu, Pingli Lu

Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper proposes an original data-driven intelligent control solution to the cooperative output regulation problem of discrete-time multi-agent systems. Based on the combination of internal model principle and reinforcement learning, a distributed suboptimal controller is learned realtime via online input-state data collected from system trajectories. Rigorous theoretical analysis guarantees the convergence of the proposed algorithm and the asymptotic stability of the closed-loop system. Numerical results validate the effectiveness of the proposed control methodology.

Original language	English (US)
Title of host publication	2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	348-353
Number of pages	6
ISBN (Electronic)	9781538668689
DOIs	https://doi.org/10.1109/RCAR.2018.8621852
State	Published - Jul 2 2018
Event	2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018 - Kandima, Maldives Duration: Aug 1 2018 → Aug 5 2018

Publication series

Name	2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018

Conference

Conference	2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018
Country/Territory	Maldives
City	Kandima
Period	8/1/18 → 8/5/18

ASJC Scopus subject areas

Artificial Intelligence
Control and Optimization

Access to Document

10.1109/RCAR.2018.8621852

Cite this

Gao, W., Liu, Y., Odekunle, A., Jiang, Z. P., Yu, Y., & Lu, P. (2018). Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning. In 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018 (pp. 348-353). Article 8621852 (2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/RCAR.2018.8621852

Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning. / Gao, Weinan; Liu, Yiyang; Odekunle, Adedapo et al.
2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 348-353 8621852 (2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Gao, W, Liu, Y, Odekunle, A, Jiang, ZP, Yu, Y & Lu, P 2018, Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning. in 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018., 8621852, 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018, Institute of Electrical and Electronics Engineers Inc., pp. 348-353, 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018, Kandima, Maldives, 8/1/18. https://doi.org/10.1109/RCAR.2018.8621852

Gao W, Liu Y, Odekunle A, Jiang ZP, Yu Y, Lu P. Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning. In 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 348-353. 8621852. (2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018). doi: 10.1109/RCAR.2018.8621852

Gao, Weinan ; Liu, Yiyang ; Odekunle, Adedapo et al. / Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning. 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 348-353 (2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018).

@inproceedings{b7b6aa74564c4860ab7f074e8d1ead65,

title = "Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning",

abstract = "This paper proposes an original data-driven intelligent control solution to the cooperative output regulation problem of discrete-time multi-agent systems. Based on the combination of internal model principle and reinforcement learning, a distributed suboptimal controller is learned realtime via online input-state data collected from system trajectories. Rigorous theoretical analysis guarantees the convergence of the proposed algorithm and the asymptotic stability of the closed-loop system. Numerical results validate the effectiveness of the proposed control methodology.",

author = "Weinan Gao and Yiyang Liu and Adedapo Odekunle and Jiang, {Zhong Ping} and Yunjun Yu and Pingli Lu",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018 ; Conference date: 01-08-2018 Through 05-08-2018",

year = "2018",

month = jul,

day = "2",

doi = "10.1109/RCAR.2018.8621852",

language = "English (US)",

series = "2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "348--353",

booktitle = "2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018",

}

TY - GEN

T1 - Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning

AU - Gao, Weinan

AU - Liu, Yiyang

AU - Odekunle, Adedapo

AU - Jiang, Zhong Ping

AU - Yu, Yunjun

AU - Lu, Pingli

PY - 2018/7/2

Y1 - 2018/7/2

N2 - This paper proposes an original data-driven intelligent control solution to the cooperative output regulation problem of discrete-time multi-agent systems. Based on the combination of internal model principle and reinforcement learning, a distributed suboptimal controller is learned realtime via online input-state data collected from system trajectories. Rigorous theoretical analysis guarantees the convergence of the proposed algorithm and the asymptotic stability of the closed-loop system. Numerical results validate the effectiveness of the proposed control methodology.

AB - This paper proposes an original data-driven intelligent control solution to the cooperative output regulation problem of discrete-time multi-agent systems. Based on the combination of internal model principle and reinforcement learning, a distributed suboptimal controller is learned realtime via online input-state data collected from system trajectories. Rigorous theoretical analysis guarantees the convergence of the proposed algorithm and the asymptotic stability of the closed-loop system. Numerical results validate the effectiveness of the proposed control methodology.

UR - http://www.scopus.com/inward/record.url?scp=85062499600&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062499600&partnerID=8YFLogxK

U2 - 10.1109/RCAR.2018.8621852

DO - 10.1109/RCAR.2018.8621852

M3 - Conference contribution

AN - SCOPUS:85062499600

T3 - 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018

SP - 348

EP - 353

BT - 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2018 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2018

Y2 - 1 August 2018 through 5 August 2018

ER -

Cooperative and adaptive optimal output regulation of discrete-time multi-agent systems using reinforcement learning

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this