A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures

Linan Huang; Juntao Chen; Quanyan Zhu

doi:10.1109/MSCPES.2017.8064531

A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures

Linan Huang, Juntao Chen, Quanyan Zhu

Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.

Original language	English (US)
Title of host publication	2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781509064397
DOIs	https://doi.org/10.1109/MSCPES.2017.8064531
State	Published - Oct 10 2017
Event	2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Pittsburgh, United States Duration: Apr 21 2017 → …

Publication series

Name	2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings

Other

Other	2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017
Country/Territory	United States
City	Pittsburgh
Period	4/21/17 → …

ASJC Scopus subject areas

Artificial Intelligence
Energy Engineering and Power Technology
Computer Networks and Communications
Modeling and Simulation

Access to Document

10.1109/MSCPES.2017.8064531

Cite this

Huang, L., Chen, J., & Zhu, Q. (2017). A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. In 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings Article 8064531 (2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/MSCPES.2017.8064531

A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. / Huang, Linan; Chen, Juntao; Zhu, Quanyan.
2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. 8064531 (2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Huang, L, Chen, J & Zhu, Q 2017, A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. in 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings., 8064531, 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings, Institute of Electrical and Electronics Engineers Inc., 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017, Pittsburgh, United States, 4/21/17. https://doi.org/10.1109/MSCPES.2017.8064531

Huang L, Chen J, Zhu Q. A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. In 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings. Institute of Electrical and Electronics Engineers Inc. 2017. 8064531. (2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings). doi: 10.1109/MSCPES.2017.8064531

Huang, Linan ; Chen, Juntao ; Zhu, Quanyan. / A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. (2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings).

@inproceedings{510155fa3e984aafa7ed95022cea1fcf,

title = "A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures",

abstract = "Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.",

author = "Linan Huang and Juntao Chen and Quanyan Zhu",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 ; Conference date: 21-04-2017",

year = "2017",

month = oct,

day = "10",

doi = "10.1109/MSCPES.2017.8064531",

language = "English (US)",

series = "2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings",

}

TY - GEN

T1 - A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures

AU - Huang, Linan

AU - Chen, Juntao

AU - Zhu, Quanyan

PY - 2017/10/10

Y1 - 2017/10/10

N2 - Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.

AB - Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.

UR - http://www.scopus.com/inward/record.url?scp=85032879499&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032879499&partnerID=8YFLogxK

U2 - 10.1109/MSCPES.2017.8064531

DO - 10.1109/MSCPES.2017.8064531

M3 - Conference contribution

AN - SCOPUS:85032879499

T3 - 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings

BT - 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017

Y2 - 21 April 2017

ER -

A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this