Feedback Nash Equilibrium for Randomly Switching Differential-Algebraic Games

Aneel Tanwanimember, Quanyan Zhu Zhu

Research output: Contribution to journalArticlepeer-review

Abstract

As a subclass of stochastic differential games with algebraic constraints, this article studies dynamic noncooperative games where the dynamics are described by Markov jump differential-algebraic equations (DAEs). Theoretical tools, which require computing the extended generator and deriving Hamilton-Jacobi-Bellman equation for Markov jump DAEs, are developed. These fundamental results lead to pure feedback optimal strategies to compute the Nash equilibrium in noncooperative setting. In case of quadratic cost and linear dynamics, these strategies are obtained by solving coupled Riccati-like differential equations. Under an appropriate stabilizability assumption on system dynamics, these differential equations reduce to coupled algebraic Riccati equations when the cost functionals are considered over infinite horizon. As a first case-study, the application of our results is studied in the context of an economic system where different suppliers aim to maximize their profits subject to the market demands and fluctuations in operating conditions. The second case-study refers to the conventional problem of robust control for randomly switching linear DAEs, which can be formulated as a two-player zero sum game and is solved using the results developed in this article.

Original languageEnglish (US)
Article number8848414
Pages (from-to)3286-3301
Number of pages16
JournalIEEE Transactions on Automatic Control
Volume65
Issue number8
DOIs
StatePublished - Aug 2020

Keywords

  • Coupled Riccati equations
  • differential-algebraic dynamical systems
  • generalized Hamilton-Jacobi-Bellman (HJB) equation
  • infinitesimal generators
  • Leontief input-output (IO) models
  • minimax robust control
  • noncooperative games
  • piecewise deterministic Markov processes

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Feedback Nash Equilibrium for Randomly Switching Differential-Algebraic Games'. Together they form a unique fingerprint.

Cite this