TY - JOUR
T1 - Context-aware controller inference for stabilizing dynamical systems from scarce data
AU - Werner, Steffen W.R.
AU - Peherstorfer, Benjamin
N1 - Funding Information:
The authors acknowledge support from the Air Force Office of Scientific Research (AFOSR) award FA9550-21-1-0222 (Dr Fariba Fahroo). The second author additionally acknowledges support from the National Science Foundation under grant no. 2012250.
Publisher Copyright:
© 2023 The Author(s).
PY - 2023/2/22
Y1 - 2023/2/22
N2 - This work introduces a data-driven control approach for stabilizing high-dimensional dynamical systems from scarce data. The proposed context-aware controller inference approach is based on the observation that controllers need to act locally only on the unstable dynamics to stabilize systems. This means it is sufficient to learn the unstable dynamics alone, which are typically confined to much lower dimensional spaces than the high-dimensional state spaces of all system dynamics and thus few data samples are sufficient to identify them. Numerical experiments demonstrate that context-aware controller inference learns stabilizing controllers from orders of magnitude fewer data samples than traditional data-driven control techniques and variants of reinforcement learning. The experiments further show that the low data requirements of context-aware controller inference are especially beneficial in data-scarce engineering problems with complex physics, for which learning complete system dynamics is often intractable in terms of data and training costs.
AB - This work introduces a data-driven control approach for stabilizing high-dimensional dynamical systems from scarce data. The proposed context-aware controller inference approach is based on the observation that controllers need to act locally only on the unstable dynamics to stabilize systems. This means it is sufficient to learn the unstable dynamics alone, which are typically confined to much lower dimensional spaces than the high-dimensional state spaces of all system dynamics and thus few data samples are sufficient to identify them. Numerical experiments demonstrate that context-aware controller inference learns stabilizing controllers from orders of magnitude fewer data samples than traditional data-driven control techniques and variants of reinforcement learning. The experiments further show that the low data requirements of context-aware controller inference are especially beneficial in data-scarce engineering problems with complex physics, for which learning complete system dynamics is often intractable in terms of data and training costs.
KW - context-aware learning
KW - data-driven control
KW - nonlinear systems
KW - stabilizing feedback
UR - http://www.scopus.com/inward/record.url?scp=85149007888&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85149007888&partnerID=8YFLogxK
U2 - 10.1098/rspa.2022.0506
DO - 10.1098/rspa.2022.0506
M3 - Article
AN - SCOPUS:85149007888
SN - 0080-4630
VL - 479
JO - Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
JF - Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
IS - 2270
M1 - 20220506
ER -