TY - JOUR
T1 - Strategies for reduced-order models for predicting the statistical responses and uncertainty quantification in complex turbulent dynamical systems
AU - Majda, Andrew J.
AU - Qi, Di
N1 - Funding Information:
A general mathematical framework to construct statistically accurate reduced-order models that have skill in capturing the statistical variability in the principal directions with largest energy of a general class of damped and forced complex turbulent dynami-cal systems is discussed here. There are generally three stages in the modeling strategy: imperfect model selection, calibration of the imperfect model in a training phase, and pre-diction of the responses with UQ to a wide class of forcing and perturbation scenarios. The methods are developed under a universal class of turbulent dynamical systems with quadratic nonlinearity that is representative in many applications in applied mathematics and engineering. Several mathematical ideas will be introduced to improve the predic-tion skill of the imperfect reduced-order models. Most importantly, empirical information theory and statistical linear response theory are applied in the training phase for cali-brating model errors to achieve optimal imperfect model parameters, and total statistical energy dynamics are introduced to improve the model sensitivity of the prediction phase, especially when strong external perturbations are exerted. The validity of the general framework of reduced-order models is demonstrated on instructive stochastic triad mod-els. Recent applications to two-layer baroclinic turbulence in the atmosphere and ocean with combinations of turbulent jets and vortices are also surveyed. The UQ and statistical ∗Received by the editors November 22, 2016; accepted for publication (in revised form) July 18, 2017; published electronically August 8, 2018. http://www.siam.org/journals/sirev/60-3/M110466.html Funding: The research of the first author was partially supported by the Office of Naval Research through MURI N00014-16-1-2161 and DARPA through W911NF-15-1-0636. The second author was supported as a graduate research assistant on these grants. †Department of Mathematics and Center for Atmosphere and Ocean Science, Courant Institute of Mathematical Sciences, New York University, New York, NY 10012 (qidi@cims.nyu.edu, jonjon@ cims.nyu.edu).
Publisher Copyright:
© 2018 SIAM.
PY - 2018
Y1 - 2018
N2 - Turbulent dynamical systems characterized by both a high-dimensional phase space and a large number of instabilities are ubiquitous among many complex systems in science and engineering, including climate, material, and neural science. The existence of a strange attractor in the turbulent systems containing a large number of positive Lyapunov exponents results in the rapid growth of small uncertainties from imperfect modeling equations or perturbations in initial values, naturally requiring a probabilistic characterization for the evolution of the turbulent system. Uncertainty quantification (UQ) in turbulent dynamical systems is a grand challenge whose goal is to obtain statistical estimates such as the change in mean and variance for key physical quantities in their nonlinear responses to changes in external forcing parameters or uncertain initial data. In the development of a proper UQ scheme for systems of high or infinite dimensionality with instabilities, significant model errors compared with the true natural signal are always unavoidable due to both the imperfect understanding of the underlying physical processes and the limited computational resources available through direct Monte Carlo integration. One central issue in contemporary research is the development of a systematic methodology that can recover the crucial features of the natural system in statistical equilibrium (model fidelity) and improve the imperfect model prediction skill in response to various external perturbations (model sensitivity). A general mathematical framework to construct statistically accurate reduced-order models that have skill in capturing the statistical variability in the principal directions with largest energy of a general class of damped and forced complex turbulent dynamical systems is discussed here. There are generally three stages in the modeling strategy: imperfect model selection, calibration of the imperfect model in a training phase, and prediction of the responses with UQ to a wide class of forcing and perturbation scenarios. The methods are developed under a universal class of turbulent dynamical systems with quadratic nonlinearity that is representative in many applications in applied mathematics and engineering. Several mathematical ideas will be introduced to improve the prediction skill of the imperfect reduced-order models. Most importantly, empirical information theory and statistical linear response theory are applied in the training phase for calibrating model errors to achieve optimal imperfect model parameters, and total statistical energy dynamics are introduced to improve the model sensitivity of the prediction phase, especially when strong external perturbations are exerted. The validity of the general framework of reduced-order models is demonstrated on instructive stochastic triad models. Recent applications to two-layer baroclinic turbulence in the atmosphere and ocean with combinations of turbulent jets and vortices are also surveyed. The UQ and statistical response for these complex models are accurately captured by the reduced-order models with only 2 × 102 modes in a highly turbulent system with 1 × 105 degrees of freedom. Less than 0.15% of the total spectral modes are needed in the reduced-order models.
AB - Turbulent dynamical systems characterized by both a high-dimensional phase space and a large number of instabilities are ubiquitous among many complex systems in science and engineering, including climate, material, and neural science. The existence of a strange attractor in the turbulent systems containing a large number of positive Lyapunov exponents results in the rapid growth of small uncertainties from imperfect modeling equations or perturbations in initial values, naturally requiring a probabilistic characterization for the evolution of the turbulent system. Uncertainty quantification (UQ) in turbulent dynamical systems is a grand challenge whose goal is to obtain statistical estimates such as the change in mean and variance for key physical quantities in their nonlinear responses to changes in external forcing parameters or uncertain initial data. In the development of a proper UQ scheme for systems of high or infinite dimensionality with instabilities, significant model errors compared with the true natural signal are always unavoidable due to both the imperfect understanding of the underlying physical processes and the limited computational resources available through direct Monte Carlo integration. One central issue in contemporary research is the development of a systematic methodology that can recover the crucial features of the natural system in statistical equilibrium (model fidelity) and improve the imperfect model prediction skill in response to various external perturbations (model sensitivity). A general mathematical framework to construct statistically accurate reduced-order models that have skill in capturing the statistical variability in the principal directions with largest energy of a general class of damped and forced complex turbulent dynamical systems is discussed here. There are generally three stages in the modeling strategy: imperfect model selection, calibration of the imperfect model in a training phase, and prediction of the responses with UQ to a wide class of forcing and perturbation scenarios. The methods are developed under a universal class of turbulent dynamical systems with quadratic nonlinearity that is representative in many applications in applied mathematics and engineering. Several mathematical ideas will be introduced to improve the prediction skill of the imperfect reduced-order models. Most importantly, empirical information theory and statistical linear response theory are applied in the training phase for calibrating model errors to achieve optimal imperfect model parameters, and total statistical energy dynamics are introduced to improve the model sensitivity of the prediction phase, especially when strong external perturbations are exerted. The validity of the general framework of reduced-order models is demonstrated on instructive stochastic triad models. Recent applications to two-layer baroclinic turbulence in the atmosphere and ocean with combinations of turbulent jets and vortices are also surveyed. The UQ and statistical response for these complex models are accurately captured by the reduced-order models with only 2 × 102 modes in a highly turbulent system with 1 × 105 degrees of freedom. Less than 0.15% of the total spectral modes are needed in the reduced-order models.
KW - Anisotropic turbulence
KW - Reduced-order methods
KW - Statistical response
KW - Uncertainty quantification
UR - http://www.scopus.com/inward/record.url?scp=85053664984&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85053664984&partnerID=8YFLogxK
U2 - 10.1137/16M1104664
DO - 10.1137/16M1104664
M3 - Article
AN - SCOPUS:85053664984
SN - 0036-1445
VL - 60
SP - 491
EP - 549
JO - SIAM Review
JF - SIAM Review
IS - 3
ER -