Fusion dynamical systems with machine learning in imitation learning: A comprehensive overview

Yingbai Hu, Fares J. Abu-Dakka, Fei Chen, Xiao Luo, Zheng Li, Alois Knoll, Weiping Ding

Research output: Contribution to journalShort surveypeer-review

Abstract

Imitation Learning (IL), also referred to as Learning from Demonstration (LfD), holds significant promise for capturing expert motor skills through efficient imitation, facilitating adept navigation of complex scenarios. A persistent challenge in IL lies in extending generalization from historical demonstrations, enabling the acquisition of new skills without re-teaching. Dynamical system-based IL (DSIL) emerges as a significant subset of IL methodologies, offering the ability to learn trajectories via movement primitives and policy learning based on experiential abstraction. This paper emphasizes the fusion of theoretical paradigms, integrating control theory principles inherent in dynamical systems into IL. This integration notably enhances robustness, adaptability, and convergence in the face of novel scenarios. This survey aims to present a comprehensive overview of DSIL methods, spanning from classical approaches to recent advanced approaches. We categorize DSIL into autonomous dynamical systems and non-autonomous dynamical systems, surveying traditional IL methods with low-dimensional input and advanced deep IL methods with high-dimensional input. Additionally, we present and analyze three main stability methods for IL: Lyapunov stability, contraction theory, and diffeomorphism mapping. Our exploration also extends to popular policy improvement methods for DSIL, encompassing reinforcement learning, deep reinforcement learning, and evolutionary strategies. The primary objective is to expedite readers’ comprehension of dynamical systems’ foundational aspects and capabilities, helping identify practical scenarios and charting potential future directions. By offering insights into the strengths and limitations of dynamical system methods, we aim to foster a deeper understanding among readers. Furthermore, we outline potential extensions and enhancements within the realm of dynamical systems, outlining avenues for further exploration.

Original languageEnglish (US)
Article number102379
JournalInformation Fusion
Volume108
DOIs
StatePublished - Aug 2024

Keywords

  • Dynamical system
  • Fusion of theoretical paradigms
  • Imitation learning
  • Policy exploration
  • Stability

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Information Systems
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Fusion dynamical systems with machine learning in imitation learning: A comprehensive overview'. Together they form a unique fingerprint.

Cite this