BandFocusNet: A Lightweight Model for Motor Imagery Classification of a Supernumerary Thumb in Virtual Reality

Haneen Alsuradi, Joseph Hong, Alireza Sarmadi, Robert Volcic, Hanan Salam, Seyed Farokh Atashzar, Farshad Khorrami, Mohamad Eid

Research output: Contribution to journalArticlepeer-review

Abstract

Objective: Human movement augmentation through supernumerary effectors is an emerging field of research. However, controlling these effectors remains challenging due to issues with agency, control, and synchronizing movements with natural limbs. A promising control strategy for supernumerary effectors involves utilizing electroencephalography (EEG) through motor imagery (MI) functions. In this work, we investigate whether MI activity associated with a supernumerary effector could be reliably differentiated from that of a natural one, thus addressing the concern of concurrency. Twenty subjects were recruited to participate in a two-fold experiment in which they observed movements of natural and supernumerary thumbs, then engaged in MI of the observed movements, conducted in a virtual reality setting. Results: A lightweight deep-learning model that accounts for the temporal, spatial and spectral nature of the EEG data is proposed and called BandFocusNet, achieving an average classification accuracy of 70.9% using the leave-one-subject-out cross validation method. The trustworthiness of the model is examined through explainability analysis, and influential regions-of-interests are cross-validated through event-related-spectral-perturbation (ERSPs) analysis. Explainability results showed the importance of the right and left frontal cortical regions, and ERSPs analysis showed an increase in the delta and theta powers in these regions during the MI of the natural thumb but not during the MI of the supernumerary thumb. Conclusion: Evidence in the literature indicates that such activation is observed during the MI of natural effectors, and its absence could be interpreted as a lack of embodiment of the supernumerary thumb.

Original languageEnglish (US)
Pages (from-to)305-311
Number of pages7
JournalIEEE Open Journal of Engineering in Medicine and Biology
Volume6
DOIs
StatePublished - 2025

Keywords

  • Brain-computer interface
  • deep learning
  • EEG
  • human augmentation
  • motor imagery
  • supernumerary robotic limbs

ASJC Scopus subject areas

  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'BandFocusNet: A Lightweight Model for Motor Imagery Classification of a Supernumerary Thumb in Virtual Reality'. Together they form a unique fingerprint.

Cite this