TY - JOUR
T1 - BandFocusNet
T2 - A Lightweight Model for Motor Imagery Classification of a Supernumerary Thumb in Virtual Reality
AU - Alsuradi, Haneen
AU - Hong, Joseph
AU - Sarmadi, Alireza
AU - Volcic, Robert
AU - Salam, Hanan
AU - Atashzar, Seyed Farokh
AU - Khorrami, Farshad
AU - Eid, Mohamad
N1 - Publisher Copyright:
© 2025 The Authors.
PY - 2025
Y1 - 2025
N2 - Objective: Human movement augmentation through supernumerary effectors is an emerging field of research. However, controlling these effectors remains challenging due to issues with agency, control, and synchronizing movements with natural limbs. A promising control strategy for supernumerary effectors involves utilizing electroencephalography (EEG) through motor imagery (MI) functions. In this work, we investigate whether MI activity associated with a supernumerary effector could be reliably differentiated from that of a natural one, thus addressing the concern of concurrency. Twenty subjects were recruited to participate in a two-fold experiment in which they observed movements of natural and supernumerary thumbs, then engaged in MI of the observed movements, conducted in a virtual reality setting. Results: A lightweight deep-learning model that accounts for the temporal, spatial and spectral nature of the EEG data is proposed and called BandFocusNet, achieving an average classification accuracy of 70.9% using the leave-one-subject-out cross validation method. The trustworthiness of the model is examined through explainability analysis, and influential regions-of-interests are cross-validated through event-related-spectral-perturbation (ERSPs) analysis. Explainability results showed the importance of the right and left frontal cortical regions, and ERSPs analysis showed an increase in the delta and theta powers in these regions during the MI of the natural thumb but not during the MI of the supernumerary thumb. Conclusion: Evidence in the literature indicates that such activation is observed during the MI of natural effectors, and its absence could be interpreted as a lack of embodiment of the supernumerary thumb.
AB - Objective: Human movement augmentation through supernumerary effectors is an emerging field of research. However, controlling these effectors remains challenging due to issues with agency, control, and synchronizing movements with natural limbs. A promising control strategy for supernumerary effectors involves utilizing electroencephalography (EEG) through motor imagery (MI) functions. In this work, we investigate whether MI activity associated with a supernumerary effector could be reliably differentiated from that of a natural one, thus addressing the concern of concurrency. Twenty subjects were recruited to participate in a two-fold experiment in which they observed movements of natural and supernumerary thumbs, then engaged in MI of the observed movements, conducted in a virtual reality setting. Results: A lightweight deep-learning model that accounts for the temporal, spatial and spectral nature of the EEG data is proposed and called BandFocusNet, achieving an average classification accuracy of 70.9% using the leave-one-subject-out cross validation method. The trustworthiness of the model is examined through explainability analysis, and influential regions-of-interests are cross-validated through event-related-spectral-perturbation (ERSPs) analysis. Explainability results showed the importance of the right and left frontal cortical regions, and ERSPs analysis showed an increase in the delta and theta powers in these regions during the MI of the natural thumb but not during the MI of the supernumerary thumb. Conclusion: Evidence in the literature indicates that such activation is observed during the MI of natural effectors, and its absence could be interpreted as a lack of embodiment of the supernumerary thumb.
KW - Brain-computer interface
KW - deep learning
KW - EEG
KW - human augmentation
KW - motor imagery
KW - supernumerary robotic limbs
UR - http://www.scopus.com/inward/record.url?scp=86000432476&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=86000432476&partnerID=8YFLogxK
U2 - 10.1109/OJEMB.2025.3537760
DO - 10.1109/OJEMB.2025.3537760
M3 - Article
AN - SCOPUS:86000432476
SN - 2644-1276
VL - 6
SP - 305
EP - 311
JO - IEEE Open Journal of Engineering in Medicine and Biology
JF - IEEE Open Journal of Engineering in Medicine and Biology
ER -