TY - GEN
T1 - Decoding a Music-Modulated Cognitive Arousal State using Electrodermal Activity and Functional Near-infrared Spectroscopy Measurements
AU - Yaghmour, Anan
AU - Rafiul Amin, Md
AU - Faghih, Rose T.
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Biofeedback systems sense different physiological activities and help with gaining self-awareness. Understanding music's impact on the arousal state is of great importance for biofeedback stress management systems. In this study, we investigate a cognitive-stress-related arousal state modulated by different types of music. During our experiments, each subject was presented with neurological stimuli that elicit a cognitive-stress-related arousal response in a working memory experiment. Moreover, this cognitive-stress-related arousal was modulated by calming and vexing music played in the background. Electrodermal activity and functional near-infrared spectroscopy (fNIRS) measurements both contain information related to cognitive arousal and were collected in our study. By considering various fNIRS features, we selected three features based on variance, root mean square, and local fNIRS peaks as the most informative fNIRS observations in terms of cognitive arousal. The rate of neural impulse occurrence underlying EDA was taken as a binary observation. To retain a low computational complexity for our decoder and select the best fNIRS-based observations, two features were chosen as fNIRS-based observations at a time. A decoder based on one binary and two continuous observations was utilized to estimate the hidden cognitive-stress-related arousal state. This was done by using a Bayesian filtering approach within an expectation-maximization framework. Our results indicate that the decoded cognitive arousal modulated by vexing music was higher than calming music. Among the three fNIRS observations selected, a combination of observations based on root mean square and local fNIRS peaks resulted in the best decoded states for our experimental settings. This study serves as a proof of concept for utilizing fNIRS and EDA measurements to develop a low-dimensional decoder for tracking cognitive-stress-related arousal levels.
AB - Biofeedback systems sense different physiological activities and help with gaining self-awareness. Understanding music's impact on the arousal state is of great importance for biofeedback stress management systems. In this study, we investigate a cognitive-stress-related arousal state modulated by different types of music. During our experiments, each subject was presented with neurological stimuli that elicit a cognitive-stress-related arousal response in a working memory experiment. Moreover, this cognitive-stress-related arousal was modulated by calming and vexing music played in the background. Electrodermal activity and functional near-infrared spectroscopy (fNIRS) measurements both contain information related to cognitive arousal and were collected in our study. By considering various fNIRS features, we selected three features based on variance, root mean square, and local fNIRS peaks as the most informative fNIRS observations in terms of cognitive arousal. The rate of neural impulse occurrence underlying EDA was taken as a binary observation. To retain a low computational complexity for our decoder and select the best fNIRS-based observations, two features were chosen as fNIRS-based observations at a time. A decoder based on one binary and two continuous observations was utilized to estimate the hidden cognitive-stress-related arousal state. This was done by using a Bayesian filtering approach within an expectation-maximization framework. Our results indicate that the decoded cognitive arousal modulated by vexing music was higher than calming music. Among the three fNIRS observations selected, a combination of observations based on root mean square and local fNIRS peaks resulted in the best decoded states for our experimental settings. This study serves as a proof of concept for utilizing fNIRS and EDA measurements to develop a low-dimensional decoder for tracking cognitive-stress-related arousal levels.
KW - Arousal
KW - Bayes Theorem
KW - Cognition
KW - Galvanic Skin Response
KW - Music
KW - Spectroscopy, Near-Infrared
UR - http://www.scopus.com/inward/record.url?scp=85122548998&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85122548998&partnerID=8YFLogxK
U2 - 10.1109/EMBC46164.2021.9630879
DO - 10.1109/EMBC46164.2021.9630879
M3 - Conference contribution
C2 - 34891470
AN - SCOPUS:85122548998
VL - 2021
T3 - Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
SP - 1055
EP - 1060
BT - 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
Y2 - 1 November 2021 through 5 November 2021
ER -