Modeling affective responses to music using audio signal analysis and physiology

Konstantinos Trochidis, Simon Lui

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A key issue in designing personalized music affective applications is to find effective ways to direct emotion by music selection with appropriate combination of acoustic features. The aim of this study is to understand the dynamic relationships between acoustic features, physiology and affective states. To model these relationships we used a multivariate approach including continuous measures of emotions from behavioral, subjective and physiological responses. Classical music excerpts taken from opera overtures were used as stimuli to induce emotional variations across time between neutral and intense emotional states. Continuous ratings of arousal and valence along with cardiovascular, respiratory, skin conductance and facial expressive activity were recorded simultaneously. Results show that parts of the music with higher loudness and pulse clarity induced higher ratings of arousal, sympathetic activation and increased cardiorespiratory synchronization. In contrast, pleasant and calming parts with major mode and prominent key strength induced higher ratings of valence, parasympathetic activation and increased facial activity.

Original languageEnglish (US)
Title of host publicationMusic, Mind, and Embodiment - 11th International Symposium, CMMR 2015, Revised Selected Papers
EditorsRichard Kronland-Martinet, Mitsuko Aramaki, Sølvi Ystad
PublisherSpringer Verlag
Pages346-357
Number of pages12
ISBN (Print)9783319462813
DOIs
StatePublished - 2016
Event11th International Symposium on Computer Music Multidisciplinary Research, CMMR 2015 - Plymouth, United Kingdom
Duration: Jun 16 2015Jun 19 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9617 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other11th International Symposium on Computer Music Multidisciplinary Research, CMMR 2015
Country/TerritoryUnited Kingdom
CityPlymouth
Period6/16/156/19/15

Keywords

  • Acoustic features
  • Affective computing
  • Emotion recognition
  • Musical emotion
  • Physiological responses

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Modeling affective responses to music using audio signal analysis and physiology'. Together they form a unique fingerprint.

Cite this