Affective computing meets design patterns: A pattern-based model for a multimodal emotion recognition framework

Javier Gonzalez-Sanchez, Maria Elena Chavez-Echeagaray, Robert Atkinson, Winslow Burleson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

There is a growing interest in how to leverage information about user's emotions as a mean of personalizing the response of computer systems. This is particularly useful for computer-aided learning, health, and entertainment systems. However, there are few architectures, frameworks, libraries, or software tools that allow developers to easily integrate emotion recognition into their software projects. The work reported in this paper offers a way to address this shortcoming in models by proposing the use of software design patterns for modeling a multimodal emotion recognition framework. The framework is designed to: (1) integrate existing sensing devices and SDK platforms, (2) include diverse inference algorithms, and (3) correlate measurements from diverse sources. We describe our experience using this model and its impact on facets, such as creating a common language among stakeholders, supporting an incremental development, and adjusting to a highly shifting development team, as well as the qualities achieved and trade-offs made.

Original languageEnglish (US)
Title of host publicationEuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings
DOIs
StatePublished - 2012
Event16th European Conference on Pattern Languages of Programs, EuroPLoP 2011 - Irsee, Germany
Duration: Jul 13 2011Jul 17 2011

Publication series

NameACM International Conference Proceeding Series

Other

Other16th European Conference on Pattern Languages of Programs, EuroPLoP 2011
CountryGermany
CityIrsee
Period7/13/117/17/11

Keywords

  • design patterns
  • emotion recognition
  • framework
  • multimodal

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Affective computing meets design patterns: A pattern-based model for a multimodal emotion recognition framework'. Together they form a unique fingerprint.

  • Cite this

    Gonzalez-Sanchez, J., Chavez-Echeagaray, M. E., Atkinson, R., & Burleson, W. (2012). Affective computing meets design patterns: A pattern-based model for a multimodal emotion recognition framework. In EuroPLoP 2011 - 16th European Conference on Pattern Languages of Programs, Invited Post-Proceedings (ACM International Conference Proceeding Series). https://doi.org/10.1145/2396716.2396730