More than a feeling: The MiFace framework for defining facial communication mappings

Crystal Butler, Stephanie Michalowicz, Lakshmi Subramanian, Winslow Burleson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Facial expressions transmit a variety of social, grammatical, and affective signals. For technology to leverage this rich source of communication, tools that better model the breadth of information they convey are required. MiFace is a novel framework for creating expression lexicons that map signal values to parameterized facial muscle movements inferred by trained experts. The set of generally accepted expressions established in this way is limited to six basic displays of affect. In contrast, our approach generatively simulates muscle movements on a 3D avatar. By applying natural language processing techniques to crowdsourced free-response labels for the resulting images, we efficiently converge on an expression's value across signal categories. Two studies returned 218 discriminable facial expressions with 51 unique labels. The six basic emotions are included, but we additionally define such nuanced expressions as embarrassed, curious, and hopeful.

Original languageEnglish (US)
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages773-786
Number of pages14
ISBN (Electronic)9781450349819
DOIs
StatePublished - Oct 20 2017
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: Oct 22 2017Oct 25 2017

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Other

Other30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
CountryCanada
CityQuebec City
Period10/22/1710/25/17

Keywords

  • 3D modeling
  • Affective computing
  • Avatars
  • Facial expression recognition
  • Natural language processing
  • Social signal processing
  • Virtual humans

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'More than a feeling: The MiFace framework for defining facial communication mappings'. Together they form a unique fingerprint.

  • Cite this

    Butler, C., Michalowicz, S., Subramanian, L., & Burleson, W. (2017). More than a feeling: The MiFace framework for defining facial communication mappings. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (pp. 773-786). (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/3126594.3126640