Predicting Trust Using Automated Assessment of Multivariate Interactional Synchrony

Adrien Meynard, Gayan Seneviratna, Elliot Doyle, Joyanne Becker, Hau Tieng Wu, Jana Schaich Borg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Diverse disciplines are interested in how the coordination of interacting agents' movements, emotions, and physiology over time impacts social behavior. Here, we describe a new multivariate procedure for automating the investigation of this kind of behaviorally-relevant 'interactional synchrony', and introduce a novel interactional synchrony measure based on features of dynamic time warping (DTW) paths. We demonstrate that our DTW path-based measure of interactional synchrony between facial action units of two people interacting freely in a natural social interaction can be used to predict how much trust they will display in a subsequent Trust Game. We also show that our approach outperforms univariate head movement models, models that consider participants' facial action units independently, and models that use previously proposed synchrony or similarity measures. The insights of this work can be applied to any research question that aims to quantify the temporal coordination of multiple signals over time, but has immediate applications in psychology, medicine, and robotics.

Original languageEnglish (US)
Title of host publicationProceedings - 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2021
EditorsVitomir Struc, Marija Ivanovska
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665431767
DOIs
StatePublished - 2021
Event16th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2021 - Virtual, Jodhpur, India
Duration: Dec 15 2021Dec 18 2021

Publication series

NameProceedings - 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2021

Conference

Conference16th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2021
Country/TerritoryIndia
CityVirtual, Jodhpur
Period12/15/2112/18/21

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Predicting Trust Using Automated Assessment of Multivariate Interactional Synchrony'. Together they form a unique fingerprint.

Cite this