TY - GEN
T1 - Engagement detection based on mutli-party cues for human robot interaction
AU - Salam, Hanan
AU - Chetouani, Mohamed
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2015/12/2
Y1 - 2015/12/2
N2 - In this paper, we address the problematic of automatic detection of engagement in multi-party Human-Robot Interaction scenarios. The aim is to investigate to what extent are we able to infer the engagement of one of the entities of a group based solely on the cues of the other entities present in the interaction. In a scenario featuring 3 entities: 2 participants and a robot, we extract behavioural cues that concern each of the entities, we then build models based solely on each of these entities' cues and on combinations of them to predict the engagement level of each of the participants. Person-level cross validation shows that we are capable of detecting the engagement of the participant in question using solely the behavioural cues of the robot with a high accuracy compared to using the participant's cues himself (75.91% vs. 74.32%). Moreover using the behavioural cues of the other participant is also informative where it permits the detection of the engagement of the participant in question at an accuracy of 62.15% on average. The correlation between the features of the other participant with the engagement labels of the participant in question suggests a high cohesion between the two participants. In addition, the similarity of the most significantly correlated features among the two participants suggests a high synchrony between the two parties.
AB - In this paper, we address the problematic of automatic detection of engagement in multi-party Human-Robot Interaction scenarios. The aim is to investigate to what extent are we able to infer the engagement of one of the entities of a group based solely on the cues of the other entities present in the interaction. In a scenario featuring 3 entities: 2 participants and a robot, we extract behavioural cues that concern each of the entities, we then build models based solely on each of these entities' cues and on combinations of them to predict the engagement level of each of the participants. Person-level cross validation shows that we are capable of detecting the engagement of the participant in question using solely the behavioural cues of the robot with a high accuracy compared to using the participant's cues himself (75.91% vs. 74.32%). Moreover using the behavioural cues of the other participant is also informative where it permits the detection of the engagement of the participant in question at an accuracy of 62.15% on average. The correlation between the features of the other participant with the engagement labels of the participant in question suggests a high cohesion between the two participants. In addition, the similarity of the most significantly correlated features among the two participants suggests a high synchrony between the two parties.
KW - Human-Robot Interaction
KW - automatic engagement inference
KW - multi-party interaction
KW - social signal processing
UR - http://www.scopus.com/inward/record.url?scp=84963994959&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84963994959&partnerID=8YFLogxK
U2 - 10.1109/ACII.2015.7344593
DO - 10.1109/ACII.2015.7344593
M3 - Conference contribution
AN - SCOPUS:84963994959
T3 - 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
SP - 341
EP - 347
BT - 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
Y2 - 21 September 2015 through 24 September 2015
ER -