Fact sheet: Automatic self-reported personality recognition Track

Hanan Salam, Oya Celiktutan, Himadri Mukherjee, Viswonathan Manoranjan, Iman Ismail

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Smart phones, voice assistants, and home robots are becoming more intelligent every day to support humans in their daily routines and tasks. Achieving the user acceptance and success of such technologies makes it necessary for them to be socially informed, responsive, and responsible. They need to understand human behaviour and socio-emotional states and adapt themselves to their user’s profiles (eg, personality) and preferences. Motivated by this, there has been a significant effort in recognising personality from multimodal data in the last decade [1],[2]. However, to the best of our knowledge, the methods so far have focused on one-fits-all approaches only and performed personality recognition without taking into consideration the user’s profiles (eg, gender and age). In this paper, we took a different approach, and we argued that one-fits-all approach does not work sufficiently for personality recognition as previous research showed that there are significant gender differences in personality traits. For example, women tend to report higher scores for extraversion, agreeableness and neuroticsm as compared to men [3]. Building upon these findings, we first clustered the participants into two profiles based on their gender, namely, female and male, and then used Neural Architecture Search (NAS) to automatically design a model for each profile to recognise personality. A separate network was designed and trained with visual and text features. The final prediction was obtained by aggregating the results of both video and text modalities. Figure 1 presents the overview of our proposed approach.
Original languageEnglish (US)
Title of host publicationICCV 2021 Understanding Social Behavior in Dyadic and Small Group Interactions Challenge
StatePublished - 2021


Dive into the research topics of 'Fact sheet: Automatic self-reported personality recognition Track'. Together they form a unique fingerprint.

Cite this