Abstract
First impressions play a critical role in shaping social interactions and consequently have a high impact on people’s lives. This study presents an explainable system that models apparent personality traits that influence first impressions as a function of automatically predicted arousal, valence and likeability (AVL) scores. To this end, we enrich the ChaLearn Looking at People - First Impressions (LAP-FI) dataset by annotating a portion of it for the AVL dimensions and carry out extensive uni-modal and multimodal experiments by using state-of-the-art acoustic, visual and linguistic features. We propose to use a glass-box model, namely, Explainable Boosting Machine, to model the Big Five personality traits. Our results demonstrate that personality trait impressions can be effectively predicted through the mood and likeability scores of a given video. We show that the proposed model, which is trained on only a few features, not only provides more meaningful explanations but also yields competitive performance (with a 0.09 Mean Absolute Error) compared to the state-of-the-art methods. The annotated benchmark dataset and the scripts to reproduce the results are available at: https://github.com/gizemsogancioglu/mood-project.
Original language | English |
---|---|
Title of host publication | 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII) |
Publisher | IEEE |
Pages | 1-8 |
Number of pages | 8 |
ISBN (Print) | 978-1-6654-0020-6 |
DOIs | |
Publication status | Published - 1 Oct 2021 |
Event | 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII) - Nara, Japan Duration: 28 Sept 2021 → 1 Oct 2021 |
Conference
Conference | 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII) |
---|---|
Period | 28/09/21 → 1/10/21 |
Bibliographical note
DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.Keywords
- Big Five personality traits
- Affective computing
- Mood recognition
- Predictive models
- Linguistics
- Benchmark testing
- Multimodal fusion
- Arousal
- Valence