Towards Emotion-based Adaptive Games: Emotion recognition via input and performance features

Julian Frommel, Claudia Schrader, Michael Weber

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

During game play undesired emotions can arise, impeding players’ positive experiences. Adapting game features based on players’ emotions can help to address this problem, but necessitates a way to detect the current emotional state. We investigate using input parameters on a graphics tablet in combination with in-game performance to unobtrusively detect the players’ current emotional state. We conducted a user study with 48 participants to collect self-reported emotions, input data from the tablet and in-game performance in a serious game teaching players to write Japanese hiragana characters. We synchronized data, extracted 46 features, trained machine learning models, and evaluated their performance to predict levels of valence, arousal, and dominance modeled as a seven class problem. The analysis shows that random forests achieve good accuracies with F 1 scores of .567 to .577 and AUC of .738 to .740, while using input features or in-game performance alone leads to highly decreased performance. Finally, we propose an architecture that developers can use to define undesired emotion levels to provide adaptive content generation in combination with emotion recognition.

Original languageEnglish
Title of host publicationCHI PLAY 2018 - Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play
PublisherAssociation for Computing Machinery
Pages187-199
Number of pages13
ISBN (Electronic)9781450356244
DOIs
Publication statusPublished - 23 Oct 2018
Event5th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2018 - Melbourne, Australia
Duration: 28 Oct 201831 Oct 2018

Publication series

NameCHI PLAY 2018 - Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play

Conference

Conference5th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2018
Country/TerritoryAustralia
CityMelbourne
Period28/10/1831/10/18

Keywords

  • Adaptive games
  • Classification
  • Emotion recognition
  • Machine learning
  • Performance

Fingerprint

Dive into the research topics of 'Towards Emotion-based Adaptive Games: Emotion recognition via input and performance features'. Together they form a unique fingerprint.

Cite this