Towards personalised gaming via facial expression recognition

Paris Mavromoustakos Blom, Sander Bakkes, Chek Tien Tan, Shimon Whiteson, Diederik Roijers, Roberto Valenti, Theo Gevers

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

In this paper we propose an approach for personalising the space in which a game is played (i.e., levels) dependent on classifications of the user's facial expression - to the end of tailoring the affective game experience to the individual user. Our approach is aimed at online game personalisation, i.e., the game experience is personalised during actual play of the game. A key insight of this paper is that game personalisation techniques can leverage novel computer vision-based techniques to unobtrusively infer player experiences automatically based on facial expression analysis. Specifically, to the end of tailoring the affective game experience to the individual user, in this paper we (1) leverage the proven INSIGHT facial expression recognition SDK as a model of the user's affective state (Sightcorp 2014), and (2) employ this model for guiding the online game personalisation process. User studies that validate the game personalisation approach in the actual video game INFINITE MARIO BROS. reveal that it provides an effective basis for converging to an appropriate affective state for the individual human player.

Original languageEnglish
Title of host publicationProceedings of the 10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014
PublisherAAAI Press
Pages30-36
Number of pages7
ISBN (Electronic)9781577356813
Publication statusPublished - 2014
Event10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014 - Raleigh, United States
Duration: 3 Oct 20147 Oct 2014

Publication series

NameProceedings of the 10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014

Conference

Conference10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014
Country/TerritoryUnited States
CityRaleigh
Period3/10/147/10/14

Fingerprint

Dive into the research topics of 'Towards personalised gaming via facial expression recognition'. Together they form a unique fingerprint.

Cite this