How nervous am I? How computer vision succeeds and humans fail in interpreting state anxiety from dynamic facial behaviour

Mithras Kuipers, Mitchel Kappen, Marnix Naber*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

For human interaction, it is important to understand what emotional state others are in. Especially the observation of faces aids us in putting behaviours into context and gives insight into emotions and mental states of others. Detecting whether someone is nervous, a form of state anxiety, is such an example as it reveals a person’s familiarity and contentment with the circumstances. With recent developments in computer vision we developed behavioural nervousness models to show which time-varying facial cues reveal whether someone is nervous in an interview setting. The facial changes, reflecting a state of anxiety, led to more visual exposure and less chemosensory (taste and olfaction) exposure. However, experienced observers had difficulty picking up these changes and failed to detect nervousness levels accurately therewith. This study highlights humans’ limited capacity in determining complex emotional states but at the same time provides an automated model that can assist us in achieving fair assessments of so far unexplored emotional states.

Original languageEnglish
Pages (from-to)1105-1115
Number of pages11
JournalCognition and Emotion
Volume37
Issue number6
DOIs
Publication statusPublished - 3 Jul 2023

Keywords

  • computer vision
  • emotion
  • facial behaviour
  • Nervousness
  • state anxiety

Fingerprint

Dive into the research topics of 'How nervous am I? How computer vision succeeds and humans fail in interpreting state anxiety from dynamic facial behaviour'. Together they form a unique fingerprint.

Cite this