Using Facial EMG to Track Emotion During Language Comprehension: Past, Present, and Future

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

Abstract

Beyond recognizing words, parsing sentences, building situation models, and other cognitive accomplishments, language comprehension always involves some degree of emotion too, with or without awareness. Language excites, bores, or otherwise moves us, and studying how it does so is crucial. This chapter examines the potential of facial electromyography (EMG) to study language-elicited emotion. After discussing the limitations of self-report measures, we examine various other tools to tap into emotion, and then zoom in on the electrophysiological recording of facial muscle activity. Surveying psycholinguistics, communication science, and other fields, we provide an exhaustive qualitative review of the relevant facial EMG research to date, exploring 55 affective comprehension experiments with single words, phrases, sentences, or larger pieces of discourse. We discuss the outcomes of this research, and evaluate the various practices, biases, and omissions in the field. We also present the fALC model, a new conceptual model that lays out the various potential sources of facial EMG activity during language comprehension. Our review suggests that facial EMG recording is a powerful tool for exploring the conscious as well as unconscious aspects of affective language comprehension. However, we also think it is time to take on a bit more complexity in this research field, by for example considering the possibility that multiple active generators can simultaneously contribute to an emotional facial expression, by studying how the communicator’s stance and social intention can give rise to emotion, and by studying facial expressions not just as indexes of inner states, but also as social tools that enrich everyday verbal interactions.

Original languageEnglish
Title of host publicationLanguage Electrified
Subtitle of host publicationPrinciples, Methods, and Future Perspectives of Investigation
EditorsMirko Grimaldi, Elvira Brattico, Yury Shtyrov
Place of PublicationNew York
PublisherSpringer
Chapter22
Pages687–729
Number of pages43
ISBN (Electronic)978-1-0716-3263-5
ISBN (Print)978-1-0716-3262-8
DOIs
Publication statusPublished - 2023

Publication series

NameNeuromethods
Volume202
ISSN (Print)0893-2336
ISSN (Electronic)1940-6045

Bibliographical note

Funding Information:
This work is partly supported by NWO Vici grant #277-89-001 to JvB. We thank Anita Eerland and Mirko Grimaldi for comments on an earlier version of this chapter, the members of the ILS Language & Communication research group for feedback on some of the ideas presented here, and Ton van Boxtel for Fig. 1, and for generously sharing his expertise when we embarked upon our first EMG project.

Publisher Copyright:
© 2023, Springer Science+Business Media, LLC, part of Springer Nature.

Keywords

  • Communication science
  • EMG
  • Emotion
  • Evaluation
  • Facial electromyography
  • Mimicry
  • Psycholinguistics
  • Psychophysiology
  • Review
  • Simulation

Fingerprint

Dive into the research topics of 'Using Facial EMG to Track Emotion During Language Comprehension: Past, Present, and Future'. Together they form a unique fingerprint.

Cite this