What if HAL breathed? Enhancing Empathy in Human-AI Interactions with Breathing Speech Synthesis

Research output: Contribution to journalConference articleAcademicpeer-review

Abstract

AI Agents increasingly leverage speech synthesis models to communicate with their users. This study explores the integration of breathing patterns into synthesized speech to deepen empathy towards AI agents. The research methodologically diverges from traditional empathy studies and speech evaluation standards by proposing to the participants the resolution of an emotional dilemma within a cooperative game scenario, where they face a choice reflecting their empathetic engagement with an AI partner. The introduction of a novel speech assessment method that takes into account the interactive and contextual aspects of conversational speech is the first novelty of the paper. The second novelty is in the findings which indicate that breathing in synthesized speech significantly enhances agents' perceived naturalness and users' empathy towards them.

Original languageEnglish
Pages (from-to)2625-2629
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
DOIs
Publication statusPublished - 2024
Event25th Interspeech Conferece 2024 - Kos Island, Greece
Duration: 1 Sept 20245 Sept 2024

Bibliographical note

Publisher Copyright:
© 2024 International Speech Communication Association. All rights reserved.

Keywords

  • breathing
  • empathy
  • speech synthesis
  • virtual agents

Fingerprint

Dive into the research topics of 'What if HAL breathed? Enhancing Empathy in Human-AI Interactions with Breathing Speech Synthesis'. Together they form a unique fingerprint.

Cite this