Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions

Hossein Miri; Jan Kolkmeier; Paul J. Taylor; R.W. Poppe; Dirk K J Heylen

doi:10.1007/978-3-319-49616-0_28

Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions

Hossein Miri
, Jan Kolkmeier
, Paul J. Taylor
, R.W. Poppe
, Dirk K J Heylen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

Abstract

This paper presents a multimodal simulation system, project-SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.

Original language	English
Title of host publication	Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN)
Publisher	Springer
Pages	279-284
DOIs	https://doi.org/10.1007/978-3-319-49616-0_28
Publication status	Published - 2016

Publication series

Name	Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
Publisher	Springer International Publishing
Volume	178
ISSN (Print)	1867-8211

Keywords

Virtual reality
Motion capture
Interactive conversational agents
Mimicry
Social skills
Interpersonal sensemaking

Access to Document

10.1007/978-3-319-49616-0_28

978-3-319-49616-0_28Final published version, 275 KBLicence: Taverne

Cite this

Miri, H., Kolkmeier, J., Taylor, P. J., Poppe, R. W., & Heylen, D. K. J. (2016). Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions. In Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN) (pp. 279-284). (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering; Vol. 178). Springer. https://doi.org/10.1007/978-3-319-49616-0_28

Miri, Hossein ; Kolkmeier, Jan ; Taylor, Paul J. et al. / Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions. Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN). Springer, 2016. pp. 279-284 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering).

@inproceedings{a02d0682de534378be8f3b836843913c,

title = "Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions",

abstract = "This paper presents a multimodal simulation system, project-SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.",

keywords = "Virtual reality, Motion capture, Interactive conversational agents, Mimicry, Social skills, Interpersonal sensemaking",

author = "Hossein Miri and Jan Kolkmeier and Taylor, \{Paul J.\} and R.W. Poppe and Heylen, \{Dirk K J\}",

year = "2016",

doi = "10.1007/978-3-319-49616-0\_28",

language = "English",

series = "Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering",

publisher = "Springer",

pages = "279--284",

booktitle = "Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN)",

}

Miri, H, Kolkmeier, J, Taylor, PJ, Poppe, RW & Heylen, DKJ 2016, Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions. in Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN). Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 178, Springer, pp. 279-284. https://doi.org/10.1007/978-3-319-49616-0_28

Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions. / Miri, Hossein; Kolkmeier, Jan; Taylor, Paul J. et al.
Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN). Springer, 2016. p. 279-284 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering; Vol. 178).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions

AU - Miri, Hossein

AU - Kolkmeier, Jan

AU - Taylor, Paul J.

AU - Poppe, R.W.

AU - Heylen, Dirk K J

PY - 2016

Y1 - 2016

N2 - This paper presents a multimodal simulation system, project-SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.

AB - This paper presents a multimodal simulation system, project-SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.

KW - Virtual reality

KW - Motion capture

KW - Interactive conversational agents

KW - Mimicry

KW - Social skills

KW - Interpersonal sensemaking

U2 - 10.1007/978-3-319-49616-0_28

DO - 10.1007/978-3-319-49616-0_28

M3 - Conference contribution

T3 - Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

SP - 279

EP - 284

BT - Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN)

PB - Springer

ER -

Miri H, Kolkmeier J, Taylor PJ, Poppe RW, Heylen DKJ. Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions. In Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN). Springer. 2016. p. 279-284. (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering). doi: 10.1007/978-3-319-49616-0_28

Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions

Abstract

Publication series

Keywords

Access to Document

Fingerprint

Cite this