TY - GEN
T1 - The cross-modal congruency effect as an objective measure of embodiment
AU - Verhagen, Pim
AU - Kuling, Irene
AU - Gijsbertse, Kaj
AU - Stuldreher, Ivo V.
AU - Overvliet, Krista
AU - Falcone, Sara
AU - Van Erp, Jan
AU - Brouwer, Anne Marie
N1 - Publisher Copyright:
© 2020 ACM.
Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.
PY - 2020/10/25
Y1 - 2020/10/25
N2 - Remote control of robots generally requires a high level of expertise and may impose a considerable cognitive burden on operators. A sense of embodiment over a remote-controlled robot might enhance operators? task performance and reduce cognitive workload. We want to study the extent to which different factors affect embodiment. As a first step, we aimed to validate the cross-modal congruency effect (CCE) as a potential objective measure of embodiment under four conditions with different, a priori expected levels of embodiment, and by comparing CCE scores with subjective reports. The conditions were (1) a real hand condition (real condition), (2) a real hand seen through a telepresence unit (mediated condition), (3) a robotic hand seen through a telepresence unit (robot condition), and (4) a human-looking virtual hand seen through VR glasses (VR condition). We found no unambiguous evidence that the magnitude of the CCE was affected by the degree of visual realism in each of the four conditions. We neither found evidence to support the hypothesis that the CCE and embodiment score as assessed by the subjective reports are correlated. These findings raise serious concerns about the use of the CCE as an objective measure of embodiment.
AB - Remote control of robots generally requires a high level of expertise and may impose a considerable cognitive burden on operators. A sense of embodiment over a remote-controlled robot might enhance operators? task performance and reduce cognitive workload. We want to study the extent to which different factors affect embodiment. As a first step, we aimed to validate the cross-modal congruency effect (CCE) as a potential objective measure of embodiment under four conditions with different, a priori expected levels of embodiment, and by comparing CCE scores with subjective reports. The conditions were (1) a real hand condition (real condition), (2) a real hand seen through a telepresence unit (mediated condition), (3) a robotic hand seen through a telepresence unit (robot condition), and (4) a human-looking virtual hand seen through VR glasses (VR condition). We found no unambiguous evidence that the magnitude of the CCE was affected by the degree of visual realism in each of the four conditions. We neither found evidence to support the hypothesis that the CCE and embodiment score as assessed by the subjective reports are correlated. These findings raise serious concerns about the use of the CCE as an objective measure of embodiment.
KW - Cross-modal congruency effect
KW - Cross-modal congruency task
KW - Embodiment
KW - Multisensory integration
KW - Teleoperation
KW - Visuotactile integration
UR - http://www.scopus.com/inward/record.url?scp=85099221264&partnerID=8YFLogxK
U2 - 10.1145/3395035.3425264
DO - 10.1145/3395035.3425264
M3 - Conference contribution
AN - SCOPUS:85099221264
T3 - ICMI 2020 Companion - Companion Publication of the 2020 International Conference on Multimodal Interaction
SP - 107
EP - 111
BT - ICMI 2020 Companion - Companion Publication of the 2020 International Conference on Multimodal Interaction
PB - Association for Computing Machinery
T2 - 2020 International Conference on Multimodal Interaction, ICMI 2020
Y2 - 25 October 2020 through 29 October 2020
ER -