TY - GEN
T1 - Multimodal Augmented Reality – Augmenting Auditory-Tactile Feedback to Change the Perception of Thickness
AU - Lugtenberg, Geert
AU - Hürst, Wolfgang
AU - Rosa, Nina
AU - Sandor, Christian
AU - Plopski, Alexander
AU - Taketomi, Takafumi
AU - Kato, Hirokazu
PY - 2018/1/1
Y1 - 2018/1/1
N2 - With vision being a primary sense of humans, we often first estimate the physical properties of objects by looking at them. However, when in doubt, for example, about the material they are made of or its structure, it is natural to apply other senses, such as haptics by touching them. Aiming at the ultimate goal of achieving a full-sensory augmented reality experience, we present an initial study focusing on multimodal feedback when tapping an object to estimate the thickness of its material. Our results indicate that we can change the perception of thickness of stiff objects by modulating acoustic stimuli. For flexible objects, which have a more distinctive tactile characteristic, adding vibratory responses when tapping on thick objects can make people perceive them as thin. We also identified that in the latter case, adding congruent acoustic stimuli does not further enhance the illusion but worsens it.
AB - With vision being a primary sense of humans, we often first estimate the physical properties of objects by looking at them. However, when in doubt, for example, about the material they are made of or its structure, it is natural to apply other senses, such as haptics by touching them. Aiming at the ultimate goal of achieving a full-sensory augmented reality experience, we present an initial study focusing on multimodal feedback when tapping an object to estimate the thickness of its material. Our results indicate that we can change the perception of thickness of stiff objects by modulating acoustic stimuli. For flexible objects, which have a more distinctive tactile characteristic, adding vibratory responses when tapping on thick objects can make people perceive them as thin. We also identified that in the latter case, adding congruent acoustic stimuli does not further enhance the illusion but worsens it.
KW - Augmented reality
KW - Multimodal AR
KW - Multimodal perception
UR - http://www.scopus.com/inward/record.url?scp=85042104957&partnerID=8YFLogxK
U2 - 10.1007/978-3-319-73603-7_30
DO - 10.1007/978-3-319-73603-7_30
M3 - Conference contribution
AN - SCOPUS:85042104957
SN - 9783319736020
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 369
EP - 380
BT - MultiMedia Modeling - 24th International Conference, MMM 2018, Proceedings
A2 - Schoeffmann, Klaus
A2 - Gabbouj, Moncef
A2 - O'Connor, Noel E.
A2 - Elgammal, Ahmed
A2 - Chalidabhongse, Thanarat H.
A2 - Aramvith, Supavadee
A2 - Ngo, Chong Wah
A2 - Ho, Yo-Sung
PB - Springer
T2 - 24th International Conference on MultiMedia Modeling, MMM 2018
Y2 - 5 February 2018 through 7 February 2018
ER -