SHREC 2024: Recognition of dynamic hand motions molding clay

Ben Veldhuijzen*, Remco C. Veltkamp, Omar Ikne, Benjamin Allaert, Hazem Wannous, Marco Emporio, Andrea Giachetti, Joseph J. LaViola, Ruiwen He, Halim Benhabiles, Adnane Cabani, Anthony Fleury, Karim Hammoudi, Konstantinos Gavalas, Christoforos Vlachos, Athanasios Papanikolaou, Ioannis Romanelis, Vlassis Fotis, Gerasimos Arvanitis, Konstantinos MoustakasMartin Hanik, Esfandiar Nava-Yazdani, Christoph von Tycowicz

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Gesture recognition is a tool to enable novel interactions with different techniques and applications, like Mixed Reality and Virtual Reality environments. With all the recent advancements in gesture recognition from skeletal data, it is still unclear how well state-of-the-art techniques perform in a scenario using precise motions with two hands. This paper presents the results of the SHREC 2024 contest organized to evaluate methods for their recognition of highly similar hand motions using the skeletal spatial coordinate data of both hands. The task is the recognition of 7 motion classes given their spatial coordinates in a frame-by-frame motion. The skeletal data has been captured using a Vicon system and pre-processed into a coordinate system using Blender and Vicon Shogun Post. We created a small, novel dataset with a high variety of durations in frames. This paper shows the results of the contest, showing the techniques created by the 5 research groups on this challenging task and comparing them to our baseline method.

Original languageEnglish
Article number104012
Number of pages11
JournalComputers and Graphics (Pergamon)
Volume123
DOIs
Publication statusPublished - Oct 2024

Keywords

  • 3D shape retrieval challenge
  • Gesture recognition
  • Hand skeleton gestures
  • Motion capture
  • Neural networks
  • SHREC

Fingerprint

Dive into the research topics of 'SHREC 2024: Recognition of dynamic hand motions molding clay'. Together they form a unique fingerprint.

Cite this