The missing interface: Micro-gestures on augmented objects

Klen Čopič Pucihar, Wolfgang Huerst, Hirokazu Kato, Christian Sandor, Alexander Plopski, Luis A. Leiva, Matjazč Kljun, Takafumi Taketomi

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Augmenting arbitrary physical objects with digital content leads to the missing interface problem, because those objects were never designed to incorporate such digital content and so they lack a user interface. A review of related work reveals that current approaches fail due to limited detection fidelity and spatial resolution. Our proposal, based on Google Soli's radar sensing technology, is designed to detect micro-gestures on objects with sub-millimeter precision. Preliminary results with a custom gesture set show that Soli's core features and traditional machine learning models (Random Forest and Support Vector Machine) do not lead to robust recognition accuracy, and so more advanced techniques should be used instead, possibly incorporating additional sensor features.

Original languageEnglish
Title of host publicationCHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450359719
DOIs
Publication statusPublished - 2 May 2019
Event2019 CHI Conference on Human Factors in Computing Systems, CHI EA 2019 - Glasgow, United Kingdom
Duration: 4 May 20199 May 2019

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2019 CHI Conference on Human Factors in Computing Systems, CHI EA 2019
Country/TerritoryUnited Kingdom
CityGlasgow
Period4/05/199/05/19

Keywords

  • Augmented Reality
  • Google Soli
  • Micro-gesture Recognition
  • Millimeter-wave Radar

Fingerprint

Dive into the research topics of 'The missing interface: Micro-gestures on augmented objects'. Together they form a unique fingerprint.

Cite this