Collaborative Feature Maps for Interactive Video Search

K. Schoeffmann*, Manfred J. Primus, B. Münzer, Stefan Petscharnig, Christof Karisch, Qing Xu, W.O. Hürst

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    Abstract

    This extended demo paper summarizes our interface used for the Video Browser Showdown (VBS) 2017 competition, where visual and textual known-item search (KIS) tasks, as well as ad-hoc video search (AVS) tasks in a 600-h video archive need to be solved interactively. To this end, we propose a very flexible distributed video search system that combines many ideas of related work in a novel and collaborative way, such that several users can work together and explore the video archive in a complementary manner. The main interface is a perspective Feature Map, which shows keyframes of shots arranged according to a selected content similarity feature (e.g., color, motion, semantic concepts, etc.). This Feature Map is accompanied by additional views, which allow users to search and filter according to a particular content feature. For collaboration of several users we provide a cooperative heatmap that shows a synchronized view of inspection actions of all users. Moreover, we use collaborative re-ranking of shots (in specific views) based on retrieved results of other users.
    Original languageEnglish
    Title of host publicationMultiMedia modeling
    Subtitle of host publication23rd International Conference, MMM 2017, Reykjavik, Iceland, January 4-6, 2017, Proceedings
    PublisherSpringer
    Pages457-462
    Number of pages6
    ISBN (Electronic)978-3-319-51814-5
    ISBN (Print)978-3-319-51813-8
    DOIs
    Publication statusPublished - 2017

    Publication series

    NameLecture Notes in Computer Science
    Volume10133

    Fingerprint

    Dive into the research topics of 'Collaborative Feature Maps for Interactive Video Search'. Together they form a unique fingerprint.

    Cite this