Adaptive guided image filter for warping in variational optical flow computation

    Research output: Contribution to journalArticleAcademicpeer-review

    Abstract

    The variational optical flow method is considered to be the standard method to calculate an accurate dense motion field between successive frames. It assumes that the energy function has spatiotemporal continuities and appearance motions are small. However, for real image sequences, the temporal continuity assumption is often violated due to outliers and occlusions, causing inaccurate flow vectors at these regions. After each warping operation, errors are generated at the corresponding regions of the warped interpolation image. This results in an inaccurate discrete approximation of the temporal derivative and thus ends up affecting the accuracy of the estimated flow field. In this paper, we propose an adaptive guided image filter to correct these errors in the warped interpolation image. A guidance image is reconstructed by considering both the feature of the reference image as well as the difference between the warped interpolation image and the reference image, to guide the filtering of the warped interpolation image. To adjust the smoothing degree, the regularization parameter in the guided image filter is adaptively selected based on a confidence measure. Extensive experiments on different datasets and comparison with state-of-the-art variational optical flow algorithms demonstrate the effectiveness of our method.
    Original languageEnglish
    Pages (from-to)253-265
    JournalSignal Processing
    Volume127
    DOIs
    Publication statusPublished - 2016

    Keywords

    • Variational optical flow
    • Warped interpolation image correction
    • Adaptive guided image filter

    Fingerprint

    Dive into the research topics of 'Adaptive guided image filter for warping in variational optical flow computation'. Together they form a unique fingerprint.

    Cite this