Weighted Local Intensity Fusion Method for Variational Optical Flow Estimation

    Research output: Contribution to journalArticleAcademicpeer-review

    Abstract

    Estimating a dense motion field of successive video frames is a fundamental problem in image processing. The multi-scale variational optical flow method is a critical technique that addresses this issue. Despite the considerable progress over the past decades, there are still some challenges such as dealing with large displacements and estimating the smoothness parameter. We present a local intensity fusion (LIF) method to tackle these difficulties. By evaluating the local interpolation error in terms of L1 block match on the corresponding set of images, we fuse flow proposals which are obtained from different methods and from different parameter settings integrally under a unified LIF. This approach has two benefits: (1) the incorporated matching information is helpful to recover large displacements; and (2) the obtained optimal fusion solution gives a tradeoff between the data term and the smoothness term. In addition, a selective gradient based weight is introduced to improve the performance of the LIF. Finally, we propose a corrected weighted median filter (CWMF), which applies the motion information to correct errors of the color distance weight to denoise the intermediate flow fields during optimization. Experiments demonstrate the effectiveness of our method.
    Original languageEnglish
    Pages (from-to)223-232
    JournalPattern Recognition
    Volume50
    DOIs
    Publication statusPublished - 2016

    Keywords

    • Optical flow
    • Weighted local intensity fusion
    • Large displacement
    • Smoothness parameter estimation
    • Corrected weighted median filter

    Fingerprint

    Dive into the research topics of 'Weighted Local Intensity Fusion Method for Variational Optical Flow Estimation'. Together they form a unique fingerprint.

    Cite this