SCIENCE@home

Temporal Frame Interpolation With Motion-Divergence-Guided Occlusion Handling

Dominic Rüfenacht,R. Mathew,D. Taubman

Published 2019 in IEEE transactions on circuits and systems for video technology (Print)

ABSTRACT

We present a high-quality temporal frame interpolation (TFI) method that employs piecewise-smooth motion and handles disoccluded regions using the observation that motion discontinuities travel with the foreground object. We derive a “motion discontinuity” likelihood map from the divergence of a motion field between the input frames. Motion which is modeled at the reference frame is mapped to the target frame using a cellular-affine mapping strategy—a process during which regions of disocclusion are readily observed. This information is then used to guide the occlusion-aware, bidirectional FI process. Furthermore, we propose two computationally inexpensive texture optimizations that selectively improve the quality of the interpolated frames in regions around moving objects. The scheme produces very high-quality interpolated frames and outperforms current high-quality state-of-the-art TFI schemes by 2–2.5 dB; the method works with a very low-complexity motion estimation scheme and runs orders of magnitudes faster than its competitors.

PUBLICATION RECORD

  • Publication year

    2019

  • Venue

    IEEE transactions on circuits and systems for video technology (Print)

  • Publication date

    2019-02-01

  • Fields of study

    Computer Science

  • Identifiers
    DOI 10.1109/TCSVT.2018.2800773
  • External record

    Open on Semantic Scholar

  • Source metadata

    Semantic Scholar

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-40 of 40 references · Page 1 of 1

CITED BY

Showing 1-12 of 12 citing papers · Page 1 of 1