Deinterlacing Using Variational Methods

We present a variational framework for deinterlacing that was originally used for inpainting and subsequently redeveloped for deinterlacing. From the framework, we derive a motion adaptive (MA) deinterlacer and a motion compensated (MC) deinterlacer and test them together with a selection of known deinterlacers. To illustrate the need for MC deinterlacing, the problem of details in motion (DIM) is introduced. It cannot be solved by MA deinterlacers or any simpler deinterlacers but only by MC deinterlacers. The major problem in MC deinterlacing is computing reliable optical flow [motion estimation (ME)] in interlaced video. We discuss a number of strategies for computing optical flows on interlaced video hoping to shed some light on this problem. We produce results on challenging real world video data with our variational MC deinterlacer that in most cases are indistinguishable from the ground truth.

• Publication year

  2008

• Venue

  IEEE Transactions on Image Processing

• Publication date

  2008-11-01

• Fields of study

  Medicine, Computer Science

• Identifiers
  DOI 10.1109/TIP.2008.2003394PMID 18854255
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Deinterlacing Using Variational Methods

  2008cited by this paper
• A De-Interlacing Algorithm Using Markov Random Field Model

  2007cited by this paper
• An Inpainting- Based Deinterlacing Method

  2007cited by this paper
• Performance analysis of motion-compensated de-interlacing systems

  2006cited by this paper
• Variational Motion Compensated Deinterlacing

  2006cited by this paper
• A Total Variation Motion Adaptive Deinterlacing Scheme

  2005cited by this paper
• Spatial de-interlacing using dynamic time warping

  2005cited by this paper
• High Accuracy Optical Flow Estimation Based on a Theory for Warping

  2004cited by this paper
• A Variational Algorithm For Motion Compensated Inpainting

  2004cited by this paper
• Four field local motion compensated de-interlacing

  2004cited by this paper
• IEEE Transactions on Image Processing

  2004cited by this paper
• Evaluation of objective quality measures for noise reduction in TV-systems

  2004cited by this paper
• High Quality deinterlacing using Inpainting and shutter-Model Directed Temporal interpolation

  2004cited by this paper
• Simultaneous Inpainting and Motion Estimation of Highly Degraded Video-Sequences

  2003influential reference
• A novel de-interlacing technique based on phase plane correlation motion estimation

  2003cited by this paper
• FPGA architecture for a videowall image processor

  2001cited by this paper
• Video Processing and Communications

  2001cited by this paper
• De-Interlacing: A Key Technology for Scan Rate Conversion

  2000influential reference
• Image sequence processing for videowall visualization

  2000cited by this paper
• Deinterlacing by successive approximation

  1997cited by this paper
• A COMPARISON OF MOTION-COMPENSATED INTERLACE-TO-PROGRESSIVE CONVERSION METHODS

  1996cited by this paper
• [서평]「Digital Video Processing」

  1996cited by this paper
• Methodology for the subjective assessment of the quality of television pictures

  1995cited by this paper
• Geometry-Driven Diffusion in Computer Vision

  1994cited by this paper
• Bayesian Rationale for the Variational Formulation

  1994cited by this paper
• Improved interpolation, motion estimation, and compensation for interlaced pictures

  1993cited by this paper
• Nonlinear total variation based noise removal algorithms

  1992cited by this paper
• Determining Optical Flow

  1981cited by this paper
• Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Variational Optic Flow Computation in Real-time Variational Optic Flow Computation in Real-time

  year unknowncited by this paper
• Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Lucas/kanade Meets Horn/schunck: Combining Local and Global Optic Flow Methods Lucas/kanade Meets Horn/schunck: Combining Local and Global Optic Flow Methods

  year unknowncited by this paper

• Euler equations and trace properties of minimizers of a functional for motion compensated inpainting

  2021cites this paper
• Punching holes in light: recent progress in single-shot coded-aperture optical imaging

  2020cites this paper
• Properties of a Variational Model for Video Inpainting

  2019cites this paper
• A Variational Method for Dejittering Large Fluorescence Line Scanner Images

  2018cites this paper
• Edge-based Error Concealment for Line Compression Methods

  2018cites this paper
• On Variational Methods for Motion Compensated Inpainting

  2018cites this paper
• Methods and algorithms of segmentation and deconvolution for quantitative analysis of Tissue Microarray images

  2017cites this paper
• Methods and algorithms of image segmentation and decovolution for quantitative analysis of Tissue Microarrays

  2017cites this paper
• The Adopting C4.5 classification and it's Application for Deinterlacing

  2017cites this paper
• Methods and algorithms of segmentation and deconvolution for quantitative analysis of Tissue Microarray images. (Méthodes et algorithmes de segmentation et de déconvolution d'images pour l'analyse quantitative de Tissue Microarrays)

  2017cites this paper
• Analysis of a variational model for motion compensated inpainting

  2017cites this paper
• Implementation of edge dependent interpolation based de-interlacer on FPGA

  2016cites this paper
• High-performance image deinterlacing using optical flow and artifact post-processing on GPU/CPU for surveillance and reconnaissance tasks

  2016cites this paper
• Efficient deinterlacing method using simple edge slope tracing

  2015cites this paper
• Motion-compensated TV-reconstruction-based video deinterlacing

  2014cites this paper
• Algorithm adaptive video deinterlacing using self-validation framework

  2013cites this paper
• A Motion Adaptive Deinterlacing Algorithm using Improved Motion Detection

  2013cites this paper
• Optimal interlacing using human sensitivity measurements

  2013cites this paper
• A Sparse Reconstruction Approach to Video Deinterlacing

  2012cites this paper
• Measurement of Human Sensitivity across the Vertical-Temporal Video Spectrum for Interlacing Filter Specification

  2012cites this paper
• The Architecture Design of Motion Adaptive De-interlacing with Multi-directional Motion? ??? Detection

  2012cites this paper
• CCTV 영상에서 참조 영상을 이용한 자동차 번호판 인식률 제고

  2012cites this paper
• Image Processing-based Validation of Unrecognizable Numbers in Severely Distorted License Plate Images

  2012cites this paper
• Decentralized Control of a Material Flow System Enabled by an Embedded Computer Vision System

  2011cites this paper
• Partial Differential Equations for Zooming, Deinterlacing and Dejittering

  2011cites this paper
• Video Super-Resolution Using Simultaneous Motion and Intensity Calculations

  2011cites this paper
• An HQV-approved edge directed interpolation algorithm for de-interlacing

  2011cites this paper
• GPU-aided motion adaptive video deinterlacing

  2010cites this paper
• Marker-based tracking in support of RFID controlled material flow systems

  2010cites this paper
• Temporal Super Resolution Using Variational Methods

  2010cites this paper
• Deinterlacing with Motion-Compensated Anisotropic Diffusion

  2009cites this paper
• Total variation regularization filtering for video signal processing

  2009cites this paper
• Improvement on optical flow based video deinterlacing by adopting Flow Vector And Intensity Reliabilities

  2009cites this paper
• Deinterlacing Using Variational Methods

  2008cites this paper