This article proposes a generative image model, which is called ''primal sketch,'' following Marr's insight and terminology. This model combines two prominent classes of generative models, namely, sparse coding model and Markov random field model, for representing geometric structures and stochastic textures, respectively. Specifically, the image lattice is divided into structure domain and texture domain. The sparse coding model is used to represent image intensities on the structure domain, where edge and ridge segments are modeled by image coding functions with explicit geometric and photometric parameters. The edge and ridge segments form a sketch graph whose nodes are corners and junctions. The sketch graph is governed by a simple spatial prior model. The Markov random field model is used to summarize image intensities on the texture domain, where the texture patterns are characterized by feature statistics in the form of marginal histograms of responses from a set of linear filters. The Markov random fields in-paint the texture domain while interpolating the structure domain seamlessly. A sketch pursuit algorithm is proposed for model fitting. A number of experiments on real images are shown to demonstrate the model and the algorithm.
Primal sketch: Integrating structure and texture
Cheng-en Guo,Song-Chun Zhu,Y. Wu
Published 2007 in Computer Vision and Image Understanding
ABSTRACT
PUBLICATION RECORD
- Publication year
2007
- Venue
Computer Vision and Image Understanding
- Publication date
2007-04-01
- Fields of study
Mathematics, Computer Science
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
CLAIMS
CONCEPTS
- image coding functions
Functions that encode edge and ridge segments using geometric and photometric parameters.
- markov random field model
A probabilistic texture model that summarizes image intensities through statistics of linear-filter responses.
Aliases: MRF model, Markov random field
- primal sketch
A generative image model that partitions an image lattice into structure and texture domains for joint representation.
Aliases: primal-sketch
- sketch graph
The graph formed by corners and junctions connected by edge and ridge segments in the structural representation.
- sketch pursuit algorithm
An algorithm used to fit the primal sketch model to images.
- sparse coding model
A sparse representation model used to encode intensities on the structure domain with explicit geometric and photometric parameters.
Aliases: sparse coding
- structure domain
The part of the image lattice reserved for structured elements such as edges and ridges.
- texture domain
The part of the image lattice reserved for stochastic texture patterns.
REFERENCES
Showing 1-32 of 32 references · Page 1 of 1