Previous learning-based interpolation methods do not consider multi-scale structural information, which is generally effective for image modeling. In this paper, we design a deep network based on a novel pyramid variation learning approach with multi-scale structure modeling. An image is represented as multi-dimensional features. Besides two spatial dimensions, the features include a neighboring variation dimension where every pixel is encoded as the variation to its nearest low-resolution pixel, and a scale dimension along which the feature maps generated by a gradual down-sampling process are stacked. Thus, these multi-dimensional features are constructed to model local dependency and multi-scale similarity jointly. Inspired by this feature design, we build an end-to-end trainable Recurrent Multi-Path Aggregation Network (RMPAN) for image interpolation, where the scale dimension is unfolded to form a multi-path aggregation network to apply joint filters at different scales recurrently. Location aware sampling layers are used in RMPAN to transform feature maps into different scales with only location changes in each convolution path, which aggregate the context information without resolution loss. Comprehensive experiments demonstrate that our method leads to a superior performance and offers new state-of-the-art benchmark.
Deep Pyramid Variation Learning for Image Interpolation
Q. Fu,Wenhan Yang,Ying Li,Jiaying Liu
Published 2019 in IEEE International Conference on Multimedia and Expo
ABSTRACT
PUBLICATION RECORD
- Publication year
2019
- Venue
IEEE International Conference on Multimedia and Expo
- Publication date
2019-07-01
- Fields of study
Computer Science
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-27 of 27 references · Page 1 of 1
CITED BY
Showing 1-2 of 2 citing papers · Page 1 of 1