Consumer Camera Demosaicking and Denoising With a Collaborative Attention Fusion Network

Nianzeng Yuan,Junhuai Li,Bangyong Sun

Published 2024 in IEEE transactions on consumer electronics

ABSTRACT

For the consumer cameras with Bayer filter array, raw color filter array (CFA) data collected in real-world is sampled with signal-dependent noise. Various joint denoising and demosaicking (JDD) methods are utilized to reconstruct full-color and noise-free images. However, some artifacts (e.g., remaining noise, color distortion, and fuzzy details) still exist in the reconstructed images by most JDD models, mainly due to the highly related challenges of low sampling rate and signal-dependent noise. In this paper, a collaborative attention fusion network (CAF-Net), with two key modules, is proposed to solve this issue. Firstly, a multi-weight attention module is proposed to efficiently extract image features by realizing the interaction of spatial, channel, and pixel attention mechanisms. By designing a local feedforward network and mask convolution aggregation of multiple receptive fields, we then propose an effective dual-branch feature fusion module, which enhances image details and spatial correlation. Accordingly, the proposed two modules significantly facilitate our CAF-Net to recover a high-quality image, by accurately inferring the correlations of color, noise, and the spatial distribution of the CFA data. Extensive experiments on demosaicking, synthetic, and real image JDD tasks prove that the proposed CAF-Net can achieve advanced performance in terms of objective evaluation index metrics and visual perception.

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-70 of 70 references · Page 1 of 1