Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data

In this paper, we investigate into the problem of image quality assessment (IQA) and enhancement via machine learning. This issue has long attracted a wide range of attention in computational intelligence and image processing communities, since, for many practical applications, e.g., object detection and recognition, raw images are usually needed to be appropriately enhanced to raise the visual quality (e.g., visibility and contrast). In fact, proper enhancement can noticeably improve the quality of input images, even better than originally captured images, which are generally thought to be of the best quality. In this paper, we present two most important contributions. The first contribution is to develop a new no-reference (NR) IQA model. Given an image, our quality measure first extracts 17 features through analysis of contrast, sharpness, brightness and more, and then yields a measure of visual quality using a regression module, which is learned with big-data training samples that are much bigger than the size of relevant image data sets. The results of experiments on nine data sets validate the superiority and efficiency of our blind metric compared with typical state-of-the-art full-reference, reduced-reference and NA IQA methods. The second contribution is that a robust image enhancement framework is established based on quality optimization. For an input image, by the guidance of the proposed NR-IQA measure, we conduct histogram modification to successively rectify image brightness and contrast to a proper level. Thorough tests demonstrate that our framework can well enhance natural images, low-contrast images, low-light images, and dehazed images. The source code will be released at https://sites.google.com/site/guke198701/publications.

• Publication year

  2018

• Venue

  IEEE Transactions on Neural Networks and Learning Systems

• Publication date

  2018-04-01

• Fields of study

  Medicine, Computer Science

• Identifiers
  DOI 10.1109/TNNLS.2017.2649101arXiv 1904.08632PMID 28287984
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• A Fast Reliable Image Quality Predictor by Fusing Micro- and Macro-Structures

  2017influential reference
• Single Image Haze Removal Using Dark Channel Prior

  2016influential reference
• Nonparametric Quality Assessment of Natural Images

  2016cited by this paper
• The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement

  2016influential reference
• Brain-Inspired Deep Networks for Image Aesthetics Assessment

  2016cited by this paper
• Guided Image Contrast Enhancement Based on Retrieved Images in Cloud

  2016cited by this paper
• Toward a Blind Deep Quality Evaluator for Stereoscopic Images Based on Monocular and Binocular Interactions

  2016cited by this paper
• Learning a blind quality evaluation engine of screen content images

  2016influential reference
• Blind Quality Assessment of Tone-Mapped Images Via Analysis of Information, Naturalness, and Structure

  2016cited by this paper
• A Feature-Enriched Completely Blind Image Quality Evaluator

  2015influential reference
• Blind Image Quality Assessment via Deep Learning

  2015cited by this paper
• Image database TID2013: Peculiarities, results and perspectives

  2015influential reference
• No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics

  2015influential reference
• Quality Assessment Considering Viewing Distance and Image Resolution

  2015cited by this paper
• A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images

  2015influential reference
• Distilling the Knowledge in a Neural Network

  2015cited by this paper
• No-Reference Image Sharpness Assessment in Autoregressive Parameter Space

  2015cited by this paper
• Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging

  2015cited by this paper
• Automatic Contrast Enhancement Technology With Saliency Preservation

  2015influential reference
• Using Free Energy Principle For Blind Image Quality Assessment

  2015influential reference
• Quality Assessment for Comparing Image Enhancement Algorithms

  2014influential reference
• Subjective quality assessment of Screen Content Images

  2014cited by this paper
• VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment

  2014influential reference
• Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images

  2014cited by this paper
• An efficient color image quality metric with local-tuned-global model

  2014cited by this paper
• Subjective and objective quality assessment for images with contrast change

  2013cited by this paper
• Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning

  2013influential reference
• Making a “Completely Blind” Image Quality Analyzer

  2013influential reference
• From Image Statistics to Scene Gist: Evoked Neural Activity Reveals Transition from Low-Level Natural Image Structure to Scene Category

  2013cited by this paper
• Efficient Contrast Enhancement Using Adaptive Gamma Correction With Weighting Distribution

  2013influential reference
• Learning to Rank for Blind Image Quality Assessment

  2013cited by this paper
• ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images

  2012cited by this paper
• No-Reference Image Quality Assessment in the Spatial Domain

  2012influential reference
• Fourier Transform-Based Scalable Image Quality Measure

  2012influential reference
• A Fast Wavelet-Based Algorithm for Global and Local Image Sharpness Estimation

  2012cited by this paper
• RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment

  2012influential reference
• FSIM: A Feature Similarity Index for Image Quality Assessment

  2011influential reference
• Single Image Haze Removal Using Dark Channel Prior

  2011cited by this paper
• A perceptual metric for photo retouching

  2011cited by this paper
• Blind Image Quality Assessment Using a General Regression Neural Network

  2011cited by this paper
• Content-based photo quality assessment

  2011cited by this paper
• LIBSVM: A library for support vector machines

  2011cited by this paper
• Objective Image Quality Assessment Based on Support Vector Regression

  2010cited by this paper
• Most apparent distortion: full-reference image quality assessment and the role of strategy

  2010influential reference
• Brain responses strongly correlate with Weibull image statistics when processing natural images.

  2009cited by this paper
• A Histogram Modification Framework and Its Application for Image Contrast Enhancement

  2009cited by this paper
• Reduced-Reference IQA in Contourlet Domain

  2009cited by this paper
• Image Quality Assessment Based on Multiscale Geometric Analysis

  2009cited by this paper
• UvA-DARE (Digital Academic Repository) Brain responses strongly correlate with Weibull image statistics when processing natural images

  2009cited by this paper
• Wavelet-based contourlet in quality evaluation of digital images

  2008cited by this paper
• Image statistics and the perception of surface qualities

  2007cited by this paper
• Studying Aesthetics in Photographic Images Using a Computational Approach

  2006cited by this paper
• Image quality assessment: from error visibility to structural similarity

  2004cited by this paper
• TID2008 – A database for evaluation of full-reference visual quality assessment metrics

  2004influential reference
• Measuring colorfulness in natural images

  2003cited by this paper
• Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope

  2001cited by this paper
• A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics

  2001cited by this paper
• Nonlinear dimensionality reduction by locally linear embedding.

  2000cited by this paper
• Similarity of color images

  1995cited by this paper
• Image Features from Phase Congruency

  1995cited by this paper
• The statistics of natural images

  1994cited by this paper
• Normalization of cell responses in cat striate cortex

  1992cited by this paper
• Mach bands are phase dependent

  1986cited by this paper
• The importance of phase in signals

  1980cited by this paper

• No-reference Magnetic Resonance Image Quality Assessment Via Local-Global Feature Integration

  2026cites this paper
• A Retinex-based variational model for low-light image enhancement with noise transformation

  2026cites this paper
• NGSCD: Nighttime Glow Suppression for Visibility Enhancement via Structural Cascade Decomposition Model

  2026cites this paper
• MF-CLF: Multi-Feature Chrominance–Luminance Fusion for Blind Underwater Image Quality Assessment

  2026cites this paper
• A Review on Computational Low-Light Image Enhancement Models: Challenges, Benchmarks, and Perspectives

  2025cites this paper
• Semantic-Guided Residual Learning for the Quality Assessment of Enhanced Images

  2025cites this paper
• Deep Underwater Image Quality Assessment With Explicit Degradation Awareness Embedding

  2025influential citation
• ZERRIN-Net: Adaptive low-light image enhancement using Retinex decomposition and noise extraction

  2025cites this paper
• Gamma: Toward Generic Image Assessment with Mixture of Assessment Experts

  2025cites this paper
• CoA: Towards Real Image Dehazing via Compression-and-Adaptation

  2025cites this paper
• Toward Dimension-Enriched Underwater Image Quality Assessment

  2025cites this paper
• Sinking into water without seeing water: Semi-supervised underwater image enhancement based on simulated image re-degradation process

  2025cites this paper
• Adaptive structural compensation enhancement based on multi-scale illumination estimation

  2025cites this paper
• Multi-scale Perception Enhancement of Structural Patch Decomposition and Fusion for low light imaging

  2025cites this paper
• Cross-Frequency Attention and Color Contrast Constraint for Remote Sensing Dehazing

  2025cites this paper
• Retinex-guided generative diffusion prior for low-light image enhancement

  2025cites this paper
• Breaking the Synthetic Barrier: Towards Stable and Generalizable Real-World Image Dehazing

  2025cites this paper
• No-Reference Image Contrast Assessment with Customized EfficientNet-B0

  2025cites this paper
• Contrast enhancement-based no-reference image quality assessment method

  2025cites this paper
• Illumination Map Estimation via Sparse Bright Channel for Enhancing Under-Exposed Images

  2025cites this paper
• Evaluating inter-and intra-rater reliability in the bronchoscopic grading of burn inhalation injury: The iBRONCH-BII study.

  2025cites this paper
• An Adaptive Non-Reference Approach for Characterizing and Assessing Image Quality in Multichannel GPR for Automatic Hyperbola Detection

  2025cites this paper
• A Hybrid Approach for Unified Image Quality Assessment: Permutation Entropy-Based Features Fused with Random Forest for Natural-Scene and Screen-Content Images for Cross-Content Applications

  2025cites this paper
• Adaptive enhancement of shoulder x-ray images using tissue attenuation and type-II fuzzy sets

  2025cites this paper
• Zero-reference generative exposure correction and adaptive fusion for low-light image enhancement

  2025cites this paper
• MM-PCQA+: Advancing Multi-Modal Learning for Point Cloud Quality Assessment

  2025cites this paper
• Advancing low-light image enhancement through deep learning: A comprehensive experimental study

  2025cites this paper
• Research on pedestrian recognition in complex scenarios based on data augmentation using large language models

  2025cites this paper
• Low-light image enhancement via collaborative dual-stream optimization with domain adaptation

  2025cites this paper
• LoRaDIP: Low-Rank Adaptation With Deep Image Prior for Generative Low-Light Image Enhancement

  2025cites this paper
• Joint luminance-chrominance learning for quality assessment of low-light image enhancement

  2025cites this paper
• Quantifying Objective and Perceived Image Quality Through EEG and Eye-Tracking

  2025cites this paper
• Illuminating the darkness: experimental review of cutting-edge deep learning techniques for low-light image enhancement

  2025cites this paper
• No-reference Quality Assessment of Contrast-distorted Images using Contrast-enhanced Pseudo Reference

  2025cites this paper
• Deep learning framework for bronchoscopic diagnosis of burn inhalation injury.

  2025cites this paper
• HyperHazeOff: Hyperspectral Remote Sensing Image Dehazing Benchmark

  2025cites this paper
• Perceptual Information Fidelity for Quality Estimation of Industrial Images

  2025cites this paper
• Multi-Scale Local and Global Feature Fusion for Blind Quality Assessment of Enhanced Images

  2025cites this paper
• QUIQ: quality-sensitive features for no-reference underwater image quality assessment

  2025cites this paper
• Diffusion Model-Based Visual Compensation Guidance and Visual Difference Analysis for No-Reference Image Quality Assessment

  2025cites this paper
• Light-Aware Contrastive Learning for Low-Light Image Enhancement

  2024cites this paper
• Visual smoke recognition based on an inverse-radiating attention pyramid network

  2024cites this paper
• UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessment

  2024influential citation
• Blind cartoon image quality assessment based on local structure and chromatic statistics

  2024cites this paper
• Blind quality assessment of night-time photos: A region selective approach

  2024cites this paper
• LMM-PCQA: Assisting Point Cloud Quality Assessment with LMM

  2024cites this paper
• Deep Blind Image Quality Assessment Using Dynamic Neural Model With Dual-Order Statistics

  2024cites this paper
• An ensemble transfer learning for nutrient deficiency identification and yield-loss prediction in crop

  2024cites this paper
• Bridging the Gap Between Haze Scenarios: A Unified Image Dehazing Model

  2024cites this paper
• Subjective and Objective Quality Assessment of Multi-Attribute Retouched Face Images

  2024cites this paper
• DDSNet: A dual-channel dual-mode smoke detection network for lightweight industrial scenarios

  2024cites this paper
• Learning sparse feature representation for blind quality assessment of night-time images

  2024cites this paper
• Subjective Quality Assessment of Thermal Infrared Images

  2024influential citation
• Satellite terminal collaborative processing method for sensing images based on neural networks

  2024cites this paper
• PIGUIQA: A Physical Imaging Guided Perceptual Framework for Underwater Image Quality Assessment

  2024cites this paper
• A novel self-attention weight transformer for air pollution smoke detection

  2024cites this paper
• Perceptually-calibrated synergy network for night-time image quality assessment with enhancement booster and knowledge cross-sharing

  2024cites this paper
• Blind Quality Evaluator for Enhanced Colonoscopy Images by Integrating Local and Global Statistical Features

  2024influential citation
• Content-Adaptive Efficient Transformer for No-Reference Underwater Image Quality Assessment

  2024cites this paper
• A low-light image enhancement model based on anisotropic weighted exponential local derivatives

  2024cites this paper
• Reversible data hiding with automatic contrast enhancement for color images

  2024cites this paper
• Reversible data hiding based on global and local automatic contrast enhancement of low-light color images

  2024cites this paper
• No-Reference Image Quality Assessment Using Local Binary Patterns: A Comprehensive Performance Evaluation

  2024cites this paper
• Zero-shot industrial image denoising with lightweight network

  2024cites this paper
• A New Image Quality Database for Multiple Industrial Processes

  2024cites this paper
• Satellite Image Restoration via an Adaptive QWNNM Model

  2024cites this paper
• Low-illuminance Image Enhancement Algorithm for Indoor Wine Cellar Scenes Based on Retinex-net

  2024cites this paper
• HNQA: histogram-based descriptors for fast night-time image quality assessment

  2024cites this paper
• An Improved CycleGAN-Based Model for Low-Light Image Enhancement

  2024cites this paper
• Progressive Bidirectional Feature Extraction and Enhancement Network for Quality Evaluation of Night-Time Images

  2024cites this paper
• Image Quality Assessment: Measuring Perceptual Degradation via Distribution Measures in Deep Feature Spaces

  2024cites this paper
• Advancing Real-World Image Dehazing: Perspective, Modules, and Training

  2024cites this paper
• Autonomous underwater vehicle visual enhancement using area-to-point kriging and multi-color spaces embedding

  2024influential citation
• Quality-Guided Skin Tone Enhancement for Portrait Photography

  2024cites this paper
• A comprehensive qualitative and quantitative survey on image dehazing based on deep neural networks

  2024cites this paper
• No-reference quality assessment of underwater image enhancement

  2023cites this paper
• Analysis on Innovation and Development of Accounting Industry Based on Genetic Algorithm

  2023cites this paper
• BézierCE: Low-Light Image Enhancement via Zero-Reference Bézier Curve Estimation

  2023cites this paper
• A multimodal dense convolution network for blind image quality assessment

  2023cites this paper
• NDELS: A Novel Approach for Nighttime Dehazing, Low-Light Enhancement, and Light Suppression

  2023cites this paper
• A non-regularization self-supervised Retinex approach to low-light image enhancement with parameterized illumination estimation

  2023cites this paper
• Low-Artifact and Fast Backlit Image Enhancement Method Based on Suppression of Lightness Order Error

  2023cites this paper
• Underwater image quality assessment method based on color space multi-feature fusion

  2023cites this paper
• Unmasking the Invisible: Finding Location-Specific Aggregated Air Quality Index with Smartphone-Captured Images

  2023cites this paper
• A lightweight object detection framework for underwater imagery with joint image restoration and color transformation

  2023cites this paper
• Zero-Shot Enhancement of Low-Light Image Based on Retinex Decomposition

  2023cites this paper
• HSV-3S and 2D-GDA for High-Saturation Low-Light Image Enhancement in Night Traffic Monitoring

  2023cites this paper
• Unsupervised Low-Light Video Enhancement With Spatial-Temporal Co-Attention Transformer

  2023cites this paper
• Towards real-world haze removal with uncorrelated graph model

  2023cites this paper
• Blind quality-based pairwise ranking of contrast changed color images using deep networks

  2023cites this paper
• Low-Illumination Image Enhancement Using Local Gradient Relative Deviation for Retinex Models

  2023cites this paper
• Spatiotemporal imagery selection for full coverage image generation over a large area with HFA-Net based quality grading

  2023cites this paper
• DHIQA: Quality assessment of dehazed images based on attentive multi-scale feature fusion and rank learning

  2023cites this paper
• Non-Intrusive Speech Quality Assessment Based on Deep Neural Networks for Speech Communication

  2023cites this paper
• Uncovering local aggregated air quality index with smartphone captured images leveraging efficient deep convolutional neural network

  2023cites this paper
• Visibility and Distortion Measurement for No-Reference Dehazed Image Quality Assessment via Complex Contourlet Transform

  2023cites this paper
• Subjective Quality Assessment of Enhanced Retinal Images

  2023influential citation
• No-reference blurred image quality assessment method based on structure of structure features

  2023cites this paper
• A Novel No-Reference Quality Assessment Metric for Stereoscopic Images with Consideration of Comprehensive 3D Quality Information

  2023cites this paper
• Deep Learning for Time-Series Prediction in IIoT: Progress, Challenges, and Prospects

  2023cites this paper