What Do We Understand About Convolutional Networks?

This document will review the most prominent proposals using multilayer convolutional architectures. Importantly, the various components of a typical convolutional network will be discussed through a review of different approaches that base their design decisions on biological findings and/or sound theoretical bases. In addition, the different attempts at understanding ConvNets via visualizations and empirical studies will be reviewed. The ultimate goal is to shed light on the role of each layer of processing involved in a ConvNet architecture, distill what we currently understand about ConvNets and highlight critical open problems.

• Publication year

  2018

• Venue

  arXiv.org

• Publication date

  2018-03-23

• Fields of study

  Computer Science

• Identifiers
  arXiv 1803.08834
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• GENERATIVE ADVERSARIAL NETS

  2018cited by this paper
• Gabor Convolutional Networks

  2017influential reference
• Fundamentals of deep learning

  2017influential reference
• A Spatiotemporal Oriented Energy Network for Dynamic Texture Recognition

  2017influential reference
• Temporal Residual Networks for Dynamic Scene Recognition

  2017cited by this paper
• Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset

  2017influential reference
• Oriented Response Networks

  2017influential reference
• Spatiotemporal Multiplier Networks for Video Action Recognition

  2017influential reference
• Deformable Convolutional Networks

  2017cited by this paper
• Active Convolution: Learning the Shape of Convolution for Image Classification

  2017cited by this paper
• Categorization

  2017cited by this paper
• Learning Texture Manifolds with the Periodic Spatial GAN

  2017influential reference
• Network Dissection: Quantifying Interpretability of Deep Visual Representations

  2017influential reference
• Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network

  2016cited by this paper
• DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs

  2016cited by this paper
• Semantic Image Inpainting with Deep Generative Models

  2016influential reference
• Salient Deconvolutional Networks

  2016cited by this paper
• Divisive Normalization Predicts Adaptation-Induced Response Changes in Macaque Inferior Temporal Cortex

  2016cited by this paper
• Spatiotemporal Residual Networks for Video Action Recognition

  2016influential reference
• Learning to learn by gradient descent by gradient descent

  2016influential reference
• Convolutional Two-Stream Network Fusion for Video Action Recognition

  2016influential reference
• Densely Connected Convolutional Networks

  2016influential reference
• Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units

  2016cited by this paper
• Steerable CNNs

  2016influential reference
• Meta-Learning with Memory-Augmented Neural Networks

  2016cited by this paper
• An overview of gradient descent optimization algorithms

  2016cited by this paper
• Generative Adversarial Text to Image Synthesis

  2016cited by this paper
• Harmonic Networks: Deep Translation and Rotation Equivariance

  2016influential reference
• Structured Receptive Fields in CNNs

  2016cited by this paper
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks

  2015influential reference
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

  2015cited by this paper
• Fast R-CNN

  2015influential reference
• Deep Residual Learning for Image Recognition

  2015influential reference
• Dynamically encoded actions based on spacetime saliency

  2015cited by this paper
• Deep Learning

  2015cited by this paper
• Beyond short snippets: Deep networks for video classification

  2015cited by this paper
• Action recognition with trajectory-pooled deep-convolutional descriptors

  2015influential reference
• Towards Good Practices for Very Deep Two-Stream ConvNets

  2015cited by this paper
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

  2015influential reference
• Spatial Transformer Networks

  2015influential reference
• Learning Deep Features for Discriminative Localization

  2015cited by this paper
• Learning the Structure of Deep Convolutional Networks

  2015influential reference
• Convolutional Clustering for Unsupervised Learning

  2015cited by this paper
• Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification

  2015cited by this paper
• Understanding Neural Networks Through Deep Visualization

  2015influential reference
• Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Tree

  2015influential reference
• Deep Learning with S-Shaped Rectified Linear Activation Units

  2015cited by this paper
• Fully convolutional networks for semantic segmentation

  2014cited by this paper
• Long-term recurrent convolutional networks for visual recognition and description

  2014influential reference
• ImageNet Large Scale Visual Recognition Challenge

  2014cited by this paper
• Deep roto-translation scattering for object classification

  2014cited by this paper
• Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture

  2014cited by this paper
• Very Deep Convolutional Networks for Large-Scale Image Recognition

  2014cited by this paper
• Large-Scale Video Classification with Convolutional Neural Networks

  2014cited by this paper
• Going deeper with convolutions

  2014cited by this paper
• Object Detectors Emerge in Deep Scene CNNs

  2014cited by this paper
• Understanding deep image representations by inverting them

  2014influential reference
• Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition

  2014influential reference
• Analyzing the Performance of Multilayer Neural Networks for Object Recognition

  2014influential reference
• Representation of Naturalistic Image Structure in the Primate Visual Cortex.

  2014cited by this paper
• PCANet: A Simple Deep Learning Baseline for Image Classification?

  2014cited by this paper
• Learning Spatiotemporal Features with 3D Convolutional Networks

  2014influential reference
• Adam: A Method for Stochastic Optimization

  2014influential reference
• How transferable are features in deep neural networks?

  2014cited by this paper
• Dropout: a simple way to prevent neural networks from overfitting

  2014cited by this paper
• Return of the Devil in the Details: Delving Deep into Convolutional Nets

  2014influential reference
• V4 neural network model for visual saliency and discriminative local representation of shapes

  2014cited by this paper
• Understanding Locally Competitive Networks

  2014cited by this paper
• Two-Stream Convolutional Networks for Action Recognition in Videos

  2014influential reference
• Deep Neural Networks for Object Detection

  2013cited by this paper
• Selective Search for Object Recognition

  2013cited by this paper
• Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps

  2013cited by this paper
• Network In Network

  2013influential reference
• Maxout Networks

  2013influential reference
• Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation

  2013influential reference
• A functional and perceptual signature of the second visual area in primates

  2013cited by this paper
• Describing Textures in the Wild

  2013cited by this paper
• Visualizing and Understanding Convolutional Networks

  2013influential reference
• Stochastic Pooling for Regularization of Deep Convolutional Neural Networks

  2013influential reference
• Rectifier Nonlinearities Improve Neural Network Acoustic Models

  2013cited by this paper
• Beyond spatial pyramids: Receptive field learning for pooled image features

  2012cited by this paper
• Representation Learning: A Review and New Perspectives

  2012influential reference
• A New Biologically Inspired Color Image Descriptor

  2012cited by this paper
• Invariant Scattering Convolution Networks

  2012influential reference
• ADADELTA: An Adaptive Learning Rate Method

  2012influential reference
• The Roles of Endstopped and Curvature Tuned Computations in a Hierarchical Representation of 2D Shape

  2012influential reference
• ImageNet classification with deep convolutional neural networks

  2012cited by this paper
• Cross-orientation suppression in human visual cortex.

  2011cited by this paper
• The importance of intermediate representations for the modeling of 2D shape detection: Endstopping and curvature tuned computations

  2011influential reference
• Normalization as a canonical neural computation

  2011cited by this paper
• The devil is in the details: an evaluation of recent feature encoding methods

  2011cited by this paper
• Biologically-inspired object recognition system with features from complex wavelets

  2011cited by this paper
• Selecting Receptive Fields in Deep Networks

  2011cited by this paper
• Adaptive Subgradient Methods for Online Learning and Stochastic Optimization

  2011influential reference
• Contractive Auto-Encoders: Explicit Invariance During Feature Extraction

  2011cited by this paper
• Deep Sparse Rectifier Neural Networks

  2011cited by this paper
• Melting of Peridotite to 140 Gigapascals

  2010cited by this paper
• Fast Inference in Sparse Coding Algorithms with Applications to Object Recognition

  2010cited by this paper
• Divisive Normalization: Justification and Effectiveness as Efficient Coding Transform

  2010cited by this paper
• Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion

  2010cited by this paper

• TFA-Net: A Temporal Feature Aggregation Framework for Tropical Cyclone Intensity Estimation From Satellite Images

  2025cites this paper
• The dual stream network with embedding temporal convolution for micro-expression recognition

  2025cites this paper
• Hybrid EEG-fNIRS Detection of MCI Subtypes Based on Transformer Network

  2025cites this paper
• Chinese inscription restoration based on artificial intelligent models

  2025cites this paper
• Shark Image Classification and Recognition Based on Convolutional Neural Networks

  2025cites this paper
• Attention-enhanced deep learning for stress-strain response prediction and inverse design of random porous materials

  2025cites this paper
• SCC-YOLO: An Improved Object Detector for Assisting in Brain Tumor Diagnosis

  2025cites this paper
• Visualization Method of Emotional EEG Features Based on Convolutional Neural Networks

  2024cites this paper
• Fractal Filter Networks for Sea State Classification Using Radar Sea Clutter Data

  2024cites this paper
• LBCapsNet: a lightweight balanced capsule framework for image classification of porcelain fragments

  2024cites this paper
• Badminton Movement Quality Assessment Through Kinect Sensor Data Using NDT-GCN Algorithm

  2024cites this paper
• A study on the high power microwave effects of PIN diode limiter based on deep learning algorithm

  2024cites this paper
• Application of CNN in Active Surface Adjustment of Large Reflector Antennas

  2024cites this paper
• Garbage Classification System Based on Deep Learning

  2024cites this paper
• Weak ultrasonic guided wave signal recognition based on one-dimensional convolutional neural network denoising autoencoder and its application to small defect detection in pipelines

  2024cites this paper
• CLAC-Net: a composite medical image segmentation framework using self-attention and cross-layer asymmetric connections

  2024cites this paper
• Research on Large-scale Structured and Unstructured Data Processing based on Large Language Model

  2024cites this paper
• A Comprehensive Comparative Study of Deep Learning Methods for Noisy Sperm Image Classification: from Convolutional Neural Network to Visual Transformer

  2023cites this paper
• A Review on 3D Convolutional Neural Network

  2023cites this paper
• Prediction of Traffic Flow Density and Velocity Based on Kalman Filter Fusion of The Non-Local Gas-Kinetic Model and Convolution Neural Networks-Long-Short Term Memory Model

  2023cites this paper
• Convolutional Neural Network Based Alzheimer's Disease Detection Using OIASIS Dataset

  2023cites this paper
• Automatic Detection and Classification of Spread‐F From Ionosonde at Hainan With Image‐Based Deep Learning Method

  2023influential citation
• Multi-step prediction of chlorophyll concentration based on adaptive graph-temporal convolutional network with series decomposition

  2023cites this paper
• Application study on the recognition of oral obstructed tooth images using semantic segmentation

  2023cites this paper
• Railway Track Fault Detection Using Selective MFCC Features from Acoustic Data

  2023cites this paper
• 基于深度学习的超材料设计及光纤光束控制研究进展

  2023cites this paper
• UW-ProCCaps: UnderWater Progressive Colourisation with Capsules

  2023cites this paper
• Improved YOLOX method for small target smoking detection algorithm

  2023cites this paper
• Liquid Petroleum Hydrocarbon Ocean Coastal Water Pollution Identification Using Deep Neural Network

  2023cites this paper
• Multiscale Spatial Attention Network for Seismic Data Denoising

  2022cites this paper
• Automated Stellar Spectra Classification with Ensemble Convolutional Neural Network

  2022cites this paper
• Arbitrage: Stock Market Comparative Analysis

  2022cites this paper
• Fast classification of indoor functional areas based on a pre-trained lightweight network

  2022cites this paper
• Driver Violation Prediction based on Neural Network

  2022cites this paper
• Research on 6-DOF robot inverse kinematics based on blended optimization algorithm of ELM- SSA-SCA

  2022cites this paper
• Research on Water-Level Recognition Method Based on Image Processing and Convolutional Neural Networks

  2022cites this paper
• Semantic Segmentation-Based Adaptive Mining Algorithm for Ceramic Cultural Resource Data

  2022cites this paper
• Pro-CCaps: Progressively Teaching Colourisation to Capsules

  2022cites this paper
• A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer

  2021cites this paper
• Autonomous and Real-time Rock Image Classification using Convolutional Neural Networks

  2021cites this paper
• Deep learning model for classifying endometrial lesions

  2021cites this paper
• Collaboration among Image and Object Level Features for Image Colourisation

  2021cites this paper
• A Multi-Module Based Method for Generating Natural Language Descriptions of Code Fragments

  2021cites this paper
• Application of deep and machine learning techniques for multi-label classification performance on psychotic disorder diseases

  2021cites this paper
• High spatial resolution remote sensing image segmentation based on the multiclassification model and the binary classification model

  2021cites this paper
• An Evaluation of Deep Learning Networks to Extract Emotions from Yelp Reviews

  2021cites this paper
• Hybrid Pyramid Convolutional Network for Multiscale Face Detection

  2021cites this paper
• TUCaN: Progressively Teaching Colourisation to Capsules

  2021cites this paper
• Collaborative Image and Object Level Features for Image Colourisation

  2021cites this paper
• Product innovation concept generation based on deep learning and Kansei engineering

  2021cites this paper
• A real-time crack detection algorithm for pavement based on CNN with multiple feature layers

  2021cites this paper
• A novel method for peanut variety identification and classification by Improved VGG16

  2021cites this paper
• Image forgery detection based on fusion of lightweight deep learning models

  2021cites this paper
• Exploring CNN features in the context of adversarial robustness and human perception

  2021cites this paper
• Automatic Reservoir Model Identification Method based on Convolutional Neural Network

  2021cites this paper
• Predicting gene expression levels from histone modification profiles by a hybrid deep learning network

  2021cites this paper
• Custom Convolutional Layer Designs for CNN Based Automatic Modulation Classification Solution

  2021cites this paper
• UNROLLING OF GRAPH TOTAL VARIATION FOR IMAGE DENOISING HUY VU A THESIS SUBMITTED TO THE FACULTY OF GRADUATE STUDIES IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTERS OF APPLIED SCIENCE GRADUATE PROGRAM IN ELECTRICAL ENGINEERING

  2021cites this paper
• Deep Learning Analysis of Polaritonic Wave Images.

  2021cites this paper
• Optimization of a Pre-Trained AlexNet Model for Detecting and Localizing Image Forgeries

  2020cites this paper
• Global sensitivity analysis based on Inception-CNN

  2020cites this paper
• The Invasiveness Classification of Ground-Glass Nodules Using 3D Attention Network and HRCT

  2020cites this paper
• A Pornographic Images Recognition Model based on Deep One-Class Classification With Visual Attention Mechanism

  2020cites this paper
• Applying deep learning in automatic and rapid measurement of lattice spacings in HRTEM images

  2020cites this paper
• Independent learning approaches: overcoming multi-agent learning pathologies in team-games

  2020cites this paper
• Applying Radam Method to improve treatment of Convolutional Neural Network on Banknote Identification

  2020cites this paper
• Discovering software developer's coding expertise through deep learning

  2020cites this paper
• LMDAPNet: A Novel Manifold-Based Deep Learning Network

  2020cites this paper
• Compressed Holistic ConvNet Representations for Detecting Loop Closures in Dynamic Environments

  2020cites this paper
• A CNN-Based Hybrid Model for Tropical Cyclone Intensity Estimation in Meteorological Industry

  2020cites this paper
• Oil Spill Detection in Quad-Polarimetric SAR Images Using an Advanced Convolutional Neural Network Based on SuperPixel Model

  2020cites this paper
• Intelligent Monitoring System of Coal Conveyor Belt Based on Computer Vision Technology

  2020cites this paper
• Deep Spectral Biometrics: Overview and Open Issues

  2020cites this paper
• Reinforcement Learning-Based Downlink Interference Control for Ultra-Dense Small Cells

  2020cites this paper
• Defect detection of magnetic sheets based on convolutional neural network stacked by perception modules

  2020cites this paper
• Water Level Classification for Flood Monitoring System Using Convolutional Neural Network

  2020cites this paper
• Automatic well test interpretation based on convolutional neural network for infinite reservoir

  2020cites this paper
• Intelligent Mapping of Urban Forests from High-Resolution Remotely Sensed Imagery Using Object-Based U-Net-DenseNet-Coupled Network

  2020cites this paper
• An Individual Specific Electroencephalography Signal Pattern Verification Model Based on Machine Learning and Convolutional Neural Network

  2020cites this paper
• Deep Dual-Channel Neural Network for Image-Based Smoke Detection

  2020cites this paper
• Compressed Holistic Convolutional Neural Network-based Descriptors for Scene Recognition

  2019cites this paper
• A Comprehensive Techno-Economic Framework for Shale Gas Exploitation and Distribution in the United States

  2019cites this paper
• Deep Feature Extraction for Pap-Smear Image Classification: A Comparative Study

  2019cites this paper
• Measuring the Data Efficiency of Deep Learning Methods

  2019cites this paper
• Sequential image processing methods for improving semantic video segmentation algorithms

  2019cites this paper
• Towards Natural Scene Rock Image Classification with Convolutional Neural Networks

  2019cites this paper
• Blind Modulation Classification via Accelerated Deep Learning

  2019influential citation
• Research on Fine-Grained Sentiment Classification

  2019cites this paper
• Amplitude‐frequency images‐based ConvNet: Applications of fault detection and diagnosis in chemical processes

  2019cites this paper
• An Integrative 3C evaluation framework for Explainable Artificial Intelligence

  2019cites this paper
• Microscopic Machine Vision Based Degradation Monitoring of Low-Voltage Electromagnetic Coil Insulation Using Ensemble Learning in a Membrane Computing Framework

  2019cites this paper
• Few-shot hypercolumn-based mitochondria segmentation in cardiac and outer hair cells in focused ion beam-scanning electron microscopy (FIB-SEM) data

  2019cites this paper
• Deep Neural Networks in the View of Ecological Holism

  2019cites this paper
• Reconnaissance d'expressions corporelles dans des mouvements de personnes en vue de la synthèse de style. (Capturing and transferring expression from children's faces for interaction with virtual modes)

  2019cites this paper
• $\alpha$ Diff: Cross-Version Binary Code Similarity Detection with DNN

  2018cites this paper
• An Extensive Review on Spectral Imaging in Biometric Systems: Challenges and Advancements

  2018cites this paper
• Opening the black box of deep learning

  2018cites this paper
• A novel database of Children's Spontaneous Facial Expressions (LIRIS-CSE)

  2018cites this paper
• FALCON: A Fourier Transform Based Approach for Fast and Secure Convolutional Neural Network Predictions

  2018cites this paper
• SAR Target Classification Method Based on Convolutional Neural Network

  2018cites this paper