Residual Networks Behave Like Ensembles of Relatively Shallow Networks

No abstract is available for this paper.

• Publication year

  2016

• Venue

  Neural Information Processing Systems

• Publication date

  2016-05-20

• Fields of study

  Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Identity Mappings in Deep Residual Networks

  2016influential reference
• Deep Networks with Stochastic Depth

  2016cited by this paper
• Binding via Reconstruction Clustering

  2015cited by this paper
• Deep Residual Learning for Image Recognition

  2015cited by this paper
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

  2015cited by this paper
• Highway Networks

  2015cited by this paper
• Going deeper with convolutions

  2014cited by this paper
• How transferable are features in deep neural networks?

  2014cited by this paper
• Very Deep Convolutional Networks for Large-Scale Image Recognition

  2014influential reference
• Intriguing properties of neural networks

  2013cited by this paper
• Visualizing and Understanding Convolutional Networks

  2013cited by this paper
• Improving neural networks by preventing co-adaptation of feature detectors

  2012cited by this paper
• ImageNet classification with deep convolutional neural networks

  2012influential reference
• ImageNet: A large-scale hierarchical image database

  2009influential reference
• Learning Multiple Layers of Features from Tiny Images

  2009influential reference
• A feedforward architecture accounts for rapid categorization

  2007cited by this paper
• Gradient-based learning applied to document recognition

  1998cited by this paper
• Boosting and Other Ensemble Methods

  1994cited by this paper
• Learning long-term dependencies with gradient descent is difficult

  1994cited by this paper
• Untersuchungen zu dynamischen neuronalen Netzen

  1991cited by this paper
• Nuts and bolts for the social sciences

  1989cited by this paper
• The Strength of Weak Learnability

  1989cited by this paper
• Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position

  1980cited by this paper
• Receptive fields, binocular interaction and functional architecture in the cat's visual cortex

  1962cited by this paper

• Privacy-Preserving Synthetic Histopathological Single-to-Multimodal Data Generation from Brain MRI Using Transfer Learning

  2026cites this paper
• Component-wise independent adaptive learning and local optimization for long-term forecasting

  2026cites this paper
• WEITS: A wavelet-enhanced residual framework for interpretable time series forecasting

  2026cites this paper
• I Dropped a Neural Net

  2026cites this paper
• LW-ResGRU DPD: Layer-Wise Residual GRU for Low-Latency DPD in Nonlinear RF Systems

  2026cites this paper
• Orthogonal Self-Attention

  2026cites this paper
• Hyperparameter Transfer Laws for Non-Recurrent Multi-Path Neural Networks

  2026cites this paper
• Multi-Module Collaborative Optimization for SAR Image Aircraft Recognition: The SAR-YOLOv8l-ADE Network

  2026cites this paper
• An Improved Yolo Algorithm Based on Concise Decoupled Head for Real-Time Object Detection in Night Scenarios

  2026cites this paper
• AG-REPA: Causal Layer Selection for Representation Alignment in Audio Flow Matching

  2026cites this paper
• Inverse Depth Scaling From Most Layers Being Similar

  2026cites this paper
• ReaGP: integrating residual units and attention mechanisms in convolution neural network for genomic prediction

  2026cites this paper
• Novel High-Scalability Architecture for Photonic Deep Learning

  2026cites this paper
• TraceNAS: Zero-shot LLM Pruning via Gradient Trace Correlation

  2026cites this paper
• Efficient Sparse Selective-Update RNNs for Long-Range Sequence Modeling

  2026cites this paper
• Effect of Convolutional Depth on Image Recognition Performance: VGG vs. ResNet vs. GoogLeNet

  2026influential citation
• SPADE: Structured Pruning and Adaptive Distillation for Efficient LLM-TTS

  2025cites this paper
• Review of several key processes in wind power forecasting: Mathematical formulations, scientific problems, and logical relations

  2025cites this paper
• Anomaly Detection from IGBT Images Based on VGGNet

  2025cites this paper
• Improved 3-D LSTM: A Video Prediction Approach to Long Sequence Load Forecasting

  2025cites this paper
• Tiny Titans: Efficient Large Vision, Language and Multimodal Models Through Pruning

  2025cites this paper
• Reviving Legacy Seismic Data via Machine Learning Technique—Part 1: Expanding 3-D Seismic Survey Coverage With Gated Convolution GAN

  2025cites this paper
• Stochastic Dynamical Low-Rank Approximation in the Context of Machine Learning

  2025influential citation
• Trustworthy AI-based crack-tip segmentation using domain-guided explanations

  2025cites this paper
• Pre-training under infinite compute

  2025cites this paper
• Cutting the Skip: Training Residual-Free Transformers

  2025cites this paper
• Breaking the conventional forward-backward tie in neural networks: Activation functions

  2025cites this paper
• On residual network depth

  2025influential citation
• Estimating the Event-Related Potential from Few EEG Trials

  2025cites this paper
• Artificial intelligence in Glioblastoma Diagnostics: Integrating MRI, histopathology, and molecular profiling.

  2025cites this paper
• Unit-Centric Regularization for Efficient Deep Neural Networks

  2025cites this paper
• All is Not Lost: LLM Recovery without Checkpoints

  2025cites this paper
• Enhancing Spatiotemporal Networks with xLSTM: A Scalar LSTM Approach for Cellular Traffic Forecasting

  2025cites this paper
• FreqCa: Accelerating Diffusion Models via Frequency-Aware Caching

  2025cites this paper
• Reviving Legacy Seismic Data via Machine Learning Technique—Part 2: Estimating 3-D Seismic Volumes From 2-D Seismic Lines With VQ-VAE

  2025cites this paper
• LSP-ST: Ladder Shape-Biased Side-Tuning for Robust Infrared Small Target Detection

  2025cites this paper
• Recent trends on mammogram breast density analysis using deep learning models: neoteric review

  2025cites this paper
• Integrating YOLOv5, Jetson nano microprocessor, and Mitsubishi robot manipulator for real-time machine vision application in manufacturing: A lab experimental study

  2025cites this paper
• Deep learning for MRI-based acute and subacute ischaemic stroke lesion segmentation—a systematic review, meta-analysis, and pilot evaluation of key results

  2025cites this paper
• AMPLIFY: Actionless Motion Priors for Robot Learning from Videos

  2025cites this paper
• Detailed fault detection of industrial sensor based on semantic segmentation models

  2025cites this paper
• A Joint Topology-Data Fusion Graph Network for Robust Traffic Speed Prediction with Data Anomalism

  2025influential citation
• The Vanishing Gradient Problem for Stiff Neural Differential Equations

  2025cites this paper
• Deep Learning-Based Inversion Method for Ocean Swell Waveheights From HF Radar

  2025cites this paper
• Leveraging transfer learning from Acute Lymphoblastic Leukemia (ALL) pretraining to enhance Acute Myeloid Leukemia (AML) prediction

  2025cites this paper
• Forecasting West Nile virus with deep graph encoders

  2025influential citation
• Online ResNet-Based Adaptive Control for Nonlinear Target Tracking

  2025cites this paper
• A Deep Learning Method for Autism Spectrum Disorder Classification Based on Multimodal Neuroimaging Data*

  2025cites this paper
• Block-Recurrent Dynamics in Vision Transformers

  2025cites this paper
• Illuminant Estimation Using RGB Camera Image and Ambient Light Sensor Signal

  2025cites this paper
• RepCaM++: Exploring Transparent Visual Prompt With Inference-Time Re-Parameterization for Neural Video Delivery

  2025cites this paper
• Analysis of Deep Learning based Ensemble Models for Brain Tumor Detection

  2025cites this paper
• DRANet: Deep Learning-Based Automatic White Balancing Approach to CVCC

  2025cites this paper
• Frequency-aware vision transformers for high-fidelity super-resolution of Earth system models.

  2025cites this paper
• SkipPipe: Partial and Reordered Pipelining Framework for Training LLMs in Heterogeneous Networks

  2025cites this paper
• Leveraging the true depth of LLMs

  2025cites this paper
• Accelerated Training through Iterative Gradient Propagation Along the Residual Path

  2025cites this paper
• ViSIR: Vision Transformer Single Image Reconstruction Method for Earth System Models

  2025cites this paper
• MAMSN: Multi‐Attention Interaction and Multi‐Scale Fusion Network for Spectral Reconstruction From RGB Images

  2025cites this paper
• Quantum Decision Transformers (QDT): Synergistic Entanglement and Interference for Offline Reinforcement Learning

  2025cites this paper
• Do Language Models Use Their Depth Efficiently?

  2025cites this paper
• Whole-Brain Task fMRI Decoding Using Stage-Wise Residual-Optimized 3D ConvNeXt With Layer-Global Response Normalization

  2025cites this paper
• Reciprocal Point Learning Network With Large Electromagnetic Kernel for SAR Open-Set Recognition

  2025influential citation
• Problem Decomposition Strategies and Credit Distribution Mechanisms in Modular Genetic Programming for Supervised Learning

  2025cites this paper
• Content-Aware Dynamic In-Loop Filter With Adjustable Complexity for VVC Intra Coding

  2025cites this paper
• Random Feature Representation Boosting

  2025cites this paper
• LUNAR: LLM Unlearning via Neural Activation Redirection

  2025cites this paper
• Foundations and Innovations in Data Fusion and Ensemble Learning for Effective Consensus

  2025cites this paper
• Improved deep residual network for chirp signal recovery in microwave photonic receiving systems

  2025cites this paper
• Building robust deep recommender systems: Utilizing a weighted adversarial noise propagation framework with robust fine-tuning modules

  2025cites this paper
• Low-shot Image Classification Using Mixture of Experts

  2025cites this paper
• LinEAS: End-to-end Learning of Activation Steering with a Distributional Loss

  2025cites this paper
• 1000 Layer Networks for Self-Supervised RL: Scaling Depth Can Enable New Goal-Reaching Capabilities

  2025cites this paper
• Research into the Application of ResNet in Soil: A Review

  2025cites this paper
• Improved biometric quantification in 3D ultrasound biomicroscopy via generative adversarial networks-based image enhancement

  2025cites this paper
• DiffSegNet：基于差分3D U-Net的三维点云实例分割模型

  2025cites this paper
• Always Skip Attention

  2025cites this paper
• Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detection

  2025cites this paper
• Prediction of monitoring data and state assessment of heritage stone-timber structures based on spatio-temporal graph neural networks

  2025cites this paper
• New online in-air signature recognition dataset and embodied cognition inspired feature selection

  2025cites this paper
• Auto-Compressing Networks

  2025influential citation
• ResNets Are Deeper Than You Think

  2025influential citation
• Spprnet: A Robust CNN for Library Material Recognition via Spatial Pyramid Pooling and Heterogeneous Convolution

  2025cites this paper
• Interpretable and robust fault diagnosis of rotating machinery in noisy environments via improved high-order spatial interactions network

  2025cites this paper
• Cross-regularization: Adaptive Model Complexity through Validation Gradients

  2025cites this paper
• Exploiting Student Parallelism for Low-latency GPU Inference of BERT-like Models in Online Services

  2025cites this paper
• Towards trustworthy AI in materials mechanics through domain-guided attention

  2025cites this paper
• GWSC-SegMamba: Gate Wavelet Spatial Convolution Enhanced State Space Model for Multi-Temporal Agricultural Land Segmentation

  2025cites this paper
• Small sample hyperspectral image classification based on spiking re-parameterization and multi-discriminator adversarial

  2025cites this paper
• KAM-Net: Kilobyte-Scale Ultralightweight Attention-Based Network for Glass Defect Detection With Algorithm/Hardware Co-Design

  2025cites this paper
• Performance Analysis of Deep Learning Techniques in Brain Tumor Segmentation

  2025cites this paper
• Associative graph convolution network for point cloud analysis

  2024cites this paper
• Interaction-Aware Trajectory Prediction for Safe Motion Planning in Autonomous Driving: A Transformer-Transfer Learning Approach

  2024cites this paper
• Layer Pruning With Consensus: A Triple-Win Solution

  2024cites this paper
• DC-DOES: A Dual-Camera Deep Learning Approach for Robust Orientation Estimation in Maritime Environments

  2024cites this paper
• High-Resolution Reconstruction of Temperature Fields Based on Improved ResNet18

  2024cites this paper
• Generalized Probabilistic Attention Mechanism in Transformers

  2024cites this paper
• Residual connections improve click-through rate and conversion rate prediction performance

  2024cites this paper
• Scaling Up Your Kernels: Large Kernel Design in ConvNets Toward Universal Representations

  2024cites this paper
• On the Adversarial Transferability of Generalized "Skip Connections"

  2024cites this paper