Retrospective: Scalpel: Customizing DNN Pruning to the Underlying Hardware Parallelism

No abstract is available for this paper.

• Publication year

  2023

• Venue

  Unknown venue

• Publication date

  Unknown publication date

• Fields of study

  Not labeled

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• StructADMM: Achieving Ultrahigh Efficiency in Structured Pruning for DNNs

  2021cited by this paper
• Block Pruning For Faster Transformers

  2021cited by this paper
• Bit Prudent In-Cache Acceleration of Deep Convolutional Neural Networks

  2019influential reference
• Learning Efficient Convolutional Networks through Network Slimming

  2017cited by this paper
• Learning Intrinsic Sparse Structures within Long Short-term Memory

  2017cited by this paper
• Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding

  2015cited by this paper

• Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollers

  2025influential citation
• CheckBullet: A Lightweight Checkpointing System for Robust Model Training on Mobile Networks

  2024cites this paper
• INTELLECT: Adapting Cyber Threat Detection to Heterogeneous Computing Environments

  2024cites this paper
• Joint Pruning and Channel-Wise Mixed-Precision Quantization for Efficient Deep Neural Networks

  2024cites this paper
• A roulette wheel-based pruning method to simplify cumbersome deep neural networks

  2024cites this paper
• Edge-Efficient Deep Learning Models for Automatic Modulation Classification: A Performance Analysis

  2024cites this paper
• HyperCLIP: Adapting Vision-Language models with Hypernetworks

  2024cites this paper
• Activation Sparsity Opportunities for Compressing General Large Language Models

  2024cites this paper
• A Holistic Review of the TinyML Stack for Predictive Maintenance

  2024cites this paper
• Structured Bayesian Federated Learning for Green AI: A Decentralized Model Compression Using Turbo-VBI-Based Approach

  2024cites this paper
• A Multi-Scale Automatic Progressive Pruning Algorithm Based on Deep Neural Network

  2024cites this paper
• Bayesian Federated Model Compression for Communication and Computation Efficiency

  2024cites this paper
• Tetris: Accelerating Sparse Convolution by Exploiting Memory Reuse on GPU

  2024cites this paper
• DECADE: Towards Designing Efficient-yet-Accurate Distance Estimation Modules for Collision Avoidance in Mobile Advanced Driver Assistance Systems

  2024cites this paper
• Pruning Federated Learning Models for Anomaly Detection in Resource-Constrained Environments

  2023cites this paper
• V-LSTM: An Efficient LSTM Accelerator Using Fixed Nonzero-Ratio Viterbi-Based Pruning

  2023cites this paper
• CANNON: Communication-Aware Sparse Neural Network Optimization

  2023cites this paper
• Mitigating Memory Wall Effects in CNN Engines with On-the-Fly Weights Generation

  2023cites this paper
• FPGA Resource-aware Structured Pruning for Real-Time Neural Networks

  2023cites this paper
• BitSET: Bit-Serial Early Termination for Computation Reduction in Convolutional Neural Networks

  2023cites this paper
• Intermittent-Aware Neural Network Pruning

  2023cites this paper
• Cooperative DNN partitioning for accelerating DNN-empowered disease diagnosis via swarm reinforcement learning

  2023cites this paper
• Energy-Efficient RISC-V-Based Vector Processor for Cache-Aware Structurally-Pruned Transformers

  2023cites this paper
• A Machine Learning-Oriented Survey on Tiny Machine Learning

  2023cites this paper
• Reprogrammable Non-Linear Circuits Using ReRAM for NN Accelerators

  2023cites this paper
• A Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques

  2023cites this paper
• Machine Learning Hardware Design for Efficiency, Flexibility, and Scalability [Feature]

  2023cites this paper
• LCP: A Low-Communication Parallelization Method for Fast Neural Network Inference for IoT

  2023cites this paper
• Towards Sobolev Pruning

  2023cites this paper
• Hardware Implementation of nmODE on FPGA

  2023cites this paper
• Lightweight Neural Architecture Search for Temporal Convolutional Networks at the Edge

  2023cites this paper
• Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review

  2023cites this paper
• Sneaky Spikes: Uncovering Stealthy Backdoor Attacks in Spiking Neural Networks with Neuromorphic Data

  2023cites this paper
• A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques

  2023cites this paper
• Structured Bayesian Compression for Deep Neural Networks Based on the Turbo-VBI Approach

  2023cites this paper
• A heterogeneous processing-in-memory approach to accelerate quantum chemistry simulation

  2023cites this paper
• Adaptive neuron pruning based on hybrid coding of temporal and rate

  2023cites this paper
• STen: Productive and Efficient Sparsity in PyTorch

  2023cites this paper
• ULEEN: A Novel Architecture for Ultra-low-energy Edge Neural Networks

  2023cites this paper
• PruMUX: Augmenting Data Multiplexing with Model Compression

  2023cites this paper
• FASS-pruner: customizing a fine-grained CNN accelerator-aware pruning framework via intra-filter splitting and inter-filter shuffling

  2023cites this paper
• Exploring Architecture, Dataflow, and Sparsity for GCN Accelerators: A Holistic Framework

  2023cites this paper
• Neural Network Compression using Binarization and Few Full-Precision Weights

  2023cites this paper
• A Survey of Design and Optimization for Systolic Array-based DNN Accelerators

  2023cites this paper
• A Runtime Switchable Multi-Phase Convolutional Neural Network for Resource-Constrained Systems

  2023influential citation
• A Global Modeling Pruning Ensemble Stacking With Deep Learning and Neural Network Meta-Learner for Passenger Train Delay Prediction

  2023cites this paper
• Rosko: Row Skipping Outer Products for Sparse Matrix Multiplication Kernels

  2023cites this paper
• Balanced Column-Wise Block Pruning for Maximizing GPU Parallelism

  2023cites this paper
• LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models

  2022cites this paper
• Radio Frequency Fingerprinting on the Edge

  2022cites this paper
• Orchid classification using homogeneous ensemble of small deep convolutional neural network

  2022cites this paper
• Machine Learning-based Optimal Framework for Internet of Things Networks

  2022cites this paper
• Towards Execution-Efficient LSTMs via Hardware-Guided Grow-and-Prune Paradigm

  2022cites this paper
• Only Buffer When You Need To: Reducing On-chip GPU Traffic with Reconfigurable Local Atomic Buffers

  2022cites this paper
• Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputs

  2022cites this paper
• Distilled Neural Networks for Efficient Learning to Rank

  2022cites this paper
• Energy Efficient Boosting of GEMM Accelerators for DNN via Reuse

  2022cites this paper
• CANDLES: Channel-Aware Novel Dataflow-Microarchitecture Co-Design for Low Energy Sparse Neural Network Acceleration

  2022cites this paper
• Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications

  2022cites this paper
• Dynamic ConvNets on Tiny Devices via Nested Sparsity

  2022influential citation
• Hardware-friendly User-specific Machine Learning for Edge Devices

  2022cites this paper
• Demystifying BERT: System Design Implications

  2022cites this paper
• Research and analysis of pruning algorithm

  2022cites this paper
• Inference Time Reduction of Deep Neural Networks on Embedded Devices: A Case Study

  2022cites this paper
• Machine Learning for Microcontroller-Class Hardware: A Review

  2022cites this paper
• Cascading structured pruning: enabling high data reuse for sparse DNN accelerators

  2022cites this paper
• Implementing a Timing Error-Resilient and Energy-Efficient Near-Threshold Hardware Accelerator for Deep Neural Network Inference

  2022influential citation
• Binarizing Split Learning for Data Privacy Enhancement and Computation Reduction

  2022cites this paper
• nuQmm: Quantized MatMul for Efficient Inference of Large-Scale Generative Language Models

  2022cites this paper
• SWPU: A 126.04 TFLOPS/W Edge-Device Sparse DNN Training Processor With Dynamic Sub-Structured Weight Pruning

  2022cites this paper
• RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network

  2022cites this paper
• Online Anomaly Detection Based On Reservoir Sampling and LOF for IoT devices

  2022cites this paper
• A High-Speed CNN Hardware Accelerator with Regular Pruning

  2022cites this paper
• On-Device Training Under 256KB Memory

  2022cites this paper
• CPrune: Compiler-Informed Model Pruning for Efficient Target-Aware DNN Execution

  2022cites this paper
• Structured Dynamic Precision for Deep Neural Networks Quantization

  2022cites this paper
• Exploring Fine-Grained Sparsity in Convolutional Neural Networks for Efficient Inference

  2022cites this paper
• SASCHA—Sparsity-Aware Stochastic Computing Hardware Architecture for Neural Network Acceleration

  2022influential citation
• CPU-GPU Layer-Switched Low Latency CNN Inference

  2022cites this paper
• TinyRL: Towards Reinforcement Learning on Tiny Embedded Devices

  2022cites this paper
• Neural Network Compression by Joint Sparsity Promotion and Redundancy Reduction

  2022cites this paper
• A Sparse CNN Accelerator for Eliminating Redundant Computations in Intra- and Inter-Convolutional/Pooling Layers

  2022cites this paper
• Tiny Machine Learning for Resource-Constrained Microcontrollers

  2022cites this paper
• Approximations in Deep Learning

  2022cites this paper
• Accelerating Applications using Edge Tensor Processing Units

  2021cites this paper
• Reconstruction of a Fully Paralleled Auditory Spiking Neural Network and FPGA Implementation

  2021cites this paper
• DNN pruning with principal component analysis and connection importance estimation

  2021cites this paper
• Demystifying TensorRT: Characterizing Neural Network Inference Engine on Nvidia Edge Devices

  2021cites this paper
• Encoding Weights of Irregular Sparsity for Fixed-to-Fixed Model Compression

  2021influential citation
• E2bird: Enhanced Elastic Batch for Improving Responsiveness and Throughput of Deep Learning Services

  2021cites this paper
• Pruning and Quantization for Deep Neural Network Acceleration: A Survey

  2021cites this paper
• Mind mappings: enabling efficient algorithm-accelerator mapping space search

  2021cites this paper
• A Mixed-Pruning Based Framework for Embedded Convolutional Neural Network Acceleration

  2021cites this paper
• unzipFPGA: Enhancing FPGA-based CNN Engines with On-the-Fly Weights Generation

  2021cites this paper
• Barrier-Free Large-Scale Sparse Tensor Accelerator (BARISTA) For Convolutional Neural Networks

  2021cites this paper
• Demystifying BERT: Implications for Accelerator Design

  2021cites this paper
• Lottery Jackpots Exist in Pre-Trained Models

  2021cites this paper
• Chapter Six - Deep learning with GPUs

  2021cites this paper
• Spartan: A Sparsity-Adaptive Framework to Accelerate Deep Neural Network Training on GPUs

  2021cites this paper
• A Survey of Deep Learning on CPUs: Opportunities and Co-Optimizations

  2021influential citation