Accelerating Recurrent Neural Networks: A Memory-Efficient Approach

No abstract is available for this paper.

• Publication year

  2017

• Venue

  IEEE Transactions on Very Large Scale Integration (VLSI) Systems

• Publication date

  2017-07-03

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/TVLSI.2017.2717950
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Top Downloads in IEEE Xplore [Reader's Choice]

  2017cited by this paper
• Low Overhead Architectures for OMP Compressive Sensing Reconstruction Algorithm

  2017cited by this paper
• Learning compact recurrent neural networks

  2016influential reference
• Fathom: reference workloads for modern deep learning methods

  2016cited by this paper
• Intra-layer Nonuniform Quantization for Deep Convolutional Neural Network

  2016cited by this paper
• Cambricon: An Instruction Set Architecture for Neural Networks

  2016cited by this paper
• Compression of Neural Machine Translation Models via Pruning

  2016cited by this paper
• ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA

  2016cited by this paper
• Recurrent Neural Networks With Limited Numerical Precision

  2016cited by this paper
• FPGA-Based Low-Power Speech Recognition with Recurrent Neural Networks

  2016cited by this paper
• Deep neural networks are robust to weight binarization and other non-linear distortions

  2016cited by this paper
• Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations

  2016cited by this paper
• Intra-layer nonuniform quantization of convolutional neural network

  2016cited by this paper
• Accelerating recurrent neural networks in analytics servers: Comparison of FPGA, CPU, GPU, and ASIC

  2016cited by this paper
• Structured Convolution Matrices for Energy-efficient Deep learning

  2016cited by this paper
• Hybrid computing using a neural network with dynamic external memory

  2016cited by this paper
• Structured Transforms for Small-Footprint Deep Learning

  2015cited by this paper
• Distilling the Knowledge in a Neural Network

  2015cited by this paper
• FPGA Acceleration of Recurrent Neural Network Based Language Model

  2015cited by this paper
• Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding

  2015cited by this paper
• An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections

  2015cited by this paper
• Fixed-point performance analysis of recurrent neural networks

  2015cited by this paper
• Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin

  2015cited by this paper
• Unsupervised Learning of Video Representations using LSTMs

  2015cited by this paper
• Recurrent Neural Networks Hardware Implementation on FPGA

  2015influential reference
• Sequence to Sequence Learning with Neural Networks

  2014cited by this paper
• Neural Turing Machines

  2014cited by this paper
• On the Properties of Neural Machine Translation: Encoder–Decoder Approaches

  2014influential reference
• Restructuring of deep neural network acoustic models with singular value decomposition

  2013cited by this paper
• Speech recognition with deep recurrent neural networks

  2013cited by this paper
• On the difficulty of training recurrent neural networks

  2012cited by this paper
• Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks

  2006cited by this paper
• Hardware Efficient Fast DCT Based on Novel Cyclic Convolution Structures

  2006cited by this paper
• 2005 Special Issue: Framewise phoneme classification with bidirectional LSTM and other neural network architectures

  2005cited by this paper
• Recurrent nets that time and count

  2000cited by this paper
• Long Short-Term Memory

  1997cited by this paper
• A class of fast cyclic convolution algorithms based on block pseudocirculants

  1995cited by this paper
• Building a Large Annotated Corpus of English: The Penn Treebank

  1993cited by this paper
• Expanding the Range of Convergence of the CORDIC Algorithm

  1991cited by this paper
• Backpropagation Through Time: What It Does and How to Do It

  1990influential reference

• Mental health-aware sentiment analysis using a hybrid quantum–classical approach

  2026cites this paper
• Design of an Approximate Radix-2 FFT Butterfly Unit for LSTM-Speech signal-based Parkinson’s Disease Classifier

  2025cites this paper
• FLToP CTC: Frame-Level Token Pruning via Relative Threshold for Efficient and Memory-Saving Decoding on Diverse Platforms

  2025cites this paper
• QL-LSTM: A Parameter-Efficient LSTM for Stable Long-Sequence Modeling

  2025cites this paper
• A lightweight distillation recurrent convolution network on FPGA for real-time video super-resolution

  2024cites this paper
• Approximate Multiplier Design With LFSR-Based Stochastic Sequence Generators for Edge AI

  2024cites this paper
• Real-time Blood Pressure Prediction on Wearables with Edge-Based DNNs: A Co-Design Approach

  2024cites this paper
• Digit-Serial DA-Based Fixed-Point RNNs: A Unified Approach for Enhancing Architectural Efficiency

  2024influential citation
• Edge-side load prediction analysis method based on hardware acceleration

  2024cites this paper
• Precision and Power Efficient Piece-Wise-Linear Implementation of Transcendental Functions

  2024cites this paper
• Design and Implementation of Power Efficient Hardware Accelerator for Bidirectional Long Short- Term Memory (Bi-LSTM)

  2024cites this paper
• Reconfigurable and Energy-Efficient Architecture for Deploying Multi-Layer RNNs on FPGA

  2024cites this paper
• Low-Area and Low-Power VLSI Architectures for Long Short-Term Memory Networks

  2023cites this paper
• Design of low power LSTM neural network accelerator based on FPGA

  2023cites this paper
• A Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques

  2023cites this paper
• HBP: Hierarchically Balanced Pruning and Accelerator Co-Design for Efficient DNN Inference

  2023influential citation
• Power and Delay-Efficient Matrix Vector Multiplier Units for the LSTM Networks Using Activity Span Reduction Technique and Recursive Adders

  2023influential citation
• Performance-Driven LSTM Accelerator Hardware Using Split-Matrix-Based MVM

  2023cites this paper
• Cost effective Tanh activation function circuits based on fast piecewise linear logic

  2023cites this paper
• An Efficient Accelerator Based on Lightweight Deformable 3D-CNN for Video Super-Resolution

  2023cites this paper
• A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques

  2023cites this paper
• A Lightweight Sentiment Analysis Framework for a Micro-Intelligent Terminal

  2023cites this paper
• Architectural Trade-Off Analysis for Accelerating LSTM Network Using Radix-r OBC Scheme

  2023influential citation
• Highly Parallel Implementation of Machine Learning Algorithms based on Reconfigurable Structures

  2023cites this paper
• Lookupx: Next-Generation Quantization and Lookup Techniques for Empowering Performance and Energy Efficiency

  2023cites this paper
• FPGA Hardware Implementation of Efficient Long Short-Term Memory Network Based on Construction Vector Method

  2023cites this paper
• Energy-Efficient LSTM Inference Accelerator for Real-Time Causal Prediction

  2022cites this paper
• An Efficient Accelerator of Deformable 3D Convolutional Network for Video Super-Resolution

  2022cites this paper
• Remarn: A Reconfigurable Multi-threaded Multi-core Accelerator for Recurrent Neural Networks

  2022cites this paper
• Energy Eficient LSTM Inference Accelerator for Real-Time Causal Prediction

  2022cites this paper
• GBC: An Energy-Efficient LSTM Accelerator With Gating Units Level Balanced Compression Strategy

  2022influential citation
• A PLS-based pruning algorithm for simplified long-short term memory neural network in time series prediction

  2022cites this paper
• Recurrent Neural Networks With Column-Wise Matrix–Vector Multiplication on FPGAs

  2022cites this paper
• MOHAQ: Multi-Objective Hardware-Aware Quantization of recurrent neural networks

  2021cites this paper
• Spartus: A 9.4 TOp/s FPGA-Based LSTM Accelerator Exploiting Spatio-Temporal Sparsity

  2021cites this paper
• A survey On hardware accelerators and optimization techniques for RNNs

  2020cites this paper
• A Universal Method of Linear Approximation With Controllable Error for the Efficient Implementation of Transcendental Functions

  2020cites this paper
• Low-Complexity Distributed-Arithmetic-Based Pipelined Architecture for an LSTM Network

  2020influential citation
• DNet: A lightweight and efficient model for aspect based sentiment analysis

  2020cites this paper
• Towards deep neural network compression via learnable wavelet transforms

  2020cites this paper
• Neural Network Compression via Learnable Wavelet Transforms

  2020cites this paper
• PLAC: Piecewise Linear Approximation Computation for All Nonlinear Unary Functions

  2020cites this paper
• Design of a Sparsity-Aware Reconfigurable Deep Learning Accelerator Supporting Various Types of Operations

  2020cites this paper
• EdgeDRNN: Recurrent Neural Network Accelerator for Edge Inference

  2020cites this paper
• Structured deep neural network with low complexity

  2020cites this paper
• Accelerating Deep Neural Networks by Combining Block-Circulant Matrices and Low-Precision Weights

  2019cites this paper
• Recent advances in connected and automated vehicles

  2019cites this paper
• DynExit: A Dynamic Early-Exit Strategy for Deep Residual Networks

  2019cites this paper
• An Energy-Efficient Reconfigurable LSTM Accelerator for Natural Language Processing

  2019cites this paper
• An Energy-efficient Processing-in-memory Architecture for Long Short Term Memory in Spin Orbit Torque MRAM

  2019influential citation
• A Neural Network-Based ECG Classification Processor With Exploitation of Heartbeat Similarity

  2019cites this paper
• ELSA

  2019influential citation
• Manna: An Accelerator for Memory-Augmented Neural Networks

  2019cites this paper
• One Size Does Not Fit All: Multi-Scale, Cascaded RNNs for Radar Classification

  2019cites this paper
• Real-Time Maritime Traffic Anomaly Detection Based on Sensors and History Data Embedding

  2019cites this paper
• Recurrent Neural Networks: An Embedded Computing Perspective

  2019influential citation
• A 3.89-GOPS/mW Scalable Recurrent Neural Network Processor With Improved Efficiency on Memory and Computation

  2019cites this paper
• Deep Neural Network Approximation for Custom Hardware

  2019influential citation
• Acceleration of LSTM With Structured Pruning Method on FPGA

  2019cites this paper
• Real-Time Speech Recognition for IoT Purpose using a Delta Recurrent Neural Network Accelerator

  2019cites this paper
• A Hardware-Oriented and Memory-Efficient Method for CTC Decoding

  2019cites this paper
• Compressing Deep Neural Networks Using Toeplitz Matrix: Algorithm Design and Fpga Implementation

  2019cites this paper
• E-LSTM: An Efficient Hardware Architecture for Long Short-Term Memory

  2019cites this paper
• Approximate LSTMs for Time-Constrained Inference: Enabling Fast Reaction in Self-Driving Cars

  2019cites this paper
• An Application Specific Processor Architecture with 3D Integration for Recurrent Neural Networks

  2019cites this paper
• Approximate FPGA-based LSTMs under Computation Time Constraints

  2018cites this paper
• Biological applications, visualizations, and extensions of the long short-term memory network

  2018cites this paper
• The unreasonable effectiveness of the forget gate

  2018cites this paper
• Hardware aspects of Long Short Term Memory

  2018cites this paper
• A High-Speed and Low-Complexity Architecture for Softmax Function in Deep Learning

  2018cites this paper
• RNNFast

  2018cites this paper
• Deep neural networks for myoelectric pattern recognition - An implementation for multifunctional control

  2018cites this paper
• FastGRNN: A Fast, Accurate, Stable and Tiny Kilobyte Sized Gated Recurrent Neural Network

  2018cites this paper
• Logarithmic number system for deep learning

  2018cites this paper
• Hardware-Oriented Compression of Long Short-Term Memory for Efficient Inference

  2018cites this paper
• Exploring Efficient Implementations of Deep Learning Applications on Embedded Platforms

  year unknowninfluential citation