FPGA Acceleration of Recurrent Neural Network Based Language Model

No abstract is available for this paper.

• Publication year

  2015

• Venue

  2015 IEEE 23rd Annual International Symposium on Field-Programmable Custom Computing Machines

• Publication date

  2015-05-02

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/FCCM.2015.50
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Large scale recurrent neural network on GPU

  2014influential reference
• A Recursive Recurrent Neural Network for Statistical Machine Translation

  2014cited by this paper
• Intel Math Kernel Library

  2014cited by this paper
• Hardware conversion of neural networks simulation models for neural processing accelerator implemented as FPGA-based SoC

  2014cited by this paper
• Sequence discriminative distributed training of long short-term memory recurrent neural networks

  2014cited by this paper
• Recent advances in deep learning for speech research at Microsoft

  2013cited by this paper
• Learning word embeddings efficiently with noise-contrastive estimation

  2013cited by this paper
• A Parallel Neuromorphic Text Recognition System and Its Implementation on a Heterogeneous High-Performance Computing Cluster

  2013cited by this paper
• A Challenge Set for Advancing Language Modeling

  2012cited by this paper
• Neural Acceleration for General-Purpose Approximate Programs

  2012cited by this paper
• Statistical Language Models Based on Neural Networks

  2012cited by this paper
• Generating Text with Recurrent Neural Networks

  2011cited by this paper
• Empirical Evaluation and Combination of Advanced Language Modeling Techniques

  2011cited by this paper
• Faster and Smaller N-Gram Language Models

  2011cited by this paper
• Extensions of recurrent neural network language model

  2011cited by this paper
• Strategies for training large scale neural network language models

  2011cited by this paper
• Query language modeling for voice search

  2010cited by this paper
• A high-performance FPGA architecture for restricted boltzmann machines

  2009cited by this paper
• Simultaneous perturbation learning rule for recurrent neural networks and its FPGA implementation

  2005cited by this paper
• A Neural Probabilistic Language Model

  2003cited by this paper
• A bit of progress in language modeling

  2001cited by this paper
• A maximum entropy language model integrating N-grams and topic dependencies for conversational speech recognition

  1999cited by this paper
• A study of n-gram and decision tree letter language modeling methods

  1998cited by this paper
• Piecewise linear approximation applied to nonlinear function of a neural network

  1997cited by this paper
• Building a Large Annotated Corpus of English: The Penn Treebank

  1993cited by this paper

• AMSER: Accelerate Mobile Speech Emotion Recognition with Signal Compression

  2025cites this paper
• Hybrid MEMS-FPGA Architectures with Transformer Models for Real-Time Speech and Language Processing

  2025cites this paper
• Amser+: Accelerating Mobile Speech Emotion Recognition in IoT Environments With Mel Feature Compression

  2025cites this paper
• Hardware/Software Co-Design Optimization for Training Recurrent Neural Networks at the Edge

  2025influential citation
• Field-Programmable Gate Array Architecture for Deep Learning: Survey and Future Directions

  2024cites this paper
• TwinStep Network (TwNet): a Neuron-Centric Architecture Achieving Rapid Training

  2024cites this paper
• Presynaptic spike-driven plasticity based on eligibility trace for on-chip learning system

  2023cites this paper
• Smart Energy Meters for Smart Grids, an Internet of Things Perspective

  2023cites this paper
• GanNoise: Defending against black-box membership inference attacks by countering noise generation

  2023cites this paper
• FPGA Based Area Reduction with Recurrent Neural Network and VHDL Modelling

  2023cites this paper
• An On-Chip Fully Connected Neural Network Training Hardware Accelerator Based on Brain Float Point and Sparsity Awareness

  2023cites this paper
• KD‐GAN: An effective membership inference attacks defence framework

  2022cites this paper
• Saving RNN Computations with a Neuron-Level Fuzzy Memoization Scheme

  2022cites this paper
• Enhanced Object Detection with Deep Convolutional Neural Networks for Vehicle Detection

  2022cites this paper
• E2HRL: An Energy-efficient Hardware Accelerator for Hierarchical Deep Reinforcement Learning

  2022cites this paper
• Random Fourier Feature-Based Deep Learning for Wireless Communications

  2021cites this paper
• Human Activity Recognition with Deep Learning: Overview, Challenges & Possibilities

  2021cites this paper
• Exploring GPU Architectural Optimizations for RNNs

  2021cites this paper
• Mixed Script Identification Using Automated DNN Hyperparameter Optimization

  2021cites this paper
• Bibliography

  2021cites this paper
• Long Short-Term Memory with Spin-Based Binary and Non-Binary Neurons

  2021cites this paper
• RETRACTED ARTICLE: Human activity recognition with deep learning: overview, challenges and possibilities

  2021cites this paper
• AERO: A 1.28 MOP/s/LUT Reconfigurable Inference Processor for Recurrent Neural Networks in a Resource-Limited FPGA

  2021cites this paper
• EILE: Efficient Incremental Learning on the Edge

  2021cites this paper
• Case study of hardware implementation

  2021cites this paper
• Chapter Five - FPGA based neural network accelerators

  2021cites this paper
• An Energy Efficient EdgeAI Autoencoder Accelerator for Reinforcement Learning

  2021cites this paper
• Memory-Augmented Neural Networks on FPGA for Real-Time and Energy-Efficient Question Answering

  2021cites this paper
• A classification method based on encoder‐decoder structure with paper content

  2020cites this paper
• Balancing Computation Loads and Optimizing Input Vector Loading in LSTM Accelerators

  2020cites this paper
• Achieving Full Parallelism in LSTM via a Unified Accelerator Design

  2020cites this paper
• A survey On hardware accelerators and optimization techniques for RNNs

  2020cites this paper
• Study on turbidity prediction method of reservoirs based on long short term memory neural network

  2020cites this paper
• Efficient Biomedical Image Segmentation on EdgeTPUs at Point of Care

  2020cites this paper
• WooKong: A Ubiquitous Accelerator for Recommendation Algorithms With Custom Instruction Sets on FPGA

  2020cites this paper
• A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

  2020cites this paper
• RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition

  2020cites this paper
• An Energy-Efficient Reconfigurable LSTM Accelerator for Natural Language Processing

  2019influential citation
• Deep Neural Network Approximation for Custom Hardware

  2019influential citation
• An energy-efficient voice activity detector using deep neural networks and approximate computing

  2019cites this paper
• An Application Specific Processor Architecture with 3D Integration for Recurrent Neural Networks

  2019cites this paper
• Jointly Considering Siamese Network and MatchPyramid Network for Text Semantic Matching

  2019influential citation
• AIX: A high performance and energy efficient inference accelerator on FPGA for a DNN-based commercial speech recognition

  2019cites this paper
• Low Complex & High Accuracy Computation Approximations to Enable On-Device RNN Applications

  2019cites this paper
• ApproxLP: Approximate Multiplication with Linearization and Iterative Error Control

  2019cites this paper
• Acceleration of LSTM With Structured Pruning Method on FPGA

  2019cites this paper
• PIPULS: Predicting I/O Patterns Using LSTM in Storage Systems

  2019cites this paper
• FastWave: Accelerating Autoregressive Convolutional Neural Networks on FPGA

  2019cites this paper
• Manna: An Accelerator for Memory-Augmented Neural Networks

  2019cites this paper
• Neuron-Level Fuzzy Memoization in RNNs

  2019cites this paper
• ELSA

  2019cites this paper
• LSTM-Sharp: An Adaptable, Energy-Efficient Hardware Accelerator for Long Short-Term Memory

  2019cites this paper
• Exploiting Model-Level Parallelism in Recurrent Neural Network Accelerators

  2019cites this paper
• On the Resilience of Deep Learning for Reduced-voltage FPGAs

  2019cites this paper
• RNA: Reconfigurable LSTM Accelerator with Near Data Approximate Processing

  2019cites this paper
• Efficient OpenCL Accelerators for Canny Edge Detection Algorithm on a CPU-FPGA Platform

  2019cites this paper
• A Deep Leaming Model with Multi-Scale Skip Connections for Solar Flare Prediction Combined with Prior Information

  2019cites this paper
• Accelerating RNN on FPGA with Efficient Conversion of High-Level Designs to RTL

  2019cites this paper
• Digital Design of Radial Basis Function Neural Network and Recurrent Neural Network

  2019cites this paper
• SHARP: An Adaptable, Energy-Efficient Accelerator for Recurrent Neural Networks

  2019cites this paper
• RNNFast

  2018cites this paper
• Approximate Computing for Long Short Term Memory (LSTM) Neural Networks

  2018cites this paper
• Streaming MANN: A Streaming-Based Inference for Energy-Efficient Memory-Augmented Neural Networks

  2018cites this paper
• EERA-ASR: An Energy-Efficient Reconfigurable Architecture for Automatic Speech Recognition With Hybrid DNN and Approximate Computing

  2018cites this paper
• Implementation Costs of Spiking versus Rate-Based ANNs

  2018cites this paper
• Detecting DGA domains with recurrent neural networks and side information

  2018influential citation
• C-LSTM: Enabling Efficient LSTM using Structured Compression Techniques on FPGAs

  2018cites this paper
• Analysis of Hardware Implementations to Accelerate Convolutional and Recurrent Neuronal Networks

  2018influential citation
• Reconfiguration optimization for nonvolatile memories based field programmable gate arrays

  2018cites this paper
• Approximate FPGA-based LSTMs under Computation Time Constraints

  2018cites this paper
• Perspective: Uniform switching of artificial synapses for large-scale neuromorphic arrays

  2018cites this paper
• 2 . 3 Detecting objects affordances with convolution neural networks [ 3 ]

  2018cites this paper
• An Innovative Machine Learning Approach for Object Detection and Recognition

  2018cites this paper
• EERA-DNN: An energy-efficient reconfigurable architecture for DNNs with hybrid bit-width and logarithmic multiplier

  2018influential citation
• DeepCPU: Serving RNN-based Deep Learning Models 10x Faster

  2018cites this paper
• Neuromorphic computing's yesterday, today, and tomorrow - an evolutional view

  2018cites this paper
• Efficient machine learning: models and accelerations

  2018influential citation
• The Implementation of a Pointer Network Model for Traveling Salesman Problem on a Xilinx PYNQ Board

  2018cites this paper
• MAERI: Enabling Flexible Dataflow Mapping over DNN Accelerators via Reconfigurable Interconnects

  2018cites this paper
• Energy-Efficient Inference Accelerator for Memory-Augmented Neural Networks on an FPGA

  2018cites this paper
• An Energy-efficient Reconfigurable Hybrid DNN Architecture for Speech Recognition with Approximate Computing

  2018cites this paper
• Accuracy Evaluation of Long Short Term Memory Network Based Language Model with Fixed-Point Arithmetic

  2017cites this paper
• FPGA-based accelerator for long short-term memory recurrent neural networks

  2017cites this paper
• A Survey of Neuromorphic Computing and Neural Networks in Hardware

  2017cites this paper
• Accelerating Recurrent Neural Networks: A Memory-Efficient Approach

  2017cites this paper
• E-ERA: An energy-efficient reconfigurable architecture for RNNs using dynamically adaptive approximate computing

  2017cites this paper
• Implementation and Optimization of the Accelerator Based on FPGA Hardware for LSTM Network

  2017cites this paper
• LOCAL DISTRIBUTED MOBILE COMPUTING SYSTEM FOR DEEP NEURAL NETWORKS

  2017cites this paper
• Processing LSTM in memory using hybrid network expansion model

  2017cites this paper
• Reconfigurable Hardware Accelerators: Opportunities, Trends, and Challenges

  2017cites this paper
• An FPGA Design Framework for CNN Sparsification and Acceleration

  2017cites this paper
• A fast and power efficient architecture to parallelize LSTM based RNN for cognitive intelligence applications

  2017cites this paper
• Hardware architecture of Bidirectional Long Short-Term Memory Neural Network for Optical Character Recognition

  2017cites this paper
• E-PUR: an energy-efficient processing unit for recurrent neural networks

  2017cites this paper
• MoDNN: Local distributed mobile computing system for Deep Neural Network

  2017cites this paper
• Hardware accelerators for recurrent neural networks on FPGA

  2017cites this paper
• FPGA architecture for feed-forward sequential memory network targeting long-term time-series forecasting

  2016cites this paper
• Accelerated Artificial Neural Networks on FPGA for fault detection in automotive systems

  2016cites this paper
• ApesNet: a pixel-wise efficient segmentation network

  2016cites this paper
• Accelerating recurrent neural networks in analytics servers: Comparison of FPGA, CPU, GPU, and ASIC

  2016cites this paper