Recurrent neural network language model training with noise contrastive estimation for speech recognition

No abstract is available for this paper.

• Publication year

  2015

• Venue

  IEEE International Conference on Acoustics, Speech, and Signal Processing

• Publication date

  2015-04-19

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1109/ICASSP.2015.7179005
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Improving the training and evaluation efficiency of recurrent neural network language models

  2015cited by this paper
• Efficient GPU-based training of recurrent neural network language models using spliced sentence bunch

  2014cited by this paper
• Variance regularization of RNNLM for speech recognition

  2014cited by this paper
• Fast and Robust Neural Network Joint Models for Statistical Machine Translation

  2014cited by this paper
• Efficient One-Pass Decoding with NNLM for Speech Recognition

  2014cited by this paper
• Efficient lattice rescoring using recurrent neural network language models

  2014cited by this paper
• Joint Language and Translation Modeling with Recurrent Neural Networks

  2013cited by this paper
• Recurrent neural networks for language understanding

  2013cited by this paper
• Distributed Representations of Words and Phrases and their Compositionality

  2013cited by this paper
• Comparison of feedforward and recurrent neural network language models

  2013influential reference
• Investigation of recurrent-neural-network architectures and learning methods for spoken language understanding

  2013cited by this paper
• Speed up of recurrent neural network language models with sentence independent subsampling stochastic gradient descent

  2013cited by this paper
• Accelerating recurrent neural network training via two stage classes and parallelization

  2013cited by this paper
• Decoding with Large-Scale Neural Language Models Improves Translation

  2013cited by this paper
• One billion word benchmark for measuring progress in statistical language modeling

  2013cited by this paper
• Structured Output Layer Neural Network Language Models for Speech Recognition

  2013cited by this paper
• Conversion of Recurrent Neural Network Language Models to Weighted Finite State Transducers for Automatic Speech Recognition

  2012cited by this paper
• A fast and simple algorithm for training neural probabilistic language models

  2012cited by this paper
• Noise-Contrastive Estimation of Unnormalized Statistical Models, with Applications to Natural Image Statistics

  2012influential reference
• Variational approximation of long-span language models for lvcsr

  2011cited by this paper
• Extensions of recurrent neural network language model

  2011cited by this paper
• Recurrent neural network based language model

  2010cited by this paper
• Improved neural network based language modelling and adaptation

  2010cited by this paper
• Continuous space language models

  2007cited by this paper
• Empirical study of neural network language models for Arabic speech recognition

  2007cited by this paper
• Training LVCSR systems on thousands of hours of data

  2005cited by this paper
• Getting More Mileage from Web Text Sources for Conversational Speech Language Modeling using Class-Dependent Mixtures

  2003cited by this paper
• SRILM - an extensible language modeling toolkit

  2002cited by this paper
• Learning representations by back-propagating errors

  1986cited by this paper

• Score-Based Training for Energy-Based TTS Models

  2025cites this paper
• DOC-RAG: ASR Language Model Personalization with Domain-Distributed Co-occurrence Retrieval Augmentation

  2024cites this paper
• PersonaLM: Language Model Personalization via Domain-distributed Span Aggregated K-Nearest N-gram Retrieval Augmentation

  2023cites this paper
• Language mapping functions: Improving softmax estimation and word embedding quality

  2021cites this paper
• A Tibetan Language Model That Considers the Relationship Between Suffixes and Functional Words

  2021cites this paper
• Self-Normalized Importance Sampling for Neural Language Modeling

  2021cites this paper
• Probabilistic Text Entry—Case Study 3

  2021cites this paper
• Joint Energy-based Model Training for Better Calibrated Natural Language Understanding Models

  2021cites this paper
• A Parallelizable Lattice Rescoring Strategy with Neural Language Models

  2021influential citation
• Efficient Neural Query Auto Completion

  2020cites this paper
• Advancing neural language modeling in automatic speech recognition

  2020cites this paper
• Language Model Using Neural Turing Machine Based on Localized Content-Based Addressing

  2020cites this paper
• Domain Robust, Fast, and Compact Neural Language Models

  2020cites this paper
• LSTM-LM with Long-Term History for First-Pass Decoding in Conversational Speech Recognition

  2020cites this paper
• Neural Language Modeling with Implicit Cache Pointers

  2020influential citation
• Investigation of Sampling Techniques for Maximum Entropy Language Modeling Training

  2019cites this paper
• Scalable Multi Corpora Neural Language Models for ASR

  2019cites this paper
• LSTM Language Models for LVCSR in First-Pass Decoding and Lattice-Rescoring

  2019cites this paper
• Multi-Graph Decoding for Code-Switching ASR

  2019cites this paper
• Investigating Speech Recognition for Improving Predictive AAC

  2019influential citation
• Recurrent Neural Network Language Model Adaptation for Multi-Genre Broadcast Speech Recognition and Alignment

  2019cites this paper
• Word Embedding Algorithms as Generalized Low Rank Models and their Canonical Form

  2019cites this paper
• An Empirical Study of Efficient ASR Rescoring with Transformers

  2019cites this paper
• Acoustic and Textual Data Augmentation for Improved ASR of Code-Switching Speech

  2018cites this paper
• Learning with Noise-Contrastive Estimation: Easing training by learning to scale

  2018cites this paper
• A Comparison of Language Model Training Techniques in a Continuous Speech Recognition System for Serbian

  2018cites this paper
• DA-IICT/IIITV System for Low Resource Speech Recognition Challenge 2018

  2018influential citation
• Efficient Language Model Adaptation with Noise Contrastive Estimation and Kullback-Leibler Regularization

  2018influential citation
• Whole Sentence Neural Language Models

  2018cites this paper
• Semi-supervised acoustic model training for speech with code-switching

  2018cites this paper
• Neural Networks-based Automatic Speech Recognition for Agricultural Commodity in Gujarati Language

  2018cites this paper
• Algorithmes à base d’échantillonage pour l’entraînement de modèles de langue neuronaux (Here the title in English)

  2018cites this paper
• Automatic Speech Recognition: Low Resource and Noise Robustness

  2018cites this paper
• Accelerating Recurrent Neural Network Language Model Based Online Speech Recognition System

  2018cites this paper
• Actes de la conférence Traitement Automatique de la Langue Naturelle, TALN 2018

  2018cites this paper
• Self-Normalization Properties of Language Modeling

  2018influential citation
• Conditional Noise-Contrastive Estimation of Unnormalised Models

  2018cites this paper
• Unsupervised and Efficient Vocabulary Expansion for Recurrent Neural Network Language Models in ASR

  2018cites this paper
• Improved Training Of Neural Trans-Dimensional Random field Language Models with Dynamic Noise-Contrastive Estimation

  2018cites this paper
• Code-Switching Detection with Data-Augmented Acoustic and Language Models

  2018cites this paper
• Applications of Approximate Learning and Inference for Probabilistic Models

  2017cites this paper
• A Simple Language Model based on PMI Matrix Approximations

  2017influential citation
• Recurrent neural network language models for keyword search

  2017cites this paper
• A Batch Noise Contrastive Estimation Approach for Training Large Vocabulary Language Models

  2017cites this paper
• Speeding up softmax computations in DNN-based large vocabulary speech recognition by senone weight vector selection

  2017cites this paper
• Learning Neural Trans-Dimensional Random Field Language Models with Noise-Contrastive Estimation

  2017cites this paper
• Investigation of lattice-free maximum mutual information-based acoustic models with sequence-level Kullback-Leibler divergence

  2017cites this paper
• Future vector enhanced LSTM language model for LVCSR

  2017cites this paper
• Recurrent Neural Network based language modeling with controllable external Memory

  2017cites this paper
• Natural language generation as neural sequence learning and beyond

  2017cites this paper
• Recurrent neural network language models for automatic speech recognition

  2017cites this paper
• Automatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies

  2017cites this paper
• Optimizing recurrent neural network language model GPU training

  2017influential citation
• Language Models with RNNs for Rescoring Hypotheses of Russian ASR

  2016cites this paper
• Combining Feature and Model-Based Adaptation of RNNLMs for Multi-Genre Broadcast Speech Recognition

  2016cites this paper
• Learning FOFE based FNN-LMs with noise contrastive estimation and part-of-speech features

  2016influential citation
• An Empirical Evaluation of Noise Contrastive Estimation for the Neural Network Joint Model of Translation

  2016influential citation
• Word-Phrase-Entity Recurrent Neural Networks for Language Modeling

  2016cites this paper
• Collaborative Recurrent Neural Networks for Dynamic Recommender Systems

  2016cites this paper
• A deep language model for software code

  2016cites this paper
• CUED-RNNLM — An open-source toolkit for efficient training and evaluation of recurrent neural network language models

  2016cites this paper
• Unsupervised Adaptation of Recurrent Neural Network Language Models

  2016cites this paper
• Improving and Scaling Trans-dimensional Random Field Language Models

  2016cites this paper
• Efficient Training and Evaluation of Recurrent Neural Network Language Models for Automatic Speech Recognition

  2016cites this paper
• Model Interpolation with Trans-dimensional Random Field Language Models for Speech Recognition

  2016cites this paper
• On training bi-directional neural network language model with noise contrastive estimation

  2016influential citation
• PMI Matrix Approximations with Applications to Neural Language Modeling

  2016influential citation
• Bidirectional Decoder Networks for Attention-Based End-to-End Offline Handwriting Recognition

  2016influential citation
• Chinese Preposition Selection for Grammatical Error Diagnosis

  2016influential citation
• Convolutional Neural Network Language Models

  2016cites this paper
• BlackOut: Speeding up Recurrent Neural Network Language Models With Very Large Vocabularies

  2015cites this paper
• CUED RNNLM Toolkit

  2015cites this paper
• Top-down Tree Long Short-Term Memory Networks

  2015cites this paper
• Tree Recurrent Neural Networks with Application to Language Modeling

  2015influential citation
• Sparse Non-negative Matrix Language Modeling

  2015cites this paper
• Recurrent neural network language model adaptation for multi-genre broadcast speech recognition

  2015cites this paper
• Scalable Recurrent Neural Network Language Models for Speech Recognition

  2015cites this paper
• 2015 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2015, South Brisbane, Queensland, Australia, April 19-24, 2015

  2015cites this paper
• Strategies for Training Large Vocabulary Neural Language Models

  2015cites this paper
• Variable-Length Word Encodings for Neural Translation Models

  2015cites this paper