Neural Network Approach to Word Category Prediction for English Texts

Word category prediction is used to implement an accurate word recognition system. Traditional statistical approaches require considerable training data to estimate the probabilities of word sequences, and many parameters to memorize probabilities. To solve this problem, NETgram, which is the neural network for word category prediction, is proposed. Training results show that the performance of the NETgram is comparable to that of the statistical model although the NETgram requires fewer parameters than the statistical model. Also the NETgram performs effectively for unknown data, i.e., the NETgram interpolates sparse training data. Results of analyzing the hidden layer show that the word categories are classified into linguistically significant groups. The results of applying the NETgram to HMM English word recognition show that the NETgram improves the word recognition rate from 81.0% to 86.9%

• Publication year

  1990

• Venue

  International Conference on Computational Linguistics

• Publication date

  1990-08-20

• Fields of study

  Computer Science

• Identifiers
  DOI 10.3115/991146.991184
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A study of English word category prediction based on neutral networks

  1989cited by this paper
• NETtalk: a parallel network that learns to read aloud

  1988cited by this paper
• A study of English word category prediction based on neural networks

  1988cited by this paper
• Improvement of word recognition results by trigram model

  1987cited by this paper
• An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition

  1983cited by this paper
• Interpolated estimation of Markov source parameters from sparse data

  1980cited by this paper
• Continuous speech recognition by statistical methods

  1976cited by this paper

• Explore the N-Gram Model of Adaptive Prediction Text

  2024cites this paper
• Exploring N-Gram Models for Adaptive Predictive Texts

  2024cites this paper
• Advancing neural language modeling in automatic speech recognition

  2020cites this paper
• Virtual keyboard with the prediction of words for children with cerebral palsy

  2020cites this paper
• Development of POS tagger for English-Bengali Code-Mixed data

  2020cites this paper
• ADDIS ABABA UNIVERSITY COLLEGE OF NATURAL AND COMPUTATIONAL SCIENCES SCHOOL OF INFORMATION SCIENCE WORD SEQUENCE PREDICTION FOR AMHARIC

  2019influential citation
• Apprentissage profond pour le traitement automatique des langues [Deep Learning for Natural Language Procesing]

  2018cites this paper
• Neural Machine Translation and Sequence-to-sequence Models: A Tutorial

  2017cites this paper
• Apprentissage discriminant de modèles neuronaux pour la traduction automatique [Discriminative training of continuous space translation models]

  2016cites this paper
• Neural Machine Translation

  2016cites this paper
• Part-of-speech Tagging of Code-Mixed Social Media Text

  2016cites this paper
• Improvements in language and translation modeling

  2016cites this paper
• Improving black-box speech-to-text systems via machine learning techniques

  2016cites this paper
• Generalizing and Hybridizing Count-based and Neural Language Models

  2016cites this paper
• Simple Tools for Exploring Variation in Code-switching for Linguists

  2016cites this paper
• Corpus based part-of-speech tagging

  2016cites this paper
• Apprentissage discriminant des modèles continus de traduction

  2015cites this paper
• Desambiguação de anotações morfossintáticas feitas por MTMDD

  2015cites this paper
• Neural Networks Leverage Corpus-wide Information for Part-of-speech Tagging

  2014cites this paper
• Combining techniques from different NN-based language models for machine translation

  2014cites this paper
• Adaptation in Machine Translation

  2014cites this paper
• Automatic Part-of-speech Tagging for Oromo Language Using Maximum Entropy Markov Model (MEMM) ⋆

  2014cites this paper
• Comparison of scheduling methods for the learning rate of neural network language models (Modèles de langue neuronaux: une comparaison de plusieurs stratégies d’apprentissage) [in French]

  2014cites this paper
• MECKA: Methodologies for Constructing Knowledge Bases for NLP Systems

  2014cites this paper
• N-Gram-based Input Encoding for Continuous Space Language Models

  2014cites this paper
• Adaptation Data Selection using Neural Language Models: Experiments in Machine Translation

  2013cites this paper
• Identifying Personal Narratives in Chinese Weblog Posts

  2013cites this paper
• Letter N-Gram-based Input Encoding for Continuous Space Language Models

  2013cites this paper
• Continuous space models with neural networks in natural language processing. (Modèles neuronaux pour la modélisation statistique de la langue)

  2012cites this paper
• Continuous space language models using restricted Boltzmann machines

  2012cites this paper
• Machine Learning Approaches applied to Brazilian Portuguese Word Prediction

  2010cites this paper
• Part-of-Speech Tagging for Bengali

  2009cites this paper
• 1 Neural Networks , Part-of-Speech Tagging and Lexicons

  2007cites this paper
• Identifier Splitting: A Study of Two Techniques

  2006cites this paper
• Part of Speech Tagging of spoken Dutch using Neural Networks

  2006cites this paper
• Adaptive Multilingual SentenceBoundary

  2006cites this paper
• Semantic description of text clusters

  2005cites this paper
• Application of Artificial Neural Networks in Morphological Tagging of Czech

  2004cites this paper
• Task adaptation in stochastic language model for Chinese homophone disambiguation

  2003cites this paper
• Efficient Part-of-Speech Tagging with a Min-Max Modular Neural-Network Model

  2003cites this paper
• Neural Network Approach to Adaptive Learning with an Application to Chinese Homophone Disambiguation

  2002cites this paper
• Chinese POS tagging based on maximum entropy model

  2002cites this paper
• Part of speech tagging with min-max modular neural networks

  2002cites this paper
• MULTILAYER FEEDFORWARD NEURAL NETWORKS IN PART-OF-SPEECH TAGGING AND WORD SENSE DISAMBIGUATION

  2001cites this paper
• Semantic Category Disambiguation of Chinese Lexicon using Neural Networks

  2001cites this paper
• Machine Learning and Natural Language Processing

  2000cites this paper
• Part-of-speech Tagging: A Machine Learning Approach based on Decision Trees

  1999cites this paper
• Part of speech tagging with min-max modular neural networks

  1999cites this paper
• Adaptive Multilingual Sentence Boundary Disambiguation

  1997cites this paper
• REAL WORLD AUTO-TAGGING OF SCIENTIFIC TEXT

  1997cites this paper
• Neural Networks in Chinese Lexical Classification

  1996cites this paper
• Markov random field based English Part-Of-Speech tagging system

  1996cites this paper
• A Neural Network Approach to Part-of-Speech Tagging *

  1996cites this paper
• Automatic Stochastic Tagging of Natural Language Texts

  1995cites this paper
• Context-sensitivity and linguistic structure in analogy-based parallel networks

  1994cites this paper
• Neural Networks for Wordform Recognition

  1994cites this paper
• The representation of natural language to enable neural networks to detect syntactic structures

  1994cites this paper
• Part-of-Speech Tagging With Neural Networks

  1994cites this paper
• Probabilistic part-of-speech tagging using decision trees

  1994cites this paper
• Tagging Experiments Using Neural Networks

  1993cites this paper
• Part-of-speech Tagging 1.1 Introduction

  year unknowncites this paper