Discriminative Training and Maximum Entropy Models for Statistical Machine Translation

We present a framework for statistical machine translation of natural languages based on direct maximum entropy models, which contains the widely used source-channel approach as a special case. All knowledge sources are treated as feature functions, which depend on the source language sentence, the target language sentence and possible hidden variables. This approach allows a baseline machine translation system to be extended easily by adding new feature functions. We show that a baseline statistical machine translation system is significantly improved using this approach.

• Publication year

  2002

• Venue

  Annual Meeting of the Association for Computational Linguistics

• Publication date

  2002-07-06

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.3115/1073083.1073133
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002cited by this paper
• Model-based MCE bound to the true Bayes' error

  2001cited by this paper
• A Comparison of Alignment Models for Statistical Machine Translation

  2000cited by this paper
• An Evaluation Tool for Machine Translation: Fast Evaluation for MT Research

  2000influential reference
• COMPACT MAXIMUM ENTROPY LANGUAGE MODELS

  1999cited by this paper
• Improved Alignment Models for Statistical Machine Translation

  1999influential reference
• Discriminative model combination

  1998cited by this paper
• Maximum likelihood and discriminative training of direct translation models

  1998influential reference
• Feature-based language understanding

  1997influential reference
• A Maximum Entropy Approach to Natural Language Processing

  1996cited by this paper
• Statistical and Discriminative Methods for Speech Recognition

  1996cited by this paper
• Verbmobil: Towards a DRT-based translation of spontaneous negotiation dialogues

  1995cited by this paper
• On the Probabilistic Interpretation of Neural Network Classifiers and Discriminative Training Criteria

  1995cited by this paper
• The Mathematics of Statistical Machine Translation: Parameter Estimation

  1993cited by this paper
• Maximum mutual information estimation of hidden Markov model parameters for speech recognition

  1986cited by this paper
• Generalized Iterative Scaling for Log-Linear Models

  1972cited by this paper

• Attention based English to Indo-Aryan and Dravidian language translation using sparsely factored NMT

  2025cites this paper
• Fine-Tuning LLMs to Analyze Multiple Dimensions of Code Review: A Maximum Entropy Regulated Long Chain-of-Thought Approach

  2025cites this paper
• Two Spelling Normalization Approaches Based on Large Language Models

  2025cites this paper
• A multi agent classical Chinese translation method based on large language models

  2025cites this paper
• Preference Grammars and Decoding Algorithms for Probabilistic Synchronous Context Free Grammar Based Translation

  2024cites this paper
• LF Transformer: A novel lightweight network for machine translation

  2024cites this paper
• A probabilistic model for API contract specification retrieval focusing on the openAPI standard

  2024cites this paper
• From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models

  2024cites this paper
• Select and Reorder: A Novel Approach for Neural Sign Language Production

  2024cites this paper
• A novel measurement approach to dynamic change of limb length discrepancy using deep learning and wearable sensors

  2024cites this paper
• Machine Translation Systems Based on Classical-Statistical-Deep-Learning Approaches

  2023cites this paper
• NAISTeacher: A Prompt and Rerank Approach to Generating Teacher Utterances in Educational Dialogues

  2023cites this paper
• On the Efficiency and Efficacy of Machine-Assisted Literary Translation: A Case Study for English/Romanian and Romanian/English Machine-Assisted Translation

  2023cites this paper
• Approximating to the Real Translation Quality for Neural Machine Translation via Causal Motivated Methods

  2023cites this paper
• Interactive machine translation for the language modernization and spelling normalization of historical documents

  2023cites this paper
• 机器翻译和大语言模型研究进展(Research Development of Machine translation and Large Language Model)

  2023cites this paper
• Romagi of Shan Language to English Using Phrase-Based Statistical Machine Translation Model

  2023cites this paper
• Design and Analysis of English Intelligent Translation System Based on Internet of Things and Big Data Model

  2022cites this paper
• Short Sequence Chinese-English Machine Translation Based on Generative Adversarial Networks of Emotion

  2022cites this paper
• Ensemble Machine Translation to Filter Low Quality Corpus

  2022cites this paper
• Chinese Named Entity Recognition of Geological News Based on BERT Model

  2022cites this paper
• Research Trend in the International Literatures on Machine Translation Based on CiteSpace

  2022cites this paper
• API-Miner: an API-to-API Specification Recommendation Engine

  2022cites this paper
• On the Construction of Knowledge-Communication-Oriented Computer Spoken Corpus for Endangered Languages

  2022cites this paper
• API-Spector: an API-to-API Specification Recommendation Engine

  2022cites this paper
• Statistical Feature Aided Intelligent Deep Learning Machine Translation in Internet of Things

  2022cites this paper
• Real-Time Automatic Translation Algorithm for Chinese Subtitles in Media Playback Using Knowledge Base

  2022cites this paper
• Unsupervised SMT: an analysis of Indic languages and a low resource language

  2022cites this paper
• Research on the Application of Multimedia Entropy Method in Data Mining of Retail Business

  2022cites this paper
• Design of New Word Retrieval Algorithm for Chinese-English Bilingual Parallel Corpus

  2022cites this paper
• Prompt Gating: A Parameter Efficient Tuning Method for Zero-Shot Multi-Source Translation

  2022cites this paper
• Lingua Custodia’s Participation at the WMT 2022 Word-Level Auto-completion Shared Task

  2022cites this paper
• Optimized Chinese Pronunciation Prediction byComponent-Based Statistical Machine Translation

  2021cites this paper
• Word reordering on multiple pivots for the Japanese and Indonesian language pair

  2021cites this paper
• Intelligent Machine Translation of Chinese English News in the Context of Communication Observations and a Priori Modeling

  2021cites this paper
• Recent Advances in Dialogue Machine Translation

  2021cites this paper
• CHAPTER 10 Machine Translation andEncoder-Decoder Models

  2021cites this paper
• Evaluation of Translation Technology

  2021cites this paper
• Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks

  2021cites this paper
• Inteligência Artificial e os rumos do processamento do português brasileiro

  2021cites this paper
• An empirical analysis of phrase-based and neural machine translation

  2021cites this paper
• Dependency Graph-to-String Statistical Machine Translation

  2021cites this paper
• Correction

  2021cites this paper
• Reducing Length Bias in Scoring Neural Machine Translation via a Causal Inference Method

  2021cites this paper
• A Critique of Statistical Machine Translation

  2021cites this paper
• Gaussian Process Regression for Maximum Entropy Distribution

  2020cites this paper
• Improving transliteration with precise alignment of phoneme chunks and using contextual features

  2020cites this paper
• Deep Neural Network--based Machine Translation System Combination

  2020cites this paper
• Rewriter-Evaluator Architecture for Neural Machine Translation

  2020influential citation
• SuVashantor: English to Bangla Machine Translation Systems

  2020cites this paper
• THEORETICAL FUNDAMENTALS OF UZBEKENGLISH PARALLEL CORPUS

  2020cites this paper
• Domain Transfer based Data Augmentation for Neural Query Translation

  2020cites this paper
• Constraint Translation Candidates: A Bridge between Neural Query Translation and Cross-lingual Information Retrieval

  2020cites this paper
• Exploiting Neural Query Translation into Cross Lingual Information Retrieval

  2020cites this paper
• A Review of 1D Convolutional Neural Networks toward Unknown Substance Identification in Portable Raman Spectrometer

  2020cites this paper
• Correction

  2020cites this paper
• Iterative Training of Unsupervised Neural and Statistical Machine Translation Systems

  2020cites this paper
• The Roles of Language Models and Hierarchical Models in Neural Sequence-to-Sequence Prediction

  2020cites this paper
• Reinforcement Learning for Machine Translation: from Simulations to Real-World Applications

  2020cites this paper
• Non-Autoregressive Neural Dialogue Generation

  2020cites this paper
• Semantically Smooth Bilingual Phrase Embeddings Based on Recursive Autoencoders

  2020cites this paper
• Improving transliteration with precise alignment of phoneme chunks and using contextual features

  2020cites this paper
• PROBLEMS OF LINGUISTIC TAGGING OF UZBEK-ENGLISH PARALLEL CORPUS TEXTS.

  2020cites this paper
• Chatbot Design Method Using Hybrid Word Vector Expression Model Based on Real Telemarketing Data

  2020cites this paper
• Self-attention based end-to-end Hindi-English Neural Machine Translation

  2019cites this paper
• Title A monotonic statistical machine translation approach tospeaking style transformation

  2019cites this paper
• An Interactive Machine Translation Framework for Modernizing Historical Documents

  2019cites this paper
• Tailoring an Interpretable Neural Language Model

  2019cites this paper
• Response-Based and Counterfactual Learning for Sequence-to-Sequence Tasks in NLP

  2019cites this paper
• Enriching Character-Based Neural Machine Translation with Modern Documents for Achieving an Orthography Consistency in Historical Documents

  2019cites this paper
• Enhanced Beam-Search Restructuring Restraint for Phrase-Based Statistical Machine Translation

  2019cites this paper
• Reranking for Neural Semantic Parsing

  2019cites this paper
• EED: Extended Edit Distance Measure for Machine Translation

  2019cites this paper
• On the use of prior and external knowledge in neural sequence models

  2019influential citation
• A simple discriminative training method for machine translation with large-scale features

  2019cites this paper
• Multilingual Multi-Domain Adaptation Approaches for Neural Machine Translation

  2019cites this paper
• Modernizing Historical Documents: a User Study

  2019cites this paper
• Multivariate multiscale distribution entropy of financial time series

  2019cites this paper
• Vector sentences representation for data selection in statisticalmachine translation

  2019cites this paper
• Myanmar Phrase Translation for Myanmar-English Machine Translation System

  2019influential citation
• Unsupervised Neural Machine Translation with SMT as Posterior Regularization

  2019cites this paper
• Fusion of Image-text attention for Transformer-based Multimodal Machine Translation

  2019cites this paper
• A unified framework and models for integrating translation memory into phrase-based statistical machine translation

  2019cites this paper
• Multiple Pivots in Statistical Machine Translation for Low Resource Languages

  2019cites this paper
• Improving Statistical Machine Translation Quality Using Differential Evolution

  2019cites this paper
• Language Model-Driven Unsupervised Neural Machine Translation

  2019cites this paper
• Deep Learning for Natural Language Processing

  2019cites this paper
• Independent Fusion of Words and Image for Multimodal Machine Translation

  2019cites this paper
• Deep Neural Networks at the Service of Multilingual Parallel Sentence Extraction

  2018cites this paper
• TermFinder: log-likelihood comparison and phrase-based statistical machine translation models for bilingual terminology extraction

  2018cites this paper
• Why Do Neural Response Generation Models Prefer Universal Replies?

  2018cites this paper
• Spatial Pyramid Pooling Mechanism in 3D Convolutional Network for Sentence-Level Classification

  2018cites this paper
• Incorporating Statistical Machine Translation Word Knowledge Into Neural Machine Translation

  2018cites this paper
• SIGN LANGUAGE RECOGNITION WITH MULTI FEATURE FUSION AND ADABOOST CLASSIFIER

  2018cites this paper
• A Machine Translation Approach for Modernizing Historical Documents Using Backtranslation

  2018cites this paper
• Training Set Similarity Based Parameter Selection for Statistical Machine Translation

  2018cites this paper
• Simultaneous Translation using Optimized Segmentation

  2018cites this paper
• Effective Parallel Corpus Mining using Bilingual Sentence Embeddings

  2018cites this paper
• Alignment-consistent recursive neural networks for bilingual phrase embeddings

  2018cites this paper
• Chapter 2 Machine translation : Past , present and future

  2018cites this paper