Statistical Phrase-Based Translation

We propose a new phrase-based translation model and decoding algorithm that enables us to evaluate and compare several, previously proposed phrase-based translation models. Within our framework, we carry out a large number of experiments to understand better and explain why phrase-based models out-perform word-based models. Our empirical results, which hold for all examined language pairs, suggest that the highest levels of performance can be obtained through relatively simple means: heuristic learning of phrase translations from word-based alignments and lexical weighting of phrase translations. Surprisingly, learning phrases longer than three words and learning phrases from high-accuracy word-level alignment models does not have a strong impact on performance. Learning only syntactically motivated phrases degrades the performance of our systems.

• Publication year

  2003

• Venue

  North American Chapter of the Association for Computational Linguistics

• Publication date

  2003-05-27

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.3115/1073445.1073462
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002cited by this paper
• A Phrase-Based,Joint Probability Model for Statistical Machine Translation

  2002influential reference
• Application of translation knowledge acquired by hierarchical phrase alignment for pattern-based MT.

  2002cited by this paper
• Fast Decoding and Optimal Decoding for Machine Translation

  2001cited by this paper
• An Efficient A* Search Algorithm for Statistical Machine Translation

  2001cited by this paper
• A Syntax-based Statistical Translation Model

  2001influential reference
• Improved Statistical Alignment Models

  2000influential reference
• Robust German Noun Chunking With a Probabilistic Context-Free Grammar

  2000cited by this paper
• Improved Alignment Models for Statistical Machine Translation

  1999influential reference
• Three Generative, Lexicalised Models for Statistical Parsing

  1997influential reference
• Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora

  1997cited by this paper
• Statistical methods for speech recognition

  1997cited by this paper
• Statistical language modeling using the CMU-cambridge toolkit

  1997cited by this paper
• The mathematics of statistical machine translation

  1993cited by this paper
• The Mathematics of Statistical Machine Translation: Parameter Estimation

  1993cited by this paper

• From voice to safety: Language AI powered pilot-ATC communication understanding for airport surface movement collision risk assessment

  2026cites this paper
• Kurukh to Hindi Translation: A Review of Methods, Challenges and Future Directions

  2026cites this paper
• ChatGPT vs Gemini: Which Digs Deeper into Arabic Semantics?

  2026cites this paper
• Controlled beam search for neural machine translation using subword units leveraging phrase-based statistical machine translation outputs

  2026cites this paper
• Multimodal Translation Method Using Summary-Level Image Utilization

  2026cites this paper
• Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation

  2025cites this paper
• LLM Based Long Code Translation using Identifier Replacement

  2025cites this paper
• Explicit Segmentation for Low-Resource NMT: A Case Study in QLoRA-Based Fine-Tuning of LLM for Khmer Language

  2025cites this paper
• Effectiveness of Transfer Learning Approach for Low-Resource Bangla Dialect Translation

  2025cites this paper
• Guiding Neural Machine Translation with Bilingual Phrase Knowledge

  2025cites this paper
• Rethinking the Capability of Fine-Tuned Language Models for Automated Vulnerability Repair

  2025cites this paper
• Enhancing Neural Machine Translation from Spanish-Zapoteco by Fine-Tuning Transformer Models

  2025cites this paper
• TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarking

  2025cites this paper
• Enhanced automatic abstractive document summarization using transformers and sentence grouping

  2025cites this paper
• Predicting Compact Phrasal Rewrites with Large Language Models for ASR Post Editing

  2025cites this paper
• Flexico: Sustainable Machine Translation via Self-Adaptation

  2025cites this paper
• Sequence-to-sequence models with attention mechanistically map to the architecture of human memory search

  2025cites this paper
• Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs

  2025cites this paper
• Learning code better through structural information of data flow

  2025cites this paper
• A comprehensive overview of LLM-based approaches for machine translation

  2025cites this paper
• Adversarial Robustness of Vision in Open Foundation Models

  2025cites this paper
• Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mapping

  2025cites this paper
• Evaluating the Impact of Verbal Multiword Expressions on Machine Translation

  2025cites this paper
• Digitalizing Maguindanaon Language Using Corpus-Based Approach and Statistical Machine Translation (Smt)

  2025cites this paper
• Case-Based Decision-Theoretic Decoding with Quality Memories

  2025cites this paper
• Machine Translation in the Era of Large Language Models:A Survey of Historical and Emerging Problems

  2025cites this paper
• An Intelligent Proofreading Framework for Structured Official Documents Based on Large Language Models

  2025cites this paper
• Post-Editing Efficiency And Quality Assessment: A Comparative Analysis Of Google Translate And DeepL

  2025cites this paper
• A Survey on Tibetan-Chinese Machine Translation

  2025cites this paper
• A Hybrid Statistical and Rule-based Approach to Extremely Low-resource Machine Transliteration

  2025cites this paper
• A decade of gender bias in machine translation

  2025cites this paper
• Unsupervised Translation of Emergent Communication

  2025cites this paper
• CS-PaperSum: A Large-Scale Dataset of AI-Generated Summaries for Scientific Papers

  2025cites this paper
• Nominalisation and semantic shift in selected isiXhosa nouns

  2025cites this paper
• Two Spelling Normalization Approaches Based on Large Language Models

  2025cites this paper
• MedCOD: Enhancing English-to-Spanish Medical Translation of Large Language Models Using Enriched Chain-of-Dictionary Framework

  2025cites this paper
• Artificial Intelligence or Human: The Use of ChatGPT in the Academic Translation for Religious Texts

  2025cites this paper
• CANDLE: A Cross-Modal Agentic Knowledge Distillation Framework for Interpretable Sarcopenia Diagnosis

  2025cites this paper
• Mitra: Improving Terminologically Constrained Translation Quality with Backtranslations and Flag Diacritics

  2024cites this paper
• Neural Representation Learning in Linguistic Structured Prediction

  2024cites this paper
• Exploring Low-Resource Machine Translation: Case Study of Lao-Vietnamese Translation

  2024cites this paper
• Sign Language Machine Translation

  2024cites this paper
• CrossInspector: A Static Analysis Approach for Cross-Contract Vulnerability Detection

  2024cites this paper
• ChakmaNMT: Machine Translation for a Low-Resource and Endangered Language via Transliteration

  2024influential citation
• Khmer-Braille Dataset for Machine Translation

  2024cites this paper
• Preference Grammars and Decoding Algorithms for Probabilistic Synchronous Context Free Grammar Based Translation

  2024influential citation
• Enhancing Sentiment Analysis: A Comparative Study of Word Embedding Integration in Mobile Phone Reviews

  2024cites this paper
• Tibetan-Chinese Machine Translation Enhanced on Cross-Lingual Pre-Trained Model

  2024cites this paper
• La traducción automática de expresiones multiverbales en el turismo gastronómico

  2024cites this paper
• Artificial intelligence contribution to translation industry: looking back and forward

  2024cites this paper
• Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation

  2024cites this paper
• LF Transformer: A novel lightweight network for machine translation

  2024cites this paper
• Design and Analysis of Digital Vocal Processor Tool Kit for Advancing Industry

  2024cites this paper
• Analysis of Idioms in Neural Machine Translation: A Data Set

  2024cites this paper
• Efficient incremental training using a novel NMT-SMT hybrid framework for translation of low-resource languages

  2024cites this paper
• Sequence-to-Sequence Models and Their Evaluation for Spoken Language Normalization of Slovenian

  2024cites this paper
• Reflection of Explicitation in Scientific Translation: Neural Machine Translation vs. Human Post-Editing

  2024cites this paper
• Table-to-Text Generation With Pretrained Diffusion Models

  2024cites this paper
• PQ-GCN: Enhancing Text Graph Question Classification with Phrase Features

  2024cites this paper
• Translation Evaluation of Social Media Auto-Translate Feature toward News Headline

  2024cites this paper
• Enhancing Neural Arabic Machine Translation using Character-Level CNN-BILSTM and Hybrid Attention

  2024cites this paper
• Output Scouting: Auditing Large Language Models for Catastrophic Responses

  2024cites this paper
• Unlocking the language barrier: A Journey through Arabic machine translation

  2024cites this paper
• NAIST-SIC-Aligned: An Aligned English-Japanese Simultaneous Interpretation Corpus

  2024cites this paper
• Uncertainty-Guided Likelihood Tree Search

  2024cites this paper
• Context-Aware Machine Translation with Source Coreference Explanation

  2024cites this paper
• Select and Reorder: A Novel Approach for Neural Sign Language Production

  2024cites this paper
• CantonMT: Investigating Back-Translation and Model-Switch Mechanisms for Cantonese-English Neural Machine Translation

  2024cites this paper
• An empirical study of a novel multimodal dataset for low-resource machine translation

  2024cites this paper
• Contextualized Word Embeddings in Azerbaijani Language

  2024cites this paper
• A phrase-based questionnaire-answering approach for automatic initial frailty assessment based on clinical notes

  2024cites this paper
• Thinker-DDM: Modeling Deliberation for Machine Translation with a Drift-Diffusion Process

  2024cites this paper
• A Study on Automatic English Grammatical Error Correction Using Transformer and BERT

  2024cites this paper
• Decoding Multilingual Topic Dynamics and Trend Identification through ARIMA Time Series Analysis on Social Networks: A Novel Data Translation Framework Enhanced by LDA/HDP Models

  2024cites this paper
• MedBot: A Novel Sequential Pipeline for Context Recognition Based on SciSpacy and Med7 Entity Recognizer

  2024cites this paper
• VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models

  2024cites this paper
• Cross-lingual Contextualized Phrase Retrieval

  2024influential citation
• Mapping Morphological Patterns: A Framework for Rinconada Bikol Language Morphological Analysis and Stemming

  2024cites this paper
• GAP: A Grammar and Position-Aware Framework for Efficient Recognition of Multi-Line Mathematical Formulas

  2024cites this paper
• RETRACTED: Improving neural machine translation by word translations

  2024cites this paper
• Machine translation literacy in the legal translation context: a SWOT analysis perspective

  2024cites this paper
• Persian Ezafe Recognition Using Neural Approaches

  2024cites this paper
• A Tale of Two Languages: Large-Vocabulary Continuous Sign Language Recognition from Spoken Language Supervision

  2024cites this paper
• Transfer Fine-tuning for Quality Estimation of Text Simplification

  2024cites this paper
• First Tragedy, then Parse: History Repeats Itself in the New Era of Large Language Models

  2024cites this paper
• Modeling of learning curves with applications to POS tagging

  2024cites this paper
• EMTeC: A corpus of eye movements on machine-generated texts

  2024cites this paper
• Machine Translation Through Cultural Texts: Can Verses and Prose Help Low-Resource Indigenous Models?

  2024cites this paper
• Unsupervised Neural Machine Translation between the Portuguese language and the Chinese and Korean languages

  2023influential citation
• Syntactic Versus Semantic Similarity of Artificial and Real Faults in Mutation Testing Studies

  2023cites this paper
• Interpreting Positional Information in Perspective of Word Order

  2023cites this paper
• On Evaluating Multilingual Compositional Generalization with Translated Datasets

  2023cites this paper
• Text-Text Neural Machine Translation: A Survey

  2023cites this paper
• Corpus Processing of Multi-Word Discourse Markers for Advanced Learners

  2023cites this paper
• Breeding Machine Translations: Evolutionary approach to survive and thrive in the world of automated evaluation

  2023cites this paper
• Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona

  2023cites this paper
• Multilingual Indian Language Neural Machine Translation System Using mT5 Transformer

  2023cites this paper
• Similarity-Based Retrieval in Process-Oriented Case-Based Reasoning Using Graph Neural Networks and Transfer Learning

  2023cites this paper
• EVALIGN: Visual Evaluation of Translation Alignment Models

  2023cites this paper
• English-Assamese neural machine translation using prior alignment and pre-trained language model

  2023cites this paper