Contextual Bitext-Derived Paraphrases in Automatic MT Evaluation

In this paper we present a novel method for deriving paraphrases during automatic MT evaluation using only the source and reference texts, which are necessary for the evaluation, and word and phrase alignment software. Using target language paraphrases produced through word and phrase alignment a number of alternative reference sentences are constructed automatically for each candidate translation. The method produces lexical and low-level syntactic paraphrases that are relevant to the domain in hand, does not use external knowledge resources, and can be combined with a variety of automatic MT evaluation system.

• Publication year

  2006

• Venue

  WMT@HLT-NAACL

• Publication date

  2006-06-08

• Fields of study

  Computer Science

• Identifiers
  DOI 10.3115/1654650.1654663
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• CDER: Efficient MT Evaluation Using Block Movements

  2006influential reference
• A STUDY OF TRANSLATION ERROR RATE WITH TARGETED HUMAN ANNOTATION

  2005cited by this paper
• METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments

  2005cited by this paper
• A Paraphrase-Based Approach to Machine Translation Evaluation

  2005cited by this paper
• Paraphrasing with Bilingual Parallel Corpora

  2005influential reference
• Europarl: A Parallel Corpus for Statistical Machine Translation

  2005influential reference
• Measuring confidence intervals for the machine translation evaluation metrics

  2004cited by this paper
• Pharaoh: A Beam Search Decoder for Phrase-Based Statistical Machine Translation Models

  2004influential reference
• Pharaoh: a beam search decoder for phrase-based statistical machine translation models

  2004influential reference
• Word to word alignment strategies

  2004cited by this paper
• Evaluation of machine translation and its evaluation

  2003cited by this paper
• Syntax-based Alignment of Multiple Translations: Extracting Paraphrases and Generating New Sentences

  2003cited by this paper
• A Systematic Comparison of Various Statistical Alignment Models

  2003cited by this paper
• Syntax for Statistical Machine Translation

  2003cited by this paper
• Statistical Phrase-Based Translation

  2003cited by this paper
• Automatic evaluation of machine translation quality using n-gram co-occurrence statistics

  2002cited by this paper
• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002cited by this paper
• An Unsupervised Method for Word Sense Tagging using Parallel Corpora

  2002cited by this paper

• Task-Oriented Paraphrase Analytics

  2024cites this paper
• Combining Variational Sampling and Metropolis--Hastings Sampling for Paraphrase Generation

  2021cites this paper
• A New Approach for Paraphrasing and Rewording a Challenging Text

  2021cites this paper
• Research on Machine Translation Automatic Evaluation Based on Extended Reference

  2019cites this paper
• Knowledge-lean Paraphrase Identification Using Character-Based Features

  2017cites this paper
• LEPOR: An Augmented Machine Translation Evaluation Metric

  2017cites this paper
• KS_JU@DPIL-FIRE2016: Detecting Paraphrases in Indian Languages Using Multinomial Logistic Regression Model

  2016cites this paper
• Manual and Automatic Paraphrases for MT Evaluation

  2016cites this paper
• Using Contextual Information for Machine Translation Evaluation

  2016cites this paper
• Learning to Detect Paraphrases in Indian Languages

  2016cites this paper
• Training machine translation for human acceptability

  2016cites this paper
• Constructing a Turkish Corpus for Paraphrase Identification and Semantic Similarity

  2016cites this paper
• Paraphrase identification using knowledge-lean techniques

  2016cites this paper
• Automatic Machine Translation Evaluation: A Qualitative Approach

  2015cites this paper
• Twitter Paraphrase Identification with Simple Overlap Features and SVMs

  2015cites this paper
• Proceedings of the EXPERT Scientific and Technological Workshop

  2015cites this paper
• Neutralizing the Effect of Translation Shifts on Automatic Machine Translation Evaluation

  2015cites this paper
• Woodpecker: An Automatic Methodology for Machine Translation Diagnosis with Rich Linguistic Knowledge

  2014cites this paper
• Learning to translate with products of novices: a suite of open-ended challenge problems for teaching MT

  2013influential citation
• BLEU Deconstructed: Designing a Better MT Evaluation Metric

  2013cites this paper
• Building Subjectivity Lexicon(s) from Scratch for Essay Data

  2012cites this paper
• Evaluation of machine translation with dependent Skip-Ngrams

  2012cites this paper
• Measuring the Adequacy of Cross-Lingual Paraphrases in a Machine Translation Setting

  2012cites this paper
• Shallow and Deep Paraphrasing for Improved Machine Translation Parameter Optimization

  2012cites this paper
• Candidacy Examination

  2011cites this paper
• Learning Sentential Paraphrases from Bilingual Parallel Corpora for Text-to-Text Generation

  2011cites this paper
• Generating Phrasal and Sentential Paraphrases: A Survey of Data-Driven Methods

  2010cites this paper
• Automatic Evaluation in Machine Translation Towards Similarity Measures Based on Multiple Linguistic Layers

  2010cites this paper
• The Circle of Meaning: From Translation to Paraphrasing and Back

  2010cites this paper
• Linguistic measures for automatic machine translation evaluation

  2010cites this paper
• All in Strings: a Powerful String-based Automatic MT Evaluation Metric with Multiple Granularities

  2010cites this paper
• PEM: A Paraphrase Evaluation Metric Exploiting Parallel Texts

  2010cites this paper
• EUSMT : Incorporating Linguistic information to Statistical Machine Translation for a morphologically rich language . Its use in preliminary SMT-RBMT-EBMT hybridization

  2009cites this paper
• Recycling texts: human evaluation of example-based machine translation subtitles for DVD

  2009cites this paper
• Capturing Lexical Variation in MT Evaluation Using Automatically Built Sense-Cluster Inventories

  2009cites this paper
• u´õstico en Mde Evaluacion Automde Traducciones Linguistic Processing in Automatic Translation Evaluation Metrics

  2009cites this paper
• Universidad Politécnica de Madrid

  2009cites this paper
• Integrated Language Technology as part of Next Generation Localisation

  2009cites this paper
• References Extension for the Automatic Evaluation of MT by Syntactic Hybridization

  2009cites this paper
• The Contribution of Linguistic Features to Automatic Machine Translation Evaluation

  2009cites this paper
• A SVM Regression Based Skip-Ngram Approach to MT Evaluation

  2008cites this paper
• Regression for machine translation evaluation at the sentence level

  2008cites this paper
• A novel dependency-based evaluation metric for machine translation

  2008cites this paper
• A Linguistically Motivated MT Evaluation System Based on SVM Regression

  2008cites this paper
• Syntactically Lexicalized Phrase-Based SMT

  2008cites this paper
• Syntactic Constraints on Paraphrases Extracted from Parallel Corpora

  2008cites this paper
• Empirical machine translation and its evaluation

  2008cites this paper
• Heterogeneous Automatic MT Evaluation Through Non-Parametric Metric Combinations

  2008cites this paper
• Towards HeterogeneousAutomatic MT Err or Analysis JeśusGiménezand Llu ís Màrquez

  2008cites this paper
• Towards Heterogeneous Automatic MT Error Analysis

  2008cites this paper
• NAACL-HLT 2007/ AMTA Workshop on Syntax and Structure in Statistical Translation (SSST): Held in conjunction with NAACL-HLT 2007, Rochester, New York, USA, 26 April 2007

  2007cites this paper
• Evaluating machine translation with LFG dependencies

  2007influential citation
• Labelled Dependencies in Machine Translation Evaluation

  2007influential citation
• Comparing rule-based and data-driven approaches to Spanish-to-Basque machine translation

  2007cites this paper
• Dependency-Based Automatic Evaluation for Machine Translation

  2007influential citation
• Paraphrasing and translation

  2007cites this paper
• In other words: Using paraphrases in translation

  2007cites this paper
• BLEUÂTRE: flattening syntactic dependencies for MT evaluation

  2007cites this paper
• Using F-structures in machine translation evaluation

  2007influential citation