Fully Automatic Semantic MT Evaluation

No abstract is available for this paper.

• Publication year

  2012

• Venue

  WMT@NAACL-HLT

• Publication date

  2012-06-07

• Fields of study

  Linguistics, Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A Radically Simple , Effective Annotation and Alignment Methodology for Semantic Frame Based SMT and MT Evaluation

  2011influential reference
• MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility based on semantic roles

  2011influential reference
• MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility based on semantic roles

  2011influential reference
• Structured vs. Flat Semantic Role Representations for Machine Translation Evaluation

  2011influential reference
• SMT Versus AI Redux: How Semantic Frames Evaluate MT More Accurately

  2011influential reference
• Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation

  2010cited by this paper
• Meta-Evaluation

  2010cited by this paper
• Further Meta-Evaluation of Machine Translation

  2008cited by this paper
• A Smorgasbord of Features for Automatic MT Evaluation

  2008cited by this paper
• Linguistic Features for Automatic Evaluation of Heterogenous MT Systems

  2007cited by this paper
• (Meta-) Evaluation of Machine Translation

  2007cited by this paper
• A Study of Translation Edit Rate with Targeted Human Annotation

  2006cited by this paper
• CDER: Efficient MT Evaluation Using Block Movements

  2006influential reference
• Manual and Automatic Evaluation of Machine Translation between European Languages

  2006cited by this paper
• A STUDY OF TRANSLATION ERROR RATE WITH TARGETED HUMAN ANNOTATION

  2005cited by this paper
• METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments

  2005influential reference
• Shallow Semantic Parsing using Support Vector Machines

  2004influential reference
• Automatic evaluation of machine translation quality using n-gram co-occurrence statistics

  2002influential reference
• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002cited by this paper
• An Evaluation Tool for Machine Translation: Fast Evaluation for MT Research

  2000influential reference
• Accelerated DP based search for statistical translation

  1997influential reference
• Automatic construction of clean broad-coverage translation lexicons

  1996cited by this paper
• Machine Translation

  1972cited by this paper

• Modelling Text Similarity: A Survey

  2023cites this paper
• ACES: Evaluating Automated Audio Captioning Models on the Semantics of Sounds

  2023cites this paper
• Translation Quality Assessment: A Brief Survey on Manual and Automatic Methods

  2021cites this paper
• An Error Analysis Framework for Shallow Surface Realization

  2021cites this paper
• A Survey of Evaluation Metrics Used for NLG Systems

  2020cites this paper
• Incorporate Semantic Structures into Machine Translation Evaluation via UCCA

  2020cites this paper
• Evaluation of Text Generation: A Survey

  2020cites this paper
• Machine Translation Evaluation Metric Based on Dependency Parsing Model

  2019cites this paper
• Research on Machine Translation Automatic Evaluation Based on Extended Reference

  2019cites this paper
• Automated Paraphrase Lattice Creation for HyTER Machine Translation Evaluation

  2018cites this paper
• Vision and Language Learning: From Image Captioning and Visual Question Answering towards Embodied Agents

  2018cites this paper
• SRL for low resource languages isn’t needed for semantic SMT

  2018cites this paper
• the 21st Annual Conference of the European Association for Machine Translation

  2018influential citation
• Otem&Utem: Over- and Under-Translation Evaluation Metric for NMT

  2018cites this paper
• Semantic Structural Evaluation for Text Simplification

  2018cites this paper
• Detecting errors in machine translation using residuals and metrics of automatic evaluation

  2018cites this paper
• The mat sat on the cat: investigating structure in the evaluation of order in machine translation

  2017cites this paper
• Permutation forests for modeling word order in machine translation

  2017cites this paper
• Towards a Better Human-Machine Collaboration in Statistical Translation : Example of Systematic Medical Reviews. (Vers une meilleure collaboration humain-machine en traduction statistique : l'exemple des revues systématiques en médecine)

  2017cites this paper
• Discourse Structure in Machine Translation Evaluation

  2017cites this paper
• Alternative Objective Functions for Training MT Evaluation Metrics

  2017cites this paper
• Machine Translation Evaluation with Neural Networks

  2017cites this paper
• Meaning preservation in Example-based Machine Translation with structural semantics

  2017cites this paper
• LEPOR: An Augmented Machine Translation Evaluation Metric

  2017influential citation
• Blend: a Novel Combined MT Metric Based on Direct Assessment — CASICT-DCU submission to WMT17 Metrics Task

  2017cites this paper
• Injecting a semantic objective function into early stage learning of spoken language translation

  2016cites this paper
• Driving inversion transduction grammar induction with semantic evaluation

  2016cites this paper
• SAARSHEFF at SemEval-2016 Task 1: Semantic Textual Similarity with Machine Translation Evaluation Metrics and (eXtreme) Boosted Tree Ensembles

  2016cites this paper
• Improving word alignment for low resource languages using English monolingual SRL

  2016cites this paper
• SPICE: Semantic Propositional Image Caption Evaluation

  2016cites this paper
• CobaltF: A Fluent Metric for MT Evaluation

  2016cites this paper
• A semantically confidence-weighted ITG induction algorithm

  2016cites this paper
• Machine Translation Evaluation for Arabic using Morphologically-enriched Embeddings

  2016cites this paper
• The 26th International Conference on Computational Linguistics (COLING 2016) Sixth Workshop on Hybrid Approaches to Translation

  2016cites this paper
• Semantically driven inversion transduction grammar induction for early stage training of spoken language translation

  2016cites this paper
• Guiding automatic MT evaluation by means of linguistic features

  2016cites this paper
• Machine Translation Evaluation Resources and Methods: A Survey.

  2016influential citation
• Improving semantic SMT via soft semantic role label constraints on ITG alignmens

  2015influential citation
• Pairwise Neural Machine Translation Evaluation

  2015cites this paper
• Re-assessing the WMT2013 Human Evaluation with Professional Translators Trainees

  2015cites this paper
• The role of syntax and semantics in machine translation and quality estimation of machine-translated user-generated content

  2015cites this paper
• VERTa: a Linguistically-motivated Metric at the WMT15 Metrics Task

  2015cites this paper
• Syntax-based machine translation using dependency grammars and discriminative machine learning

  2015cites this paper
• Re-assessing the WMT2013 Human Evaluation with Professional Translators Trainees

  2015cites this paper
• Improve the Evaluation of Translation Fluency by Using Entropy of Matched Sub-segments

  2015cites this paper
• Automatic Machine Translation Evaluation: A Qualitative Approach

  2015influential citation
• Improving evaluation and optimization of MT systems against MEANT

  2015influential citation
• Improve the Evaluation of Fluency Using Entropy for Machine Translation Evaluation Metrics

  2015cites this paper
• HLTC-HKUST: A Neural Network Paraphrase Classifier using Translation Metrics, Semantic Roles and Lexical Similarity Features

  2015cites this paper
• Predicting Machine Translation Adequacy with Document Embeddings

  2015cites this paper
• VERTa participation in the WMT14 Metrics Task

  2014cites this paper
• Lexical Access Preference and Constraint Strategies for Improving Multiword Expression Association within Semantic MT Evaluation

  2014influential citation
• On the reliability and inter-annotator agreement of human semantic MT evaluation via HMEANT

  2014influential citation
• Syntax and Semantics in Quality Estimation of Machine Translation

  2014cites this paper
• XMEANT: Better semantic MT evaluation without reference translations

  2014influential citation
• Using Discourse Structure Improves Machine Translation Evaluation

  2014cites this paper
• How Synchronous are Adjuncts in Translation Data?

  2014cites this paper
• Improving MEANT based semantically tuned SMT

  2014cites this paper
• Learning to Differentiate Better from Worse Translations

  2014cites this paper
• RED: A Reference Dependency Based MT Evaluation Metric

  2014cites this paper
• BiMEANT: Integrating Cross-Lingual and Monolingual Semantic Frame Similarities in the MEANT Semantic MT Evaluation Metric

  2014influential citation
• Better Semantic Frame Based MT Evaluation via Inversion Transduction Grammars

  2014influential citation
• Improving machine translation by training against an automatic semantic frame based evaluation metric

  2013influential citation
• Human semantic MT evaluation with HMEANT for IWSLT 2013

  2013cites this paper
• Improving machine translation into Chinese by tuning against Chinese MEANT

  2013cites this paper
• Can Informal Genres be better Translated by Tuning on Automatic Semantic Metrics?

  2013influential citation
• MEANT at WMT 2013: A Tunable, Accurate yet Inexpensive Semantic Frame Based MT Evaluation Metric

  2013influential citation
• The Feasibility of HMEANT as a Human MT Evaluation Metric

  2013cites this paper
• A Semantic Evaluation of Machine Translation Lexical Choice

  2013cites this paper
• Meaning Unit Segmentation in English and Chinese: a New Approach to Discourse Phenomena

  2013cites this paper
• Proceedings of the Workshop on Discourse in Machine Translation, DiscoMT@ACL 2013, Sofia, Bulgaria, August 9, 2013

  2013cites this paper
• Name-aware Machine Translation

  2013cites this paper
• Accuracy and robustness in measuring the lexical similarity of semantic role fillers for automatic semantic MT evaluation

  2012influential citation
• Proceedings of the Fifth Workshop on Syntax, Semantics and Structure in Statistical Translation

  2011influential citation