Demonstration of Joshua: An Open Source Toolkit for Parsing-based Machine Translation

We describe Joshua, an open source toolkit for statistical machine translation. Joshua implements all of the algorithms required for synchronous context free grammars (SCFGs): chart-parsing, n-gram language model integration, beam-and cube-pruning, and k-best extraction. The toolkit also implements suffix-array grammar extraction and minimum error rate training. It uses parallel and distributed computing techniques for scalability. We demonstrate that the toolkit achieves state of the art translation performance on the WMT09 French-English translation task.

• Publication year

  2009

• Venue

  Annual Meeting of the Association for Computational Linguistics

• Publication date

  2009-03-01

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.3115/1626431.1626459
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Variational Decoding for Statistical Machine Translation

  2009influential reference
• Findings of the 2009 Workshop on Statistical Machine Translation

  2009cited by this paper
• Efficient Extraction of Oracle-best Translations from Hypergraphs

  2009cited by this paper
• Joshua: An Open Source Toolkit for Parsing-Based Machine Translation

  2009influential reference
• Z-MERT: A Fully Configurable Open Source Tool for Minimum Error Rate Training of Machine Translation Systems

  2009cited by this paper
• Lattice-based Minimum Error Rate Training for Statistical Machine Translation

  2008cited by this paper
• A Scalable Decoder for Parsing-Based Machine Translation with Equivalent Language Model State Maintenance

  2008cited by this paper
• Hierarchical Phrase-Based Translation with Suffix Arrays

  2007cited by this paper
• Moses: Open Source Toolkit for Statistical Machine Translation

  2007cited by this paper
• Randomised Language Modelling for Statistical Machine Translation

  2007cited by this paper
• Hierarchical Phrase-Based Translation

  2007influential reference
• Scalable Inference and Training of Context-Rich Syntactic Translation Models

  2006cited by this paper
• Tree-to-String Alignment Template for Statistical Machine Translation

  2006cited by this paper
• Scaling Phrase-Based Statistical Machine Translation to Larger Corpora and Longer Phrases

  2005cited by this paper
• Dependency Treelet Translation: Syntactically Informed Phrasal SMT

  2005cited by this paper
• Better k-best Parsing

  2005cited by this paper
• Learning Non-Isomorphic Tree Mappings for Machine Translation

  2003cited by this paper
• Minimum Error Rate Training in Statistical Machine Translation

  2003cited by this paper

• Statistical Machine Translation for Indic Languages

  2023cites this paper
• Apply Chinese Radicals Into Neural Machine Translation: Deeper Than Character Level

  2018cites this paper
• Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than Character Level

  2018cites this paper
• Exploration of Corpus Augmentation Approach for English-Hindi Bidirectional Statistical Machine Translation System

  2016cites this paper
• A hybrid machine translation architecture guided by syntax

  2014cites this paper
• Getting Past the Language Gap: Innovations in Machine Translation

  2013cites this paper
• Tree-based Translation without using Parse Trees

  2012influential citation
• A joint translation model with integrated reordering

  2012cites this paper
• An incremental syntactic language model for statistical phrase-based machine translation

  2012cites this paper
• Modality and Negation in SIMT Use of Modality and Negation in Semantically-Informed Syntactic MT

  2012cites this paper
• Effective Use of Function Words for Rule Generalization in Forest-Based Translation

  2011cites this paper
• Fine-Grained Tree-to-String Translation Rule Extraction

  2010influential citation
• Improve syntax-based translation using deep syntactic structures

  2010influential citation
• Improving Statistical Machine Translation with Monolingual Collocation

  2010influential citation
• Deep Syntactic Structures for String-to-Tree Translation

  2010influential citation
• Fundamental and New Approaches to Statistical Machine Translation

  2010cites this paper
• Statistical machine translation using large-scale lexicon and deep syntactic structures

  2010cites this paper