NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation

No abstract is available for this paper.

• Publication year

  2022

• Venue

  International Conference on Computational Linguistics

• Publication date

  Unknown publication date

• Fields of study

  Linguistics, Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Enhancing Biomedical Scientific Reviews Summarization with Graph-based Factual Evidence Extracted from Papers

  2022cited by this paper
• Reproducibility Issues for BERT-based Evaluation Metrics

  2022cited by this paper
• Semantic Self-Segmentation for Abstractive Summarization of Long Documents in Low-Resource Regimes

  2022cited by this paper
• A Survey on Event Extraction for Natural Language Understanding: Riding the Biomedical Literature Wave

  2021cited by this paper
• MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers

  2021cited by this paper
• Datasets: A Community Library for Natural Language Processing

  2021cited by this paper
• AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing

  2021cited by this paper
• All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text

  2021cited by this paper
• BARTScore: Evaluating Generated Text as Text Generation

  2021influential reference
• Proceedings of the 2nd Workshop on Evaluation and Comparison of NLP Systems, Eval4NLP 2021, Punta Cana, Dominican Republic, November 10, 2021

  2021cited by this paper
• Unsupervised Event Graph Representation and Similarity Learning on Biomedical Literature

  2021cited by this paper
• Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing

  2020cited by this paper
• Asking and Answering Questions to Evaluate the Factual Consistency of Summaries

  2020cited by this paper
• BLEURT: Learning Robust Metrics for Text Generation

  2020influential reference
• Phenomena Explanation from Text: Unsupervised Learning of Interpretable and Statistically Significant Knowledge

  2020cited by this paper
• Automated Lay Language Summarization of Biomedical Scientific Reviews

  2020cited by this paper
• Systematically Exploring Redundancy Reduction in Summarizing Long Documents

  2020cited by this paper
• Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions

  2020cited by this paper
• COMET: A Neural Framework for MT Evaluation

  2020cited by this paper
• A Survey of Evaluation Metrics Used for NLG Systems

  2020influential reference
• Learning Interpretable and Statistically Significant Knowledge from Unlabeled Corpora of Social Text Messages: A Novel Methodology of Descriptive Text Mining

  2020cited by this paper
• Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics

  2020cited by this paper
• Language Models are Few-Shot Learners

  2020cited by this paper
• NUBIA: NeUral Based Interchangeability Assessor for Text Generation

  2020cited by this paper
• Volume

  2019cited by this paper
• BERTScore: Evaluating Text Generation with BERT

  2019influential reference
• Handling Divergent Reference Texts when Evaluating Table-to-Text Generation

  2019cited by this paper
• Sentence Mover’s Similarity: Automatic Evaluation for Multi-Sentence Texts

  2019cited by this paper
• SciPy 1.0: fundamental algorithms for scientific computing in Python

  2019cited by this paper
• EED: Extended Edit Distance Measure for Machine Translation

  2019cited by this paper
• Meteor++ 2.0: Adopt Syntactic Level Paraphrase Knowledge into Machine Translation Evaluation

  2019cited by this paper
• MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance

  2019cited by this paper
• Evaluating the Factual Consistency of Abstractive Text Summarization

  2019cited by this paper
• Generating Abstractive Summaries with Finetuned Language Models

  2019cited by this paper
• Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance

  2018cited by this paper
• A Call for Clarity in Reporting BLEU Scores

  2018cited by this paper
• Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategies

  2018cited by this paper
• Why We Need New Evaluation Metrics for NLG

  2017cited by this paper
• Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation

  2017influential reference
• Results of the WMT17 Metrics Shared Task

  2017cited by this paper
• chrF++: words helping character n-grams

  2017cited by this paper
• Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation

  2017cited by this paper
• CharacTer: Translation Edit Rate on Character Level

  2016cited by this paper
• Re-evaluating Automatic Metrics for Image Captioning

  2016cited by this paper
• From Word Embeddings To Document Distances

  2015cited by this paper
• CIDEr: Consensus-based image description evaluation

  2014cited by this paper
• Abstract Meaning Representation for Sembanking

  2013cited by this paper
• Scikit-learn: Machine Learning in Python

  2011cited by this paper
• The NumPy Array: A Structure for Efficient Numerical Computation

  2011cited by this paper
• Matplotlib: A 2D Graphics Environment

  2007cited by this paper
• A Study of Translation Edit Rate with Targeted Human Annotation

  2006cited by this paper
• METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments

  2005cited by this paper
• Spearman Rank Correlation

  2005cited by this paper
• Interpreting BLEU/NIST Scores: How Much Improvement do We Need to Have a Better System?

  2004influential reference
• Statistical Significance Tests for Machine Translation Evaluation

  2004cited by this paper
• ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation

  2004cited by this paper
• ROUGE: A Package for Automatic Evaluation of Summaries

  2004influential reference
• From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition

  2004cited by this paper
• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002influential reference
• Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, July 6-12, 2002, Philadelphia, PA, USA

  2002cited by this paper
• Automatic evaluation of machine translation quality using n-gram co-occurrence statistics

  2002cited by this paper
• Perplexity—a measure of the difficulty of speech recognition tasks

  1977cited by this paper
• Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel

  1975cited by this paper
• A computer readability formula designed for machine scoring.

  1975cited by this paper
• The Technique of Clear Writing.

  1968cited by this paper
• A NEW MEASURE OF RANK CORRELATION

  1938influential reference

• Efficient Memory-Enhanced Transformer for Long-Document Summarization in Low-Resource Regimes

  2023influential citation
• Can Synthetic Text Help Clinical Named Entity Recognition? A Study of Electronic Health Records in French

  2023cites this paper
• The Latest in Natural Language Generation: Trends, Tools and Applications in Industry

  2023cites this paper
• Graph-Enhanced Biomedical Abstractive Summarization Via Factual Evidence Extraction

  2023cites this paper
• Carburacy: Summarization Models Tuning and Comparison in Eco-Sustainable Regimes with a Novel Carbon-Aware Accuracy

  2023cites this paper
• Les textes cliniques français générés sont-ils dangereusement similaires à leur source ? Analyse par plongements de phrases

  2023cites this paper
• [Emoji] Evidence, my Dear Watson: Abstractive dialogue summarization on learnable relevant utterances

  2023cites this paper