N-gram Counts and Language Models from the Common Crawl

No abstract is available for this paper.

• Publication year

  2014

• Venue

  International Conference on Language Resources and Evaluation

• Publication date

  2014-05-01

• Fields of study

  Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Edinburgh SLT and MT system description for the IWSLT 2014 evaluation

  2014cited by this paper
• Statistical Machine Translation

  2014cited by this paper
• Integrating an Unsupervised Transliteration Model into Statistical Machine Translation

  2014cited by this paper
• Can Markov Models Over Minimal Translation Units Help Phrase-Based SMT?

  2013cited by this paper
• Findings of the 2013 Workshop on Statistical Machine Translation

  2013influential reference
• Dirt Cheap Web-Scale Parallel Text from the Common Crawl

  2013cited by this paper
• Empirical Exploration of Language Modeling for the google.com Query Stream as Applied to Mobile Voice Search

  2013cited by this paper
• Scalable Modified Kneser-Ney Language Model Estimation

  2013cited by this paper
• Sparse lexicalised features and topic adaptation for SMT

  2012cited by this paper
• Storing the Web in Memory: Space Efficient Language Models with Constant Time Retrieval

  2010cited by this paper
• Unsupervised Acquisition of Lexical Knowledge From N-grams : Final Report of the 2009 JHU CLSP Workshop

  2010influential reference
• An Overview of Microsoft Web N-gram Corpus and Applications

  2010cited by this paper
• Creating Robust Supervised Classifiers via Web-Scale N-Gram Data

  2010cited by this paper
• IRSTLM: an open source toolkit for handling large scale language models

  2008cited by this paper
• Moses: Open Source Toolkit for Statistical Machine Translation

  2007influential reference
• Factored Translation Models

  2007cited by this paper
• Forest Rescoring: Faster Decoding with Integrated Language Models

  2007cited by this paper
• Large Language Models in Machine Translation

  2007cited by this paper
• Europarl: A Parallel Corpus for Statistical Machine Translation

  2005influential reference
• Minimum Bayes-Risk Decoding for Statistical Machine Translation

  2004cited by this paper
• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002influential reference
• An Empirical Study of Smoothing Techniques for Language Modeling

  1996cited by this paper
• Improved backing-off for M-gram language modeling

  1995cited by this paper

• Advancements and challenges in natural language processing: a comprehensive analysis of algorithms, models, and performance metrics

  2025cites this paper
• Chitrarth: Bridging Vision and Language for a Billion People

  2025cites this paper
• Krutrim LLM: Multilingual Foundational Model for over a Billion People

  2025cites this paper
• The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models

  2025cites this paper
• Allocation of Parameters in Transformers

  2025cites this paper
• Model interpretability enhances domain generalization in the case of textual complexity modeling

  2025cites this paper
• Review of current and potential uses of large language models in engineering

  2025cites this paper
• Comparative Assessment of Large Language Models for Microbial Phenotype Annotation

  2025cites this paper
• A Temporal Knowledge Graph Generation Dataset Supervised Distantly by Large Language Models

  2025cites this paper
• 5G INSTRUCT Forge: An Advanced Data Engineering Pipeline for Making LLMs Learn 5G

  2025cites this paper
• Chitranuvad: Adapting Multi-lingual LLMs for Multimodal Translation

  2025cites this paper
• An adaptive confidence-based data revision framework for Document-level Relation Extraction

  2025cites this paper
• Document-level Translation with LLM Reranking: Team-J at WMT 2024 General Translation Task

  2024influential citation
• Correlation and Navigation in the Vocabulary Key Representation Space of Language Models

  2024cites this paper
• A Framework to Construct Financial Causality Knowledge Graph from Text

  2024cites this paper
• A Review of the Challenges with Massive Web-mined Corpora Used in Large Language Models Pre-Training

  2024cites this paper
• gaHealth: An English–Irish Bilingual Corpus of Health Data

  2024cites this paper
• Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics

  2024cites this paper
• Comparison of Common Crawl News & GDELT

  2024cites this paper
• Linguistic Structure from a Bottleneck on Sequential Information Processing

  2024cites this paper
• IGOT: Information Gain Optimized Tokenizer on Domain Adaptive Pretraining

  2024cites this paper
• Building a Large Japanese Web Corpus for Large Language Models

  2024cites this paper
• PagPassGPT: Pattern Guided Password Guessing via Generative Pretrained Transformer

  2024cites this paper
• Machine translation and its evaluation: a study

  2023cites this paper
• A Large and Diverse Arabic Corpus for Language Modeling

  2023cites this paper
• Dialog Generation with Conversational Agent in Task-Oriented Context using a Transformer Architecture

  2023cites this paper
• Artificially Intelligent Billing in Spine Surgery: An Analysis of a Large Language Model

  2023cites this paper
• NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation

  2023cites this paper
• Method for Individuals’ Speech Popularity Assessment Based on the National Terminological Information System

  2023cites this paper
• The perils and promises of fact-checking with large language models

  2023cites this paper
• MahaEmoSen: Towards Emotion-aware Multimodal Marathi Sentiment Analysis

  2023cites this paper
• Evaluating Biased Attitude Associations of Language Models in an Intersectional Context

  2023cites this paper
• StarCoder: may the source be with you!

  2023cites this paper
• LLaMA: Open and Efficient Foundation Language Models

  2023cites this paper
• Leveraging supplementary text data to kick-start automatic speech recognition system development with limited transcriptions

  2023influential citation
• Bilingual attention based neural machine translation

  2022cites this paper
• A Large and Diverse Arabic Corpus for Language Modeling

  2022cites this paper
• Machine Translation of Vedic Sanskrit using Deep Learning Algorithm

  2022influential citation
• Revisiting DocRED - Addressing the False Negative Problem in Relation Extraction

  2022cites this paper
• AfroLID: A Neural Language Identification Tool for African Languages

  2022cites this paper
• An Automatic Speech Recognition System for Bengali Language based on Wav2Vec2 and Transfer Learning

  2022cites this paper
• A Format-Aware Reducer for Scriptable Rewriting of PDF Files

  2022cites this paper
• Comparison of text preprocessing methods

  2022cites this paper
• Revisiting DocRED - Addressing the Overlooked False Negative Problem in Relation Extraction

  2022cites this paper
• Emerging trends: General fine-tuning (gft)

  2022cites this paper
• Q-Learning Scheduler for Multi Task Learning Through the use of Histogram of Task Uncertainty

  2022influential citation
• Using Natural Language Processing Techniques to Improve Manual Test Case Descriptions

  2022cites this paper
• ALX: Large Scale Matrix Factorization on TPUs

  2021cites this paper
• Deciphering Speech: a Zero-Resource Approach to Cross-Lingual Transfer in ASR

  2021cites this paper
• Recent advances of low-resource neural machine translation

  2021influential citation
• Emerging trends: A gentle introduction to fine-tuning

  2021cites this paper
• Self-Supervised Representation Learning: Introduction, advances, and challenges

  2021cites this paper
• Sparse Distillation: Speeding Up Text Classification by Using Bigger Models

  2021cites this paper
• Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

  2021cites this paper
• An empirical evaluation of text representation schemes to filter the social media stream

  2021cites this paper
• Self–other moral bias: Evidence from implicit measures and the Word-Embedding Association Test

  2021cites this paper
• Trafilatura: A Web Scraping Library and Command-Line Tool for Text Discovery and Extraction

  2021cites this paper
• Survey of Low-Resource Machine Translation

  2021cites this paper
• Parallel feature weight decay algorithms for fast development of machine translation models

  2021influential citation
• CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision

  2021cites this paper
• Putting words into the system’s mouth: A targeted attack on neural machine translation using monolingual data poisoning

  2021cites this paper
• SwissDial: Parallel Multidialectal Corpus of Spoken Swiss German

  2021cites this paper
• DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledge

  2021cites this paper
• Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models

  2021cites this paper
• Analiza modela sustava za automatsko statističko strojno prevođenje

  2021cites this paper
• On Finding Similar Verses from the Holy Quran using Word Embeddings

  2020cites this paper
• A Call for More Rigor in Unsupervised Cross-lingual Learning

  2020cites this paper
• Neural Machine Translation with Deep Attention

  2020influential citation
• Dissociable electrophysiological measures of natural language processing reveal differences in speech comprehension strategy in healthy ageing

  2020cites this paper
• ASR for Non-standardised Languages with Dialectal Variation: the case of Swiss German

  2020cites this paper
• CHAPTER 3 N-gram Language Models

  2020cites this paper
• Co-existence of prediction and error signals in electrophysiological responses to natural speech

  2020cites this paper
• iNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages

  2020cites this paper
• Evaluating Word Embeddings on Low-Resource Languages

  2020cites this paper
• Automatic Speech Recognition for ILSE-Interviews: Longitudinal Conversational Speech Recordings Covering Aging and Cognitive Decline

  2020cites this paper
• Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus

  2020cites this paper
• COD3S: Diverse Generation with Discrete Semantic Signatures

  2020cites this paper
• Guided Generation of Cause and Effect

  2020influential citation
• What determines the order of adjectives in English? Comparing efficiency-based theories using dependency treebanks

  2020cites this paper
• Neural Machine Translation With GRU-Gated Attention Model

  2020influential citation
• ParaCrawl: Web-Scale Acquisition of Parallel Corpora

  2020cites this paper
• Harbsafe-162. A Domain-Specific Data Set for the Intrinsic Evaluation of Semantic Representations for Terminological Data

  2020cites this paper
• No Data to Crawl? Monolingual Corpus Creation from PDF Files of Truly low-Resource Languages in Peru

  2020cites this paper
• A Comprehensive Survey of Grammar Error Correction

  2020cites this paper
• AI4Bharat-IndicNLP Corpus: Monolingual Corpora and Word Embeddings for Indic Languages

  2020cites this paper
• Translation Artifacts in Cross-lingual Transfer Learning

  2020cites this paper
• CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data

  2019cites this paper
• Two New Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English

  2019cites this paper
• Automatic annotation of error types for grammatical error correction

  2019cites this paper
• Optimizing Social Media Data Using Genetic Algorithm

  2019cites this paper
• KiloGrams: Very Large N-Grams for Malware Classification

  2019cites this paper
• Collecting domain specific data for MT: an evaluation of the ParaCrawlpipeline

  2019cites this paper
• The Source-Target Domain Mismatch Problem in Machine Translation

  2019cites this paper
• Facebook AI’s WAT19 Myanmar-English Translation Task Submission

  2019cites this paper
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

  2019cites this paper
• Syntactic dependencies correspond to word pairs with high mutual information

  2019cites this paper
• Generalizing Question Answering System with Pre-trained Language Model Fine-tuning

  2019cites this paper
• A Massive Collection of Cross-Lingual Web-Document Pairs

  2019cites this paper
• Assessing the Impact of Contextual Embeddings for Portuguese Named Entity Recognition

  2019influential citation
• FlauBERT: Unsupervised Language Model Pre-training for French

  2019cites this paper