Transformers in Natural Language Processing

No abstract is available for this paper.

• Publication year

  2021

• Venue

  International Conference on Advances in Computing and Artificial Intelligence

• Publication date

  Unknown publication date

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.1007/978-3-031-24349-3_6
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Spanish Pre-trained BERT Model and Evaluation Data

  2023cited by this paper
• Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

  2021cited by this paper
• A Survey on Document-level Neural Machine Translation

  2021cited by this paper
• On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜

  2021cited by this paper
• wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations

  2020cited by this paper
• Conformer: Convolution-augmented Transformer for Speech Recognition

  2020cited by this paper
• A Formal Hierarchy of RNN Architectures

  2020cited by this paper
• NukeBERT: A Pre-trained language model for Low Resource Nuclear Domain

  2020cited by this paper
• A Primer in BERTology: What We Know About How BERT Works

  2020cited by this paper
• Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning

  2020cited by this paper
• Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data

  2020cited by this paper
• Scaling Laws for Neural Language Models

  2020cited by this paper
• Patent classification by fine-tuning BERT language model

  2020cited by this paper
• ImageBERT: Cross-modal Pre-training with Large-scale Weak-supervised Image-Text Data

  2020cited by this paper
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

  2020cited by this paper
• Beyond English-Centric Multilingual Machine Translation

  2020cited by this paper
• German’s Next Language Model

  2020cited by this paper
• Knowledge Enhanced Contextual Word Representations

  2019cited by this paper
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  2019cited by this paper
• Cross-lingual Language Model Pretraining

  2019cited by this paper
• BioBERT: a pre-trained biomedical language representation model for biomedical text mining

  2019cited by this paper
• Massively Multilingual Neural Machine Translation

  2019cited by this paper
• VideoBERT: A Joint Model for Video and Language Representation Learning

  2019cited by this paper
• Language Models are Unsupervised Multitask Learners

  2019influential reference
• Energy and Policy Considerations for Deep Learning in NLP

  2019cited by this paper
• COMET: Commonsense Transformers for Automatic Knowledge Graph Construction

  2019cited by this paper
• Cross-Lingual Word Embeddings

  2019cited by this paper
• RoBERTa: A Robustly Optimized BERT Pretraining Approach

  2019cited by this paper
• ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks

  2019cited by this paper
• Language Models as Knowledge Bases?

  2019cited by this paper
• SciBERT: A Pretrained Language Model for Scientific Text

  2019cited by this paper
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

  2019cited by this paper
• BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

  2019cited by this paper
• CamemBERT: a Tasty French Language Model

  2019influential reference
• FlauBERT: Unsupervised Language Model Pre-training for French

  2019cited by this paper
• BERTje: A Dutch BERT Model

  2019cited by this paper
• ZeRO: Memory optimizations Toward Training Trillion Parameter Models

  2019cited by this paper
• Deep Contextualized Word Representations

  2018cited by this paper
• Speech-Transformer: A No-Recurrence Sequence-to-Sequence Model for Speech Recognition

  2018cited by this paper
• Generating Wikipedia by Summarizing Long Sequences

  2018cited by this paper
• Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates

  2018cited by this paper
• Attention is All you Need

  2017influential reference
• Non-Autoregressive Neural Machine Translation

  2017cited by this paper
• Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation

  2016cited by this paper
• Toward Multilingual Neural Machine Translation with Universal Encoder and Decoder

  2016cited by this paper
• Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism

  2016cited by this paper
• Translate : A Proof of Concept for End-to-End Speech-to-Text Translation

  2016cited by this paper
• Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies

  2016cited by this paper
• Enriching Word Vectors with Subword Information

  2016cited by this paper
• Neural Machine Translation of Rare Words with Subword Units

  2015cited by this paper
• Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation

  2014cited by this paper
• On the Properties of Neural Machine Translation: Encoder–Decoder Approaches

  2014cited by this paper
• Neural Machine Translation by Jointly Learning to Align and Translate

  2014cited by this paper
• Efficient Estimation of Word Representations in Vector Space

  2013cited by this paper
• Parallel Data, Tools and Interfaces in OPUS

  2012cited by this paper
• Natural Language Processing (Almost) from Scratch

  2011cited by this paper
• Structured Output Layer neural network language model

  2011cited by this paper
• Recurrent neural network based language model

  2010cited by this paper
• Continuous space language models

  2007cited by this paper
• Foundations of Statistical Natural Language Processing

  2001cited by this paper
• Two decades of statistical language modeling: where do we go from here?

  2000cited by this paper
• Long Short-Term Memory

  1997cited by this paper
• Statistical methods for speech recognition

  1997cited by this paper
• Language modeling by variable length sequences: theoretical formulation and evaluation of multigrams

  1995cited by this paper
• Statistical language learning

  1995cited by this paper
• A new algorithm for data compression

  1994cited by this paper
• Speech and Language Processing

  1990cited by this paper
• Finding Structure in Time

  1990cited by this paper
• Natural-Language Processing

  1982cited by this paper
• Interpolated estimation of Markov source parameters from sparse data

  1980cited by this paper

• Uncovering Hierarchical Structure in LLM Embeddings with δ-Hyperbolicity, Ultrametricity, and Neighbor Joining

  2025cites this paper
• Transformer-Based Approach to Optimal Sensor Placement for Structural Health Monitoring of Probe Cards

  2025cites this paper
• OmniEval: A Benchmark for Evaluating Omni-modal Models with Visual, Auditory, and Textual Inputs

  2025cites this paper
• Making sense of transformer success

  2025cites this paper
• ML-Based Virtual Sensing for Groundwater Monitoring in the Netherlands

  2025cites this paper
• Sentiment Analysis of Machine Learning Algorithms: A Transformer-Based Approach

  2024cites this paper
• No Argument Left Behind: Overlapping Chunks for Faster Processing of Arbitrarily Long Legal Texts

  2024cites this paper
• Hierarchical mixtures of Unigram models for short text clustering: the role of Beta-Liouville priors

  2024cites this paper
• Sentiment Analysis of Machine Learning Algorithms: A Transformer-Based Approach

  2024cites this paper
• Can AI Read the Minds of Corporate Executives?

  2023cites this paper
• Komparasi Algoritma Random Forest, Naïve Bayes, dan Bert Untuk Multi-Class Classification Pada Artikel Cable News Network (CNN)

  2023cites this paper
• Transformer-Based Parking Slot Detection Using Fixed Anchor Points

  2023cites this paper
• Automatic Question Generation Using Natural Language Processing and Transformers

  2023influential citation
• Character Chatbot - A Conversational AI Chatbot which can alter its Character according to User Specifications

  2021cites this paper
• The Contrastive Tension Method and Corpus Variety

  2021cites this paper
• INTERNATIONAL JOURNAL OF MULTIDISCIPLINARY RESEARCH

  year unknowncites this paper