Luke Zettlemoyer

PROFILE

Homepage
No homepage is listed.
ORCID
No ORCID is listed.
Affiliations
University of Washington, Facebook
Aliases
L. S. Zettlemoyer, Luke S. Zettlemoyer
Publication record
276 papers · 129,032 citations · H-index 116

PAPERS

Olmo 3
20250 citationsauthor #63
Representation Deficiency in Masked Language Modeling
202311 citationsauthor #9
Getting MoRE out of Mixture of Language Model Reasoning Experts
202347 citationsauthor #4
Scaling Expert Language Models with Unsupervised Domain Discovery
202361 citationsauthor #7
ART: Automatic multi-step reasoning and tool-use for large language models
2023199 citationsauthor #5
Stable and low-precision training for large-scale vision-language models
202374 citationsauthor #3
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
2023152 citationsauthor #5
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
2023315 citationsauthor #5
Revisiting Machine Translation for Cross-lingual Classification
202350 citationsauthor #5
Retrieval-Augmented Multimodal Language Modeling
2023145 citationsauthor #8
Self-Alignment with Instruction Backtranslation
2023169 citationsauthor #5
The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages
20234 citationsauthor #8
CiT: Curation in Training for Effective Vision-Language Data
202331 citationsauthor #7
Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation
202399 citationsauthor #3
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
2023259 citationsauthor #9
Toolformer: Language Models Can Teach Themselves to Use Tools
20233,089 citationsauthor #6
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
2023106 citationsauthor #7
REPLUG: Retrieval-Augmented Black-Box Language Models
2023905 citationsauthor #7
QLoRA: Efficient Finetuning of Quantized LLMs
20234,021 citationsauthor #4
Scaling Laws for Generative Mixed-Modal Language Models
2023142 citationsauthor #10
Translate to Disambiguate: Zero-shot Multilingual Word Sense Disambiguation with Pretrained Language Models
20233 citationsauthor #3
Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning
2023168 citationsauthor #26
Shepherd: A Critic for Language Model Generation
2023106 citationsauthor #8
LIMA: Less Is More for Alignment
20231,186 citationsauthor #14
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
20231,110 citationsauthor #8
SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore
202390 citationsauthor #6
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning
20230 citationsauthor #5
Generative Models as a Complex Systems Science: How can we make sense of large language model behavior?
202320 citationsauthor #3
Language Contamination Helps Explains the Cross-lingual Capabilities of English Pretrained Models
2022107 citationsauthor #2
RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering
202228 citationsauthor #4
Questions Are All You Need to Train a Dense Passage Retriever
202269 citationsauthor #4
Few-shot Mining of Naturally Occurring Inputs and Outputs
20221 citationsauthor #5
M2D2: A Massively Multi-Domain Language Modeling Dataset
202224 citationsauthor #4
Nonparametric Masked Language Modeling
202255 citationsauthor #7
Improving Passage Retrieval with Zero-Shot Question Generation
2022222 citationsauthor #7
Training Trajectories of Language Models Across Scales
202272 citationsauthor #7
Selective Annotation Makes Language Models Better Few-Shot Learners
2022309 citationsauthor #9
AGRO: Adversarial Discovery of Error-prone groups for Robust Optimization
20229 citationsauthor #4
Efficient Large Scale Language Modeling with Mixtures of Experts
20225 citationsauthor #17
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
2022899 citationsauthor #4
OPT: Open Pre-trained Transformer Language Models
20224,559 citationsauthor #19
Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models
2022185 citationsauthor #7
CREPE: Open-Domain Question Answering with False Presuppositions
202270 citationsauthor #3
InCoder: A Generative Model for Code Infilling and Synthesis
2022828 citationsauthor #9
Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection
202296 citationsauthor #7
GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale
2022753 citationsauthor #4
In-context Examples Selection for Machine Translation
2022240 citationsauthor #4
Demystifying Prompts in Language Models via Perplexity Estimation
2022286 citationsauthor #5
Contrastive Decoding: Open-ended Text Generation as Optimization
2022555 citationsauthor #7
Stop: A Dataset for Spoken Task Oriented Semantic Parsing
202241 citationsauthor #14
Logical Satisfiability of Counterfactuals for Faithful Explanations in NLI
202217 citationsauthor #5
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters
2022350 citationsauthor #6
Improving Policy Learning via Language Dynamics Distillation
202216 citationsauthor #3
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning
2022221 citationsauthor #5
Nearest Neighbor Zero-Shot Inference
202241 citationsauthor #4
Bayesian Deep Learning for Interactive Community Question Answering
20220 citationsauthor #1
On the Role of Bidirectionality in Language Model Pre-Training
202221 citationsauthor #4
One Embedder, Any Task: Instruction-Finetuned Text Embeddings
2022421 citationsauthor #9
The case for 4-bit precision: k-bit Inference Scaling Laws
2022304 citationsauthor #2
Language Contamination Explains the Cross-lingual Capabilities of English Pretrained Models
202213 citationsauthor #2
DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation
2022474 citationsauthor #6
CM3: A Causal Masked Multimodal Model of the Internet
2022172 citationsauthor #11
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models
202238 citationsauthor #3
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?
202258 citationsauthor #6
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
20221,887 citationsauthor #7
Mega: Moving Average Equipped Gated Attention
2022226 citationsauthor #8
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
2022251 citationsauthor #3
Prompting Language Models for Linguistic Structure
202255 citationsauthor #3
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation
202234 citationsauthor #4
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models
2022345 citationsauthor #22
LegoNN: Building Modular Encoder-Decoder Models
202216 citationsauthor #7
Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations
202281 citationsauthor #4
Natural Language to Code Translation with Execution
2022159 citationsauthor #4
Prompt-free and Efficient Few-shot Learning with Language Models
202276 citationsauthor #2
Language Grounding with 3D Objects
202155 citationsauthor #5
Few-shot Learning with Multilingual Generative Language Models
2021365 citationsauthor #17
Efficient Large Scale Language Modeling with Mixtures of Experts
2021233 citationsauthor #21
Muppet: Massive Multi-task Representations with Pre-Finetuning
2021292 citationsauthor #5
Quantifying Adaptability in Pre-trained Language Models with 500 Tasks
202118 citationsauthor #4
Few-shot Learning with Multilingual Language Models
2021270 citationsauthor #17
Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment
202135 citationsauthor #2
Learning Better Structured Representations Using Low-rank Adaptive Label Smoothing
202116 citationsauthor #4
Inducing Semantic Roles Without Syntax
20214 citationsauthor #2
FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionary
202125 citationsauthor #3
BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translation
20215 citationsauthor #3
Luna: Linear Unified Nested Attention
2021135 citationsauthor #7
8-bit Optimizers via Block-wise Quantization
2021428 citationsauthor #4
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding
2021150 citationsauthor #8
SILG: The Multi-domain Symbolic Interactive Language Grounding Benchmark
202123 citationsauthor #5
SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmark
202114 citationsauthor #5
MetaICL: Learning to Learn In Context
2021584 citationsauthor #3
HTLM: Hyper-Text Pre-Training and Prompting of Language Models
202181 citationsauthor #7
Noisy Channel Language Model Prompting for Few-Shot Text Classification
2021236 citationsauthor #4
DeLighT: Deep and Light-weight Transformer
202196 citationsauthor #4
BASE Layers: Simplifying Training of Large, Sparse Models
2021361 citationsauthor #5
Surface Form Competition: Why the Highest Probability Answer Isn’t Always Right
2021275 citationsauthor #5
DESCGEN: A Distantly Supervised Datasetfor Generating Entity Descriptions
20214 citationsauthor #3
Prompting Contrastive Explanations for Commonsense Reasoning Tasks
202174 citationsauthor #4
FaVIQ: FAct Verification from Information-seeking Questions
202145 citationsauthor #4
DEMix Layers: Disentangling Domains for Modular Language Modeling
2021168 citationsauthor #5

TIMELINE

1998 110 citations

1999 280 citations

2000 74 citations

2001 31 citations

2004 89 citations

2005 1,076 citations

2007 779 citations

2008 196 citations

2009 538 citations

2010 464 citations

2011 1,438 citations

2012 1,050 citations

2013 1,672 citations

2014 1,191 citations

2015 844 citations

2016 1,526 citations

2017 6,503 citations

2018 17,619 citations

2019 57,841 citations

2020 5,054 citations

2021 4,114 citations

2022 14,689 citations

2023 12,562 citations

2025 0 citations

Luke Zettlemoyer

PROFILE

PAPERS

TIMELINE

COAUTHOR MAP

CONCEPT FOOTPRINT