SemEval-2007 Task 10: English Lexical Substitution Task

In this paper we describe the English Lexical Substitution task for SemEval. In the task, annotators and systems find an alternative substitute word or phrase for a target word in context. The task involves both finding the synonyms and disambiguating the context. Participating systems are free to use any lexical resource. There is a subtask which requires identifying cases where the word is functioning as part of a multiword in the sentence and detecting what that multiword is.

• Publication year

  2007

• Venue

  International Workshop on Semantic Evaluation

• Publication date

  2007-06-23

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.3115/1621474.1621483
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Making Sense About Sense

  2007cited by this paper
• Direct Word Sense Matching for Lexical Substitution

  2006cited by this paper
• Open-source Corpora: Using the net to fish for linguistic data

  2006cited by this paper
• How Dominant Is the Commonest Sense of a Word?

  2004cited by this paper
• Lexical Substitution as a Task for WSD Evaluation

  2002cited by this paper
• Measures of Distributional Similarity

  1999cited by this paper
• An Information-Theoretic Definition of Similarity

  1998cited by this paper
• A Semantic Concordance

  1993influential reference
• 100 million words of English

  1993cited by this paper
• 100 Million Words of English:The British National Corpus (BNC)

  1992influential reference
• Introduction to WordNet: An On-line Lexical Database

  1990cited by this paper

• Lessons from the TREC Plain Language Adaptation of Biomedical Abstracts (PLABA) track.

  2026cites this paper
• Learning to Substitute Words with Model-based Score Ranking

  2025cites this paper
• CALE : Concept-Aligned Embeddings for Both Within-Lemma and Inter-Lemma Sense Differentiation

  2025cites this paper
• Unsupervised Candidate Ranking for Lexical Substitution via Holistic Sentence Semantics

  2025cites this paper
• Reversible source-aware natural language watermarking via customized lexical substitution

  2025cites this paper
• Lexical Substitution is not Synonym Substitution: On the Importance of Producing Contextually Relevant Word Substitutes

  2025cites this paper
• Inferring Adjective Hypernyms with Language Models to Increase the Connectivity of Open English Wordnet

  2025cites this paper
• ChiKhaPo: A Large-Scale Multilingual Benchmark for Evaluating Lexical Comprehension and Generation in Large Language Models

  2025cites this paper
• The Sanskrit Sembank

  2025influential citation
• Innovative Approaches to Sentence Rephrasing in Natural Language Processing

  2025cites this paper
• Sense through time: diachronic word sense annotations for word sense induction and Lexical Semantic Change Detection

  2024cites this paper
• Arabic Lexical Substitution: AraLexSubD Dataset and AraLexSub Pipeline

  2024cites this paper
• ReMark: Reversible Lexical Substitution-Based Text Watermarking

  2024cites this paper
• Multilingual Substitution-based Word Sense Induction

  2024cites this paper
• BATS: BenchmArking Text Simplicity 🦇

  2024cites this paper
• Lexical Substitution as Causal Language Modeling

  2024cites this paper
• ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution

  2024influential citation
• MultiLS: A Multi-task Lexical Simplification Framework

  2024influential citation
• Towards Content Accessibility Through Lexical Simplification for Maltese as a Low-Resource Language

  2024cites this paper
• Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing

  2024cites this paper
• TMU-HIT at MLSP 2024: How Well Can GPT-4 Tackle Multilingual Lexical Simplification?

  2024cites this paper
• MultiLS: An End-to-End Lexical Simplification Framework

  2024cites this paper
• Finding Educationally Supportive Contexts for Vocabulary Learning with Attention-Based Models

  2024cites this paper
• Neuro-Symbolic Sentiment Analysis with Dynamic Word Sense Disambiguation

  2023cites this paper
• A Context-based Image Retrieval Method for Persian Databases

  2023cites this paper
• Word sense extension

  2023cites this paper
• Grounding the Lexical Substitution Task in Entailment

  2023influential citation
• Chinese Lexical Substitution: Dataset and Method

  2023cites this paper
• Natural language watermarking via paraphraser-based lexical substitution

  2023cites this paper
• Deep learning approaches to lexical simplification: A survey

  2023cites this paper
• Smart Word Suggestions for Writing Assistance

  2023influential citation
• Taxonomy of Problems in Lexical Semantics

  2023cites this paper
• ParaLS: Lexical Substitution via Pretrained Paraphraser

  2023influential citation
• Generation of Replacement Options in Text Sanitization

  2023cites this paper
• CILS at TSAR-2022 Shared Task: Investigating the Applicability of Lexical Substitution Methods for Lexical Simplification

  2022cites this paper
• Interactive Machine Learning for Image Captioning

  2022cites this paper
• An Attention-Based Model for Predicting Contextual Informativeness and Curriculum Learning Applications

  2022cites this paper
• Neural Data-to-Text Generation Based on Small Datasets: Comparing the Added Value of Two Semi-Supervised Learning Approaches on Top of a Large Language Model

  2022cites this paper
• Improving open domain content generation by text mining and alignment

  2022cites this paper
• Design of language assisted learning model and online learning system under the background of artificial intelligence

  2022cites this paper
• A Hybrid Method for Automatic Simplification of Japanese Sentence Patterns Based on Morphological Analysis and Grammatical Rules

  2022cites this paper
• CILex: An Investigation of Context Information for Lexical Substitution Methods

  2022cites this paper
• From Word Types to Tokens and Back: A Survey of Approaches to Word Meaning Representation and Interpretation

  2022cites this paper
• Improving Contextual Representation with Gloss Regularized Pre-training

  2022influential citation
• Language Models as Context-sensitive Word Search Engines

  2022cites this paper
• Unsupervised Lexical Substitution with Decontextualised Embeddings

  2022cites this paper
• Combination of Contextualized and Non-Contextualized Layers for Lexical Substitution in French

  2022cites this paper
• Word Embeddings: What Works, What Doesn’t, and How to Tell the Difference for Applied Research

  2021cites this paper
• LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitution

  2021influential citation
• eScholarship@UMassChan eScholarship@UMassChan

  2021cites this paper
• Tracing Text Provenance via Context-Aware Lexical Substitution

  2021cites this paper
• Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality

  2021influential citation
• SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation (MCL-WiC)

  2021cites this paper
• Assessing the Representations of Idiomaticity in Vector Models with a Noun Compound Dataset Labeled at Type and Token Levels

  2021cites this paper
• ALaSca: an Automated approach for Large-Scale Lexical Substitution

  2021cites this paper
• Automated Text Simplification

  2021cites this paper
• Let’s Play Mono-Poly: BERT Can Reveal Words’ Polysemy Level and Partitionability into Senses

  2021cites this paper
• GeneSis: A Generative Approach to Substitutes in Context

  2021cites this paper
• Discovering and analysing lexical variation in social media text

  2020cites this paper
• A Dataset for the Evaluation of Lexical Simplification in Portuguese for Children

  2020cites this paper
• A Neural Generative Model for Joint Learning Topics and Topic-Specific Word Embeddings

  2020cites this paper
• A New Context-Aware Method Based on Hybrid Ranking for Community-Oriented Lexical Simplification

  2020cites this paper
• Automatic Compilation of Resources for Academic Writing and Evaluating with Informal Word Identification and Paraphrasing System

  2020cites this paper
• MSL-DE: A Lexical Substitution Method based on Dictionaries and Embeddings

  2020cites this paper
• A Hybrid Model for Community-Oriented Lexical Simplification

  2020cites this paper
• MULTISEM at SemEval-2020 Task 3: Fine-tuning BERT for Lexical Meaning

  2020cites this paper
• A Comparative Study of Lexical Substitution Approaches based on Neural Language Models

  2020influential citation
• Automatic Text Simplification for People with Intellectual Disabilities

  2020cites this paper
• Challenges in Emotion Style Transfer: An Exploration with a Lexical Substitution Pipeline

  2020cites this paper
• Modeling word interpretation with deep language models: The interaction between expectations and lexical information

  2020cites this paper
• Word Replaceability Through Word Vectors

  2020cites this paper
• SenticNet 6: Ensemble Application of Symbolic and Subsymbolic AI for Sentiment Analysis

  2020cites this paper
• SocialNLP 2020 The Eighth International Workshop on Natural Language Processing for Social Media Proceedings of the Conference

  2020cites this paper
• Language Resources for Japanese Lexical Simplification

  2020cites this paper
• Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution

  2020influential citation
• CASE: Context-Aware Semantic Expansion

  2019cites this paper
• Paraphrase-Sense-Tagged Sentences

  2019cites this paper
• What a neural language model tells us about spatial relations

  2019cites this paper
• Adaptive Approaches to Natural Language Processing in Annotation and Application

  2019cites this paper
• Comparative judgments are more consistent than binary classification for labelling word complexity

  2019cites this paper
• SemEval-2019 Task 2: Unsupervised Lexical Frame Induction

  2019cites this paper
• A Comparison of Context-sensitive Models for Lexical Substitution

  2019influential citation
• BERT-based Lexical Substitution

  2019cites this paper
• Word Usage Similarity Estimation with Sentence Representations and Automatic Substitutes

  2019cites this paper
• Word Sense Disambiguation: A Seventy Year Perspective

  2019cites this paper
• Choosing the Right Word: Using Bidirectional LSTM Tagger for Writing Support Systems

  2019cites this paper
• Contextualized Multi-Sense Word Embedding

  2019cites this paper
• Chatting about data

  2019cites this paper
• Contextualized context2vec

  2019influential citation
• From Receptive to Productive: Learning to Use Confusing Words through Automatically Selected Example Sentences

  2019cites this paper
• Text Simplification without Simplified Corpora

  2018influential citation
• English Out-of-Vocabulary Lexical Evaluation Task

  2018cites this paper
• Contextualized Word Representations for Multi-Sense Embedding

  2018influential citation
• Analyzing Hypersensitive AI: Instability in Corporate-Scale Machine Learning

  2018cites this paper
• Spot the Odd Man Out: Exploring the Associative Power of Lexical Resources

  2018cites this paper
• Leveraging Lexical Substitutes for Unsupervised Word Sense Induction

  2018influential citation
• Extending the gold standard for a lexical substitution task: is it worth it?

  2018cites this paper
• Simplification Using Paraphrases and Context-Based Lexical Substitution

  2018cites this paper
• Factors Influencing the Surprising Instability of Word Embeddings

  2018cites this paper
• SenticNet 5: Discovering Conceptual Primitives for Sentiment Analysis by Means of Context Embeddings

  2018cites this paper