Aligning Packed Dependency Trees: A Theory of Composition for Distributional Semantics

We present a new framework for compositional distributional semantics in which the distributional contexts of lexemes are expressed in terms of anchored packed dependency trees. We show that these structures have the potential to capture the full sentential contexts of a lexeme and provide a uniform basis for the composition of distributional knowledge in a way that captures both mutual disambiguation and generalization.

• Publication year

  2016

• Venue

  International Conference on Computational Logic

• Publication date

  2016-08-25

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.1162/COLI_a_00265arXiv 1608.07115
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Computational Linguistics: 16th International Conference of the Pacific Association for Computational Linguistics, PACLING 2019, Hanoi, Vietnam, October 11–13, 2019, Revised Selected Papers

  2019cited by this paper
• Improving Distributional Similarity with Lessons Learned from Word Embeddings

  2015cited by this paper
• A Systematic Study of Semantic Vector Space Model Parameters

  2014cited by this paper
• Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

  2014cited by this paper
• Improving Multi-Modal Representations Using Image Dispersion: Why Less is Sometimes More

  2014cited by this paper
• GloVe: Global Vectors for Word Representation

  2014cited by this paper
• Neural Word Embedding as Implicit Matrix Factorization

  2014cited by this paper
• Semantic Parsing via Paraphrasing

  2014cited by this paper
• Distributional Composition using Higher-Order Dependency Vectors

  2014cited by this paper
• Don’t count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors

  2014cited by this paper
• SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation

  2014cited by this paper
• Distributed Representations of Words and Phrases and their Compositionality

  2013influential reference
• Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank

  2013cited by this paper
• Multimodal Distributional Semantics

  2013cited by this paper
• Combined Distributional and Logical Semantics

  2013cited by this paper
• Efficient Estimation of Word Representations in Vector Space

  2013influential reference
• General estimation and evaluation of compositional distributional semantic models

  2013cited by this paper
• Linguistic Regularities in Continuous Space Word Representations

  2013influential reference
• Multi-Step Regression Learning for Compositional Distributional Semantics

  2013influential reference
• The Role of Syntax in Vector Space Models of Compositional Semantics

  2013cited by this paper
• Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

  2013cited by this paper
• Saarland: Vector-based models of semantic textual similarity

  2012cited by this paper
• *SEM 2012: The First Joint Conference on Lexical and Computational Semantics

  2012cited by this paper
• Vector Space Models of Word Meaning and Phrase Meaning: A Survey

  2012cited by this paper
• Domain and Function: A Dual-Space Model of Semantic Relations and Compositions

  2012cited by this paper
• Semantic Compositionality through Recursive Matrix-Vector Spaces

  2012cited by this paper
• A Challenge Set for Advancing Language Modeling

  2012cited by this paper
• A Comparison of Vector-based Representations for Semantic Composition

  2012cited by this paper
• Dynamic Pooling and Unfolding Recursive Autoencoders for Paraphrase Detection

  2011cited by this paper
• Word Meaning in Context: A Simple and Effective Vector Model

  2011cited by this paper
• A Context-Theoretic Framework for Compositionality in Distributional Semantics

  2011cited by this paper
• Integrating Logical Representations with Probabilistic Information using Markov Logic

  2011cited by this paper
• Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions

  2011cited by this paper
• Latent Vector Weighting for Word Meaning in Context

  2011cited by this paper
• A Regression Model of Adjective-Noun Compositionality in Distributional Semantics

  2010cited by this paper
• Nouns are Vectors, Adjectives are Matrices: Representing Adjective-Noun Constructions in Semantic Space

  2010cited by this paper
• Mathematical Foundations for a Compositional Distributional Model of Meaning

  2010cited by this paper
• Contextualizing Semantic Representations Using Syntactically Enriched Vector Models

  2010influential reference
• From Frequency to Meaning: Vector Space Models of Semantics

  2010cited by this paper
• Composition in Distributional Models of Semantics

  2010influential reference
• Distributional Memory: A General Framework for Corpus-Based Semantics

  2010influential reference
• Ranking Paraphrases in Context

  2009cited by this paper
• A Structured Vector Space Model for Word Meaning in Context

  2008cited by this paper
• Vector-based Models of Semantic Composition

  2008cited by this paper
• A unified architecture for natural language processing: deep neural networks with multitask learning

  2008cited by this paper
• Introducing, evaluating ukWaC, a very large web-derived corpus of English

  2008cited by this paper
• SemEval-2007 Task 10: English Lexical Substitution Task

  2007cited by this paper
• Dependency-Based Construction of Semantic Space Models

  2007cited by this paper
• Co-occurrence Retrieval: A Flexible Framework for Lexical Distributional Similarity

  2005cited by this paper
• Characterising Measures of Lexical Distributional Similarity

  2004cited by this paper
• Incrementality in Deterministic Dependency Parsing

  2004cited by this paper
• From distributional to semantic similarity

  2004cited by this paper
• Measures and applications of lexical distributional similarity

  2003cited by this paper
• Placing search in context: the concept revisited

  2002influential reference
• Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics

  1999cited by this paper
• Measures of Distributional Similarity

  1999cited by this paper
• Automatic Retrieval and Clustering of Similar Words

  1998cited by this paper
• Automatic Word Sense Discrimination

  1998cited by this paper
• An Information-Theoretic Definition of Similarity

  1998cited by this paper
• Type Grammar Revisited

  1997cited by this paper
• Producing high-dimensional semantic spaces from lexical co-occurrence

  1996cited by this paper
• Similarity-Based Estimation of Word Cooccurrence Probabilities

  1994cited by this paper
• Syntactic Processing

  1979influential reference
• ENGLISH AS A FORMAL LANGUAGE

  1975cited by this paper

• Hybrid embeddings for transition-based dependency parsing of free word order languages

  2023cites this paper
• Contextualized word senses: from attention to compositionality

  2023cites this paper
• Montague semantics and modifier consistency measurement in neural language models

  2022cites this paper
• Evaluating Contextualized Vectors from both Large Language Models and Compositional Strategies

  2022cites this paper
• Representing Syntax and Composition with Geometric Transformations

  2021influential citation
• Compositional Distributional Semantics with Syntactic Dependencies and Selectional Preferences

  2021cites this paper
• Learning Clause Representation from Dependency-Anchor Graph for Connective Prediction

  2021cites this paper
• A comprehensive analysis of the parameters in the creation and comparison of feature vectors in distributional semantic models for multiple languages

  2020cites this paper
• What are the Goals of Distributional Semantics?

  2020cites this paper
• A Graph-Based Framework for Structured Prediction Tasks in Sanskrit

  2020cites this paper
• Towards syntax-aware token embeddings

  2020cites this paper
• Synonym Knowledge Enhanced Reader for Chinese Idiom Reading Comprehension

  2020influential citation
• Sememe Knowledge Representation

  2020cites this paper
• Towards the Automatic Construction of a Multilingual Dictionary of Collocations using Distributional Semantics

  2019cites this paper
• Temporal and Aspectual Entailment

  2019cites this paper
• Modeling Semantic Compositionality with Sememe Knowledge

  2019cites this paper
• Unsupervised Compositional Translation of Multiword Expressions

  2019cites this paper
• The Rationality of Semantic Change

  2019cites this paper
• Weighted Compositional Vectors for Translating Collocations Using Monolingual Corpora

  2019cites this paper
• A dependency-based approach to word contextualization using compositional distributional semantics

  2019influential citation
• From lexical towards contextualized meaning representation

  2019cites this paper
• Contextualized Translations of Phrasal Verbs with Distributional Compositional Semantics and Monolingual Corpora

  2019cites this paper
• One Representation per Word - Does it make Sense for Composition?

  2017cites this paper
• The Lifted Matrix-Space Model for Semantic Composition

  2017cites this paper
• Sense Contextualization in a Dependency-Based Compositional Distributional Model

  2017cites this paper
• When a Red Herring in Not a Red Herring: Using Compositional Methods to Detect Non-Compositional Phrases

  2017influential citation
• Improving Semantic Composition with Offset Inference

  2017cites this paper
• Improving Sparse Word Representations with Distributional Inference for Semantic Composition

  2016cites this paper