Noun Phrase Chunking in Hebrew: Influence of Lexical and Morphological Features

We present a method for Noun Phrase chunking in Hebrew. We show that the traditional definition of base-NPs as non-recursive noun phrases does not apply in Hebrew, and propose an alternative definition of Simple NPs. We review syntactic properties of Hebrew related to noun phrases, which indicate that the task of Hebrew SimpleNP chunking is harder than base-NP chunking in English. As a confirmation, we apply methods known to work well for English to Hebrew data. These methods give low results (F from 76 to 86) in Hebrew. We then discuss our method, which applies SVM induction over lexical and morphological features. Morphological features improve the average precision by ~0.5%, recall by ~1%, and F-measure by ~0.75, resulting in a system with average performance of 93% precision, 93.4% recall and 93.2 F-measure.

• Publication year

  2006

• Venue

  Annual Meeting of the Association for Computational Linguistics

• Publication date

  2006-07-17

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.3115/1220175.1220262
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• An Unsupervised Morpheme-Based HMM for Hebrew Morphological Disambiguation

  2006cited by this paper
• Arabic Tokenization, Part-of-Speech Tagging and Morphological Disambiguation in One Fell Swoop

  2005cited by this paper
• Automatic Tagging of Arabic Text: From Raw Text to Base Phrase Chunks

  2004influential reference
• Shallow Parsing with Conditional Random Fields

  2003cited by this paper
• Fast Methods for Kernel-Based Text Analysis

  2003cited by this paper
• Text Chunking based on a Generalization of Winnow

  2002cited by this paper
• Building a tree-bank of modern hebrew text

  2001cited by this paper
• The Nature of Statistical Learning Theory

  2000cited by this paper
• Use of Support Vector Learning for Chunk Identification

  2000cited by this paper
• Introduction to the CoNLL-2000 Shared Task Chunking

  2000cited by this paper
• Text Categorization with Support Vector Machines: Learning with Many Relevant Features

  1999cited by this paper
• Generation of Noun Compounds in Hebrew: Can Syntactic Knowledge Be Fully Encapsulated?

  1998cited by this paper
• Error-Driven Pruning of Treebank Grammars for Base Noun Phrase Identification

  1998cited by this paper
• Text Chunking using Transformation-Based Learning

  1995cited by this paper
• Parsing By Chunks

  1991cited by this paper

• Enriching plWordNet with morphology

  2021cites this paper
• Turkish Constituent Chunking with Morphological and Contextual Features

  2013cites this paper
• Knowledge-Poor Approach to Shallow Parsing: Contribution of Unsupervised Part-of-Speech Induction

  2011cites this paper
• Modeling Morphosyntactic Agreement in Constituency-Based Parsing of Modern Hebrew

  2010cites this paper
• On the Role of Lexical Features in Sequence Labeling

  2009cites this paper
• Vietnamese Noun Phrase Chunking Based on Conditional Random Fields

  2009cites this paper
• Hebrew Dependency Parsing: Initial Results

  2009cites this paper
• Tagging a Hebrew Corpus: the Case of Participles

  2008cites this paper
• Accurate Unlexicalized Parsing for Modern Hebrew

  2007cites this paper
• Three-Dimensional Parametrization for Parsing Morphologically Rich Languages

  2007cites this paper
• SVM Model Tampering and Anchored Learning: A Case Study in Hebrew NP Chunking

  2007influential citation