Text Segmentation Based on Similarity between Words

This paper proposes a new indicator of text structure, called the lexical cohesion profile (LCP), which locates segment boundaries in a text. A text segment is a coherent scene; the words in a segment are linked together via lexical cohesion relations. LCP records mutual similarity of words in a sequence of text. The similarity of words, which represents their cohesiveness, is computed using a semantic network. Comparison with the text segments marked by a number of subjects shows that LCP closely correlates with the human judgments. LCP may provide valuable information for resolving anaphora and ellipsis.

• Publication year

  1993

• Venue

  Annual Meeting of the Association for Computational Linguistics

• Publication date

  1993-06-22

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.3115/981574.981616arXiv cmp-lg/9601005
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Subtopic structuring for full-length document access

  1993cited by this paper
• Similarity between Words Computed by Spreading Activation on an English Dictionary

  1993cited by this paper
• Lexical Cohesion Computed by Thesaural relations as an indicator of the structure of text

  1991cited by this paper
• A New Tool for Discourse Analysis: The Vocabulary-Management Profile.

  1991cited by this paper
• Attention, Intentions, and the Structure of Discourse

  1986cited by this paper
• British and American Short Stories

  1960cited by this paper
• A general service list of English words, with semantic frequencies and a supplementary word-list for the writing of popular science and technology

  1953cited by this paper

• Multimodal Chaptering for Long-Form TV Newscast Video

  2024cites this paper
• Tokenization via Language Modeling: the Role of Preceding Text

  2024cites this paper
• Title A study on Hierarchical Table of Indexes for Multi-documents

  2023cites this paper
• Research on the Hybrid Paragraph Detection System Using Syntactic-Semantic Analysis

  2021cites this paper
• Segmentation of Tweets with URLs and its Applications to Sentiment Analysis

  2021cites this paper
• Topical Change Detection in Documents via Embeddings of Long Sequences

  2020cites this paper
• A History and Theory of Textual Event Detection and Recognition

  2020cites this paper
• Hierarchical Text Segmentation for Medieval Manuscripts

  2020cites this paper
• PatSeg: A Sequential Patent Segmentation Approach

  2020cites this paper
• Books of Hours. the First Liturgical Data Set for Text Segmentation.

  2020cites this paper
• Structural text segmentation of legal documents

  2020cites this paper
• Transcription automatique et segmentation thématique de livres d’heures manuscrits [Automatic transcription and thematic segmentation of Books of Hours]

  2019cites this paper
• Applying Neural Network Techniques for Topic Change Detection in the HuComTech Corpus

  2019cites this paper
• Hello & Goodbye: Conversation Boundary Identification Using Text Classification

  2018cites this paper
• Low Resource Methods for Medieval Document Sections Analysis

  2018cites this paper
• Book title recognition for smart library with deep learning

  2018cites this paper
• Multi-granularity hierarchical topic-based segmentation of structured, digital library resources

  2017cites this paper
• Classifying and Segmenting Classical and Modern Standard Arabic using Minimum Cross-Entropy

  2017cites this paper
• Information Bottleneck Inspired Method For Chat Text Segmentation

  2017cites this paper
• Syntactic Form and Discourse Function in Natural Language Generation

  2016cites this paper
• Predicting the tolerance level of religious discourse through computational linguistics

  2016cites this paper
• An Imperialist Competitive Algorithm for Persian Text Segmentation

  2015cites this paper
• Approaches to Automatic Text Structuring

  2015cites this paper
• Building a Language‐Independent Discourse Parser using Universal Networking Language

  2015cites this paper
• Recognition of logical units in log files

  2015cites this paper
• Book Reviews: Semantic Similarity from Natural Language and Ontology Analysis by Sébastien Harispe, Sylvie Ranwez, Stefan Janaqi, and Jacky Montmain

  2015cites this paper
• Approaches to Automatic Text Structuring

  2015cites this paper
• CLAN: Communities in Lexical Associative Networks

  2015cites this paper
• Machine learning for relevance of information in crisis response

  2015cites this paper
• Knowledge-based Semantic Measures: From Theory to Applications. (Mesures sémantiques à base de connaissance : de la théorie aux applicatifs)

  2014cites this paper
• A general supervised approach to segmentation of clinical texts

  2014cites this paper
• Topic segmentation on spoken documents using self-validated acoustic cuts

  2014cites this paper
• Procesos de integración textual en la lectura de instrucciones

  2014cites this paper
• Knowledge Management Techniques to Augment Textual CBR (PhD Thesis)

  2014cites this paper
• An Innovative Aim for Collecting and RetrievingDocuments from Web Domain Using SSARC(Spontaneous Sorting and Retrieving Clock) Algorithm

  2014cites this paper
• Semantic Measures for the Comparison of Units of Language, Concepts or Entities from Text and Knowledge Base Analysis

  2013cites this paper
• Evaluating Text Segmentation

  2013cites this paper
• Segmentation strategies for passage retrieval in audio-visual documents

  2013cites this paper
• An initial study of topical poetry segmentation

  2013cites this paper
• Semantic Measures for the Comparison of Units of Language, Concepts or Instances from Text and Knowledge Representation Analysis A Comprehensive Survey and a Technical Introduction to Knowledge-based Measures Using Semantic Graph Analysis

  2013cites this paper
• How Ontology Based Information Retrieval Systems May Benefit from Lexical Text Analysis

  2013cites this paper
• Application of Modified Spectral Bisection for Segmenting Malayalam Documents

  2013cites this paper
• Automatic Summarization of Spoken Dialogues in Unrestricted Domains

  2012cites this paper
• Two-part segmentation of text documents

  2012cites this paper
• An Idiosyncratic Tool for Clustering Legal Documents Using Principal Direction Divisive Partitioning Algorithm (PDDP) From Webmining

  2012cites this paper
• Analysis and study on text representation to improve the accuracy of the Normalized Compression Distance

  2012cites this paper
• Automatic Organization and Generation of Presentation Slides for E-Learning

  2012cites this paper
• Segmentation of Review Texts by using Thesaurus and Corpus-based Word Similarity

  2012cites this paper
• Application of Topic Segmentation in Audiovisual Information Retrieval

  2012cites this paper
• Analysis and study on text representation to improve the accuracy of the normalized compression distance

  2012cites this paper
• Application of Topic Segmentation in Audiovisual Information Retrieval

  2012cites this paper
• Retrieval from Unsegmented Finnish Audio Using Statisti c al Morpheme-Like Units for Segmentation , Re c ognition , and Retrieval

  2012cites this paper
• Towards a Politics of Reading : Narrative , Literary Hypertext and Meaning

  2012cites this paper
• Using Dependency Parses to Augment Feature Construction for Text Mining

  2012cites this paper
• Narrative and Hypertext 2011 Proceedings: a workshop at ACM Hypertext 2011, Eindhoven

  2012cites this paper
• AN IDIOSYNCRATIC TOOL FOR CLUSTERING LEGAL DOCUMENTS USING PRINCIPAL DIRECTION DIVISIVE PARTITIONING ALGORITHM (PDDP) FROM WEBMINING

  2012cites this paper
• Legal Documents Clustering using Latent Dirichlet Allocation

  2012cites this paper
• Évaluation automatique de textes et cohésion lexicale

  2012cites this paper
• Is the contextual information relevant in text clustering by compression?

  2012cites this paper
• Legal document clustering with built-in topic segmentation

  2011cites this paper
• Segmenting eBay item descriptions into coherent sections

  2011cites this paper
• Finding the Structure of Documents

  2011cites this paper
• IIITB-KNJ-2011-0101 Issues in Information Retrieval for the Kannada Language Kanaja

  2011cites this paper
• Semiotic term expansion as the basis for thematic models in narrative systems

  2011cites this paper
• Measuring Narrative Cohesion: A Five Variables Approach

  2011cites this paper
• Text segmentation: A topic modeling perspective

  2011influential citation
• Predicting Thread Linking Structure by Lexical Chaining

  2011cites this paper
• Speech retrieval from unsegmented finnish audio using statistical morpheme-like units for segmentation, recognition, and retrieval

  2011cites this paper
• Locating Information in Heterogeneous log files

  2011cites this paper
• Evaluation of Lexical Cohesion Algorithms for Arabic Topic Segmentation

  2010cites this paper
• TV News Story Segmentation Based on Semantic Coherence and Content Similarity

  2010cites this paper
• Facilitating reading through a theme-driven approach

  2010cites this paper
• Applying Graph Algorithms to Text Segmentation

  2010cites this paper
• Linear text segmentation using classification techniques

  2010cites this paper
• Identification of Rhetorical Roles for Segmentation and Summarization of a Legal Judgment

  2010cites this paper
• Contextually-Mediated Semantic Similarity Graphs for Topic Segmentation

  2010cites this paper
• Chapter 1 Finding the Structure of Documents

  2010cites this paper
• Segmentación textual Text segmentation

  2010influential citation
• COMPARATIVE STUDY OF TOPIC SEGMENTATION ALGORITHMS BASED ON LEXICAL COHESION: EXPERIMENTAL RESULTS ON ARABIC LANGUAGE

  2010cites this paper
• Discriminative Topic Segmentation of Text and Speech

  2010cites this paper
• News story segmentation in multiple modalities

  2009cites this paper
• Applying topic segmentation algorithms on arabic language

  2009cites this paper
• Meeting decision detection : multimodal information fusion for multi-party dialogue understanding

  2009cites this paper
• Topic Detection and Segmentation in Automatic Text Summarization

  2009cites this paper
• Étude Comparative des Algorithmes de Segmentation Thématique Pour la Langue Arabe

  2009cites this paper
• Unsupervised segmentation of conversational transcripts

  2009cites this paper
• Making Semantic Topicality Robust Through Term Abstraction

  2009cites this paper
• Search Problems for Speech and Audio Sequences

  2009cites this paper
• Improving Text Segmentation by Combining Endogenous and Exogenous Methods

  2009cites this paper
• Utiliser des sens de mots pour la segmentation thématique ?

  2009cites this paper
• Automatic detection and classification of prosodic events

  2009cites this paper
• Web Content Filtering

  2009cites this paper
• Text segmentation via topic modeling: an analytical study

  2009cites this paper
• Experiments in Improvement of Arabic Information Retrieval

  2009cites this paper
• Analyse des propriétés stationnaires et des propriétés émergentes dans les flux d'information changeant au cours du temps

  2009cites this paper
• Analyse des propriétés stationnaires et des propriétés émergentes dans les flux d'informations changeant au cours du temps. (Analysis of stationary and emerging properties in information flows changing over time)

  2009cites this paper
• Détection de la cohésion lexicale par voisinage distributionnel : application à la segmentation thématique

  2009cites this paper
• Exploring the Structure of Broadcast News for Topic Segmentation

  2009cites this paper
• The Corpus Problem in the RongoRongo Studies

  2009cites this paper
• A genetic algorithm for logical topic text segmentation

  2008cites this paper