A statistical interpretation of term specificity and its application in retrieval

The exhaustivity of document descriptions and the specificity of index terms are usually regarded as independent. It is suggested that specificity should be interpreted statistically, as a function of term use rather than of term meaning. The effects on retrieval of variations in term specificity are examined, experiments with three test collections showing in particular that frequently‐occurring terms are required for good overall performance. It is argued that terms should be weighted according to collection frequency, so that matches on less frequent, more specific, terms are of greater value than matches on frequent terms. Results for the test collections show that considerable improvements in performance are obtained with this very simple procedure.

• Publication year

  2021

• Venue

  J. Documentation

• Publication date

  2021-02-02

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1108/EB026526
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Report of an Information Science Index Languages Test

  1974cited by this paper
• Report of an information science index languages test

  1972cited by this paper
• Automatic keyword classification for information retrieval

  1971cited by this paper
• Comparative evaluation of index languages

  1969cited by this paper
• The Effectiveness of Automatically Generated Weights and Links in Mechanical Indexing.

  1969cited by this paper
• Information retrieval systems; characteristics, testing, and evaluation

  1968cited by this paper
• Automatic Information Organization And Retrieval

  1968influential reference
• Computer Evaluation of Indexing and Text Processing

  1968cited by this paper
• Distribution of indexing terms for maximum efficiency of information transmission

  1967cited by this paper
• Aslib Cranfield research project - Factors determining the performance of indexing systems; Volume 1, Design; Part 2, Appendices

  1966cited by this paper
• Factors determining the performance of indexing systems

  1966cited by this paper

• Retrieval-Augmented Generation for Multi-Hop Question Answering based on Structured Planning

  2026cites this paper
• Contrastive Learning with Narrative Twins for Modeling Story Salience

  2026cites this paper
• Let's Roll a BiFTA: Bi-refinement for Fine-grained Text-visual Alignment in Vision-Language Models

  2026cites this paper
• DEEP: Docker-based Execution and Evaluation Platform

  2026cites this paper
• Ten questions concerning large language models (LLMs) for building applications

  2026cites this paper
• Improved Evidence Extraction for Document Inconsistency Detection with LLMs

  2026influential citation
• DAVA: Decoding Art With Visual Analytics Through Feature Modeling and Multi-Agent Collaboration

  2026cites this paper
• A Survey on Video Captioning in the Era of Large Language Models

  2026cites this paper
• Extending neighborhood aggregation: fine-grained node representation learning for text-attributed graphs under community structures

  2026cites this paper
• TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving

  2026cites this paper
• Measuring technological similarity in the wine industry

  2026cites this paper
• Beyond contacts: The important role of the support region in protein complex assembly

  2026cites this paper
• CurricuLLM: Designing Personalized and Workforce-Aligned Cybersecurity Curricula Using Fine-Tuned LLMs

  2026cites this paper
• Leveraging textual content, citational aspects and dissenting opinions through a multi-view contrastive learning methodology for legal precedent analysis

  2026cites this paper
• Methods and evaluation in unsupervised keyphrase prediction: a survey

  2026cites this paper
• Smiles or tears? How emojis power a semistrong efficient market of bitcoin: A comprehensive analysis of decision tree models

  2026influential citation
• Entropic Context Shaping: Information-Theoretic Filtering for Context-Aware LLM Agents

  2026cites this paper
• To Case or Not to Case: An Empirical Study in Learned Sparse Retrieval

  2026cites this paper
• Enhancing Retrieval-Augmented Generation with Topic-Enriched Embeddings: A Hybrid Approach Integrating Traditional NLP Techniques

  2026cites this paper
• LM-Lexicon: Improving Definition Modeling via Harmonizing Semantic Experts

  2026cites this paper
• MT-PingEval: Evaluating Multi-Turn Collaboration with Private Information Games

  2026cites this paper
• A multimodal slice discovery framework for systematic failure detection and explanation in medical image classification

  2026cites this paper
• Closing the acronym gap in educational retrieval with ontology-guided augmentation

  2026cites this paper
• A Systematic Approach to Key Phrase Extraction for Turkish: Adapting Embedding-Based Models

  2026cites this paper
• Mining Chinese historical sources at scale: A machine learning approach to Qing state capacity

  2026cites this paper
• Beyond the Geometric Curse: High-Dimensional N-Gram Hashing for Dense Retrieval

  2026cites this paper
• Hybrid TF-IDF and SBERT Feature Engineering with SMOTE-Tomek Resampling for Enhanced Software Requirements Classification

  2026cites this paper
• Beyond Fine-Tuning: Leveraging Domain-Aware In-Context learning with large language models for clinical named entity recognition

  2026cites this paper
• Towards accurate and scalable cross-modal retrieval with a distillation approach

  2026cites this paper
• Insights into the impact of visual and textual information on investment decision-making: A multimodal business plan analysis via deep representation learning

  2026cites this paper
• Bridging the Semantic Gap in Computational Color Design: A Neurocognitively Validated Framework

  2026cites this paper
• LongDocRank: graph-augmented large language models for unsupervised keyphrase extraction from long documents

  2026cites this paper
• Digitally mediated accessibility: A metric combining human perception and generative AI

  2026cites this paper
• Beyond Linearization: Attributed Table Graphs for Table Reasoning

  2026cites this paper
• Progressive Adaptation of Large Language Models for Multilingual Text Ranking

  2026cites this paper
• Case-based reasoning for clinical trial recruitment tools in oncology: When you need patients to find patients

  2026cites this paper
• SmartOracle - An Agentic Approach to Mitigate Noise in Differential Oracles

  2026cites this paper
• From Verifiable Dot to Reward Chain: Harnessing Verifiable Reference-based Rewards for Reinforcement Learning of Open-ended Generation

  2026cites this paper
• Misconception Diagnosis From Student-Tutor Dialogue: Generate, Retrieve, Rerank

  2026cites this paper
• Beyond keywords: modeling the semantic complexity of deceptive communication on instant messaging platforms

  2026cites this paper
• Semantic search approach for information extraction from traffic crash narratives

  2026cites this paper
• Towards unified multi-view ensemble models for multi-label podcast genre prediction

  2026cites this paper
• AIM review tool: artificial intelligence for smarter systematic review screening

  2026cites this paper
• Asymmetric Idiosyncrasies in Multimodal Models

  2026cites this paper
• Deep language model-based early recognition of out-of-hospital cardiac arrest from real-time emergency calls.

  2026cites this paper
• A spam detection model based on the discriminative TF-IDF belief rule base.

  2026cites this paper
• Virtual-Document-Augmented Retrieval-Augmented Generation for Power-Domain Knowledge-Base Question Answering with Noise-Enhanced Robustness

  2026cites this paper
• TabAgent: A Framework for Replacing Agentic Generative Components with Tabular-Textual Classifiers

  2026cites this paper
• The Use of Soft Logic for Risk Evaluation in Defense System of Systems

  2026cites this paper
• LLM-Based Explainable Detection of LLM-Generated Code in Python Programming Courses

  2026cites this paper
• From Competition to Collaboration: Designing Sustainable Mechanisms Between LLMs and Online Forums

  2026cites this paper
• Recursive multi-modal retrieval for structured semantic trees in engineering documents

  2026cites this paper
• Design Research on LLM-Based Intelligent Information Systems for Radiation Equipment Safety Management

  2026cites this paper
• Towards smarter hiring solutions: artificial intelligence-driven resume classification with advanced embedding techniques

  2026cites this paper
• An approach for detecting emerging operational risks from textual data

  2026cites this paper
• Membership Inference on LLMs in the Wild

  2026cites this paper
• OHE-RWNet: a novel neural network-based vectorization method for fake review detection

  2026cites this paper
• Depression detection in read and spontaneous speech: A Multimodal approach for lesser-resourced languages

  2025cites this paper
• BrightCookies at SemEval-2025 Task 9: Exploring Data Augmentation for Food Hazard Classification

  2025influential citation
• A symbol of purity or pedophilia? Legal perceptions of priest-perpetrated child sexual assault

  2025cites this paper
• Research on active retrieval enhancement for large language models based on multi-model integration

  2025cites this paper
• Towards Automated Detection of Inline Code Comment Smells

  2025cites this paper
• AI framework for DRIVE model based mental health detection in text: a case study on how coping strategies are expressed during COVID-19

  2025cites this paper
• Applying Machine Learning to Detect Periodicity in Transactional Banking Data

  2025cites this paper
• How urban land expansion alters terrain in mountainous and hilly areas: An empirical study in China

  2025cites this paper
• Tell Me What You Know About Sexism: Expert-LLM Interaction Strategies and Co-Created Definitions for Zero-Shot Sexism Detection

  2025cites this paper
• Online Clustering of Massive Text Data Streams

  2025cites this paper
• Social Media Multi-Emotion Detection

  2025cites this paper
• Diffulex: Diffusion based lexically constrained text generation with mixed absorbing state and constraint balance

  2025cites this paper
• What's the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns

  2025cites this paper
• Data-Driven Spatial Analysis: A Multi-Stage Framework to Enhance Temporary Event Space Attractiveness

  2025cites this paper
• From Precision to Perception: User-Centred Evaluation of Keyword Extraction Algorithms for Internet-Scale Contextual Advertising

  2025cites this paper
• Performance Analysis of Text Classification Algorithms for Dhivehi Language Documents

  2025cites this paper
• CSPLADE: Learned Sparse Retrieval with Causal Language Models

  2025cites this paper
• AttentionDefense: Leveraging System Prompt Attention for Explainable Defense Against Novel Jailbreaks

  2025cites this paper
• Automated phenotyping of mild cognitive impairment and Alzheimer's disease and related dementias using electronic health records

  2025cites this paper
• Enhancing bridge inspection data quality using machine learning

  2025cites this paper
• Study on Text Classification for Public Administration

  2025cites this paper
• ConExion: Concept Extraction with Large Language Models

  2025cites this paper
• OKRA: An Explainable, Heterogeneous, Multi-stakeholder Job Recommender System

  2025cites this paper
• Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative Analysis

  2025cites this paper
• End-to-End Explainable Fake News Detection Via Evidence-Claim Variational Causal Inference

  2025cites this paper
• Efficient bimodal emotion recognition system based on speech/text embeddings and ensemble learning fusion

  2025cites this paper
• Generating learning guides for medical education with LLMs and statistical analysis of test results

  2025cites this paper
• Empowering multimodal analysis with visualization: A survey

  2025cites this paper
• Scholar Inbox: Personalized Paper Recommendations for Scientists

  2025influential citation
• Enhancing Recruiter Outreach: Predicting Job Ad Quality with Advanced Machine Learning and NLP Models

  2025cites this paper
• Multi-modal contrastive learning of urban space representations from POI data

  2025cites this paper
• Deciphering COVID-19 Narratives: A Comparative Study of ML Models (RF, MNB, GB, LR, SVM) and DL Models (CNN, Bi-LSTM) for News Article Classification

  2025cites this paper
• Evaluation of summaries using a language model of parliamentary proceedings

  2025cites this paper
• GSAM: A simple and General Stereo Alignment Module for multi-view document clustering

  2025cites this paper
• A deep learning approach to understanding controlled ovarian stimulation and in vitro fertilization dynamics

  2025cites this paper
• Extracting Information from Reddit for Emergency Management - A Case Study on British Columbia Wildfire

  2025cites this paper
• An Optimization Algorithm for Multimodal Data Alignment

  2025cites this paper
• Poisson-Process Topic Model for Integrating Knowledge from Pre-trained Language Models

  2025cites this paper
• Analyzing cross-platform gaming experiences using topic modeling

  2025cites this paper
• Refining Interactions: Enhancing Anisotropy in Graph Neural Networks with Language Semantics

  2025cites this paper
• Decentralized Adaptive Ranking using Transformers

  2025cites this paper
• Detecting latent topics and trends in IoT and e-commerce using BERTopic modeling

  2025cites this paper
• Improving patient clustering by incorporating structured variable label relationships in similarity measures

  2025cites this paper