DBpedia-Entity v2: A Test Collection for Entity Search

The DBpedia-entity collection has been used as a standard test collection for entity search in recent years. We develop and release a new version of this test collection, DBpedia-Entity v2, which uses a more recent DBpedia dump and a unified candidate result pool from the same set of retrieval models. Relevance judgments are also collected in a uniform way, using the same group of crowdsourcing workers, following the same assessment guidelines. The result is an up-to-date and consistent test collection.To facilitate further research, we also provide details about the pre-processing and indexing steps, and include baseline results from both classical and recently developed entity search methods.

• Publication year

  2017

• Venue

  Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

• Publication date

  2017-08-07

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/3077136.3080751
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Dynamic Factual Summaries for Entity Cards

  2017cited by this paper
• Explicit Semantic Ranking for Academic Search via Knowledge Graph Embedding

  2017cited by this paper
• Target Type Identification for Entity-Bearing Queries

  2017cited by this paper
• Entity Linking in Queries: Efficiency vs. Effectiveness

  2017cited by this paper
• Parameterized Fielded Term Dependence Models for Ad-hoc Entity Retrieval from Knowledge Graph

  2016cited by this paper
• Exploiting Entity Linking in Queries for Entity Retrieval

  2016influential reference
• An Empirical Study of Learning to Rank for Entity Search

  2016cited by this paper
• Fielded Sequential Dependence Model for Ad-Hoc Entity Retrieval in the Web of Data

  2015influential reference
• Entity Retrieval via Entity Factoid Hierarchy

  2015cited by this paper
• Entity linking and retrieval for semantic search

  2014cited by this paper
• A test collection for entity search in DBpedia

  2013cited by this paper
• Evaluating question answering over linked data

  2013cited by this paper
• Overview of the INEX 2013 Linked Data Track

  2013cited by this paper
• Hierarchical target type identification for entity-oriented queries

  2012cited by this paper
• Mapping queries to the Linking Open Data cloud: A case study using DBpedia

  2011cited by this paper
• Entity Search Evaluation over Structured Web Data

  2011cited by this paper
• TAGME: on-the-fly annotation of short text fragments (by wikipedia entities)

  2010cited by this paper
• Evaluating ad-hoc object retrieval

  2010cited by this paper
• The Probabilistic Relevance Framework: BM25 and Beyond

  2009influential reference
• Named entity recognition in query

  2009cited by this paper
• Overview of the INEX 2009 Entity Ranking Track

  2009cited by this paper
• Overview of the TREC 2009 Entity Track

  2009cited by this paper
• Overview of the INEX 2009 Entity Ranking Track

  2009cited by this paper
• A Probabilistic Retrieval Model for Semistructured Data

  2009cited by this paper
• YAGO: A Core of Semantic Knowledge Unifying WordNet and Wikipedia

  2007cited by this paper
• A Markov random field model for term dependencies

  2005cited by this paper
• Combining document representations for known-item search

  2003cited by this paper
• A Language Modeling Approach to Information Retrieval

  1998cited by this paper

• Less Finetuning, Better Retrieval: Rethinking LLM Adaptation for Biomedical Retrievers via Synthetic Data and Model Merging

  2026cites this paper
• Unifying Adversarial Robustness and Training Across Text Scoring Models

  2026cites this paper
• Overcoming the Retrieval Barrier: Indirect Prompt Injection in the Wild for LLM Systems

  2026cites this paper
• Multi-model pseudo-document generation and reconstruction for hybrid query expansion

  2026cites this paper
• The Vulnerability of LLM Rankers to Prompt Injection Attacks

  2026cites this paper
• ReAttn: Improving Attention-based Re-ranking via Attention Re-weighting

  2026influential citation
• LLM-Confidence Reranker: A Training-Free Approach for Enhancing Retrieval-Augmented Generation Systems

  2026cites this paper
• Contrastive Retrieval Heads Improve Attention-Based Re-Ranking

  2025cites this paper
• Study on LLMs for Promptagator-Style Dense Retriever Training

  2025cites this paper
• Evaluating the Effectiveness and Scalability of LLM-Based Data Augmentation for Retrieval

  2025cites this paper
• NER Retriever: Zero-Shot Named Entity Retrieval with Type-Aware Embeddings

  2025cites this paper
• Retrieval Capabilities of Large Language Models Scale with Pretraining FLOPs

  2025cites this paper
• Leveraging LLMs for Utility-Focused Annotation: Reducing Manual Effort for Retrieval and RAG

  2025cites this paper
• Quantization Aware Matryoshka Adaptation: Leveraging Matryoshka Learning, Quantization, and Bitwise Operations for Reduced Storage and Improved Retrieval Speed

  2025cites this paper
• Think Before You Retrieve: Learning Test-Time Adaptive Search with Small Language Models

  2025cites this paper
• Scaling Trust: Veracity-Driven Defect Detection in Entity Search

  2025influential citation
• LLM-as-a-Judge in Entity Retrieval: Assessing Explicit and Implicit Relevance

  2025cites this paper
• A Systematic Literature Review and Classification of Approaches for Keyword Search Over Graph-Shaped Data

  2025cites this paper
• Randomly Removing 50% of Dimensions in Text Embeddings has Minimal Impact on Retrieval and Classification Tasks

  2025cites this paper
• Decoder-Only LLMs can be Masked Auto-Encoders

  2025cites this paper
• Balancing the Blend: An Experimental Analysis of Trade-offs in Hybrid Search

  2025cites this paper
• Distillation versus Contrastive Learning: How to Train Your Rerankers

  2025cites this paper
• QFFN-BERT: An Empirical Study of Depth, Performance, and Data Efficiency in Hybrid Quantum-Classical Transformers

  2025cites this paper
• Efficient Re-ranking with Cross-encoders via Early Exit

  2025cites this paper
• Distilling a Small Utility-Based Passage Selector to Enhance Retrieval-Augmented Generation

  2025cites this paper
• Bridging Modalities: Improving Universal Multimodal Retrieval by Multimodal Large Language Models

  2025cites this paper
• Graph Embeddings to Empower Entity Retrieval

  2025influential citation
• Redundancy, Isotropy, and Intrinsic Dimensionality of Prompt-based Text Embeddings

  2025cites this paper
• Conventional Contrastive Learning Often Falls Short: Improving Dense Retrieval with Cross-Encoder Listwise Distillation and Synthetic Data

  2025cites this paper
• An unsupervised fusion framework of generation and retrieval for entity search

  2025cites this paper
• CSPLADE: Learned Sparse Retrieval with Causal Language Models

  2025influential citation
• Efficient and Asymptotically Unbiased Constrained Decoding for Large Language Models

  2025influential citation
• SemCAFE: When Named Entities make the Difference–Assessing Web Source Reliability through Entity-level Analytics

  2025cites this paper
• Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation

  2025cites this paper
• Unleashing the Power of LLMs in Dense Retrieval with Query Likelihood Modeling

  2025cites this paper
• Teaching Dense Retrieval Models to Specialize with Listwise Distillation and LLM Data Augmentation

  2025cites this paper
• Mitigating Bias in RAG: Controlling the Embedder

  2025influential citation
• O1 Embedder: Let Retrievers Think Before Action

  2025cites this paper
• Hypencoder: Hypernetworks for Information Retrieval

  2025cites this paper
• MHGTN: Multi-Interaction Heterogeneous Graph Transformer Network for Knowledge Graph Completion

  2025cites this paper
• Knowledge graph based entity selection framework for ad-hoc retrieval

  2025cites this paper
• KnowFIRES: A Knowledge-Graph Framework for Interpreting Retrieved Entities from Search

  2024cites this paper
• BIRCO: A Benchmark of Information Retrieval Tasks with Complex Objectives

  2024cites this paper
• GliLem: Leveraging GliNER for Contextualized Lemmatization in Estonian

  2024cites this paper
• GME: Improving Universal Multimodal Retrieval by Multimodal LLMs

  2024cites this paper
• State Space Models are Strong Text Rerankers

  2024influential citation
• BEIR-NL: Zero-shot Information Retrieval Benchmark for the Dutch Language

  2024cites this paper
• MM-Embed: Universal Multimodal Retrieval with Multimodal LLMs

  2024cites this paper
• Interpret and Control Dense Retrieval with Sparse Latent Features

  2024cites this paper
• UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers

  2024cites this paper
• Enhancing RAG's Retrieval via Query Backtranslations

  2024cites this paper
• Veracity Estimation for Entity-Oriented Search with Knowledge Graphs

  2024cites this paper
• No Query Left Behind: Query Refinement via Backtranslation

  2024cites this paper
• ExaRanker-Open: Synthetic Explanation for IR using Open-Source LLMs

  2024cites this paper
• Utility-Oriented Knowledge Graph Accuracy Estimation with Limited Annotations: A Case Study on DBpedia

  2024cites this paper
• Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers

  2024cites this paper
• QAEncoder: Towards Aligned Representation Learning in Question Answering System

  2024cites this paper
• Disentangling Questions from Query Generation for Task-Adaptive Retrieval

  2024cites this paper
• RouterRetriever: Exploring the Benefits of Routing over Multiple Expert Embedding Models

  2024cites this paper
• PRP-Graph: Pairwise Ranking Prompting to LLMs with Graph Aggregation for Effective Text Re-ranking

  2024cites this paper
• BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval

  2024cites this paper
• A Knowledge Graph Embedding Model for Answering Factoid Entity Questions

  2024cites this paper
• Revisiting Document Expansion and Filtering for Effective First-Stage Retrieval

  2024influential citation
• Resources for Combining Teaching and Research in Information Retrieval Coursework

  2024cites this paper
• BM25S: Orders of magnitude faster lexical search via eager sparse scoring

  2024cites this paper
• Learning contextual representations for entity retrieval

  2024cites this paper
• A Bi-metric Framework for Fast Similarity Search

  2024cites this paper
• Generative Query Reformulation Using Ensemble Prompting, Document Fusion, and Relevance Feedback

  2024cites this paper
• Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration

  2024cites this paper
• INDUS: Effective and Efficient Language Models for Scientific Applications

  2024cites this paper
• Benchmark and Neural Architecture for Conversational Entity Retrieval from a Knowledge Graph

  2024cites this paper
• A Fast Hop-Biased Approximation Algorithm for the Quadratic Group Steiner Tree Problem

  2024cites this paper
• RouterRetriever: Routing over a Mixture of Expert Embedding Models

  2024cites this paper
• GenQREnsemble: Zero-Shot LLM Ensemble Prompting for Generative Query Reformulation

  2024cites this paper
• LaQuE: Enabling Entity Search at Scale

  2024influential citation
• Joint Inference of Retrieval and Generation for Passage Re-ranking

  2024cites this paper
• ExaRanker: Synthetic Explanations Improve Neural Rankers

  2023cites this paper
• Information Retrieval: Recent Advances and Beyond

  2023cites this paper
• ExaRanker: Explanation-Augmented Neural Ranker

  2023cites this paper
• Augmenting Zero-Shot Dense Retrievers with Plug-in Mixture-of-Memories

  2023cites this paper
• Query2doc: Query Expansion with Large Language Models

  2023cites this paper
• Improving the Generalizability of the Dense Passage Retriever Using Generated Datasets

  2023cites this paper
• Assessing Bias on Entity Retrieval Models through Conjunctive Fallacies

  2023cites this paper
• Modular Retrieval for Generalization and Interpretation

  2023cites this paper
• Who can verify this? Finding authorities for rumor verification in Twitter

  2023cites this paper
• Efficient Approximation Algorithms for the Diameter-Bounded Max-Coverage Group Steiner Tree Problem

  2023cites this paper
• BERM: Training the Balanced and Extractable Representation for Matching to Improve Generalization Ability of Dense Retrieval

  2023cites this paper
• Referral Augmentation for Zero-Shot Information Retrieval

  2023cites this paper
• BEIR-PL: Zero Shot Information Retrieval Benchmark for the Polish Language

  2023cites this paper
• I3: Intent-Introspective Retrieval Conditioned on Instructions

  2023cites this paper
• Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking

  2023cites this paper
• NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval

  2023cites this paper
• Plot Retrieval as an Assessment of Abstract Semantic Association

  2023cites this paper
• It's All Relative! - A Synthetic Query Generation Approach for Improving Zero-Shot Relevance Prediction

  2023cites this paper
• Document structure-driven investigative information retrieval

  2023cites this paper
• Noisy Self-Training with Synthetic Queries for Dense Retrieval

  2023cites this paper
• KeySearchWiki: An Automatically Generated Dataset for Keyword Search over Wikidata

  2023influential citation
• ControlRetriever: Harnessing the Power of Instructions for Controllable Retrieval

  2023cites this paper
• SpaDE: Improving Sparse Representations using a Dual Document Encoder for First-stage Retrieval

  2022cites this paper
• Injecting Domain Adaptation with Learning-to-hash for Effective and Efficient Zero-shot Dense Retrieval

  2022influential citation