The relationship between IR effectiveness measures and user satisfaction

No abstract is available for this paper.

• Publication year

  2007

• Venue

  Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

• Publication date

  2007-07-23

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/1277741.1277902
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• The Turn - Integration of Information Seeking and Retrieval in Context

  2005cited by this paper
• Cumulated gain-based evaluation of IR techniques

  2002cited by this paper
• Measuring Search Engine Quality

  2001cited by this paper
• IR evaluation methods for retrieving highly relevant documents

  2000cited by this paper

• Towards an AI-Driven Video-Based American Sign Language Dictionary: Exploring Design and Usage Experience with Learners

  2025cites this paper
• Towards Better Evaluating Multi-Query Sessions: A Measure Based on the Theory of Planned Behavior

  2025cites this paper
• CLUE: Using Large Language Models for Judging Document Usefulness in Web Search Evaluation

  2025cites this paper
• Learning to Rank for Query Auto-completion in the Legal Domain

  2025cites this paper
• From Code Changes to Performance Variations: A Predictive Approach for Microbenchmark Prioritization

  2025cites this paper
• Leveraging LLMs to Evaluate Usefulness of Document

  2025cites this paper
• Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems

  2024cites this paper
• Semantic Search Evaluation

  2024cites this paper
• Session-level Normalization and Click-through Data Enhancement for Session-based Evaluation

  2024cites this paper
• The Influence of Presentation and Performance on User Satisfaction

  2024influential citation
• Individual Persistence Adaptation for User-Centric Evaluation of User Satisfaction in Recommender Systems

  2024cites this paper
• On (Normalised) Discounted Cumulative Gain as an Off-Policy Evaluation Metric for Top-n Recommendation

  2023cites this paper
• Metric-agnostic Ranking Optimization

  2023cites this paper
• Adversarially Trained Environment Models Are Effective Policy Evaluators and Improvers - An Application to Information Retrieval

  2023cites this paper
• ethp2psim: Evaluating and deploying privacy-enhanced peer-to-peer routing protocols for the Ethereum network

  2023cites this paper
• How Well do Offline Metrics Predict Online Performance of Product Ranking Models?

  2023cites this paper
• Understanding and Predicting User Satisfaction with Conversational Recommender Systems

  2023cites this paper
• An Intent Taxonomy of Legal Case Retrieval

  2023cites this paper
• Preference-Based Offline Evaluation

  2023cites this paper
• Proposing a New Combined Indicator for Measuring Search Engine Performance and Evaluating Google, Yahoo, DuckDuckGo, and Bing Search Engines based on Combined Indicator

  2022cites this paper
• Counterfactually Evaluating Explanations in Recommender Systems

  2022cites this paper
• Evaluating the Cranfield Paradigm for Conversational Search Systems

  2022cites this paper
• Function Representations for Binary Similarity

  2022cites this paper
• Design and Evaluation of Hybrid Search for American Sign Language to English Dictionaries: Making the Most of Imperfect Sign Recognition

  2022cites this paper
• Vietnamese Information Retrieval Test Collection Development

  2022cites this paper
• Mixed Method Development of Evaluation Metrics

  2021cites this paper
• Understanding Bias and Variance of Learning-to-Rank Algorithms: An Empirical Framework

  2021cites this paper
• Effect of Sign-recognition Performance on the Usability of Sign-language Dictionary Search

  2021influential citation
• How Am I Doing?: Evaluating Conversational Search Systems Offline

  2021cites this paper
• Evaluation Measures Based on Preference Graphs

  2021cites this paper
• Large-scale Hybrid Approach for Predicting User Satisfaction with Conversational Agents

  2020cites this paper
• Review selection based on content quality

  2020cites this paper
• Search task success evaluation by exploiting multi-view active semi-supervised learning

  2020cites this paper
• Metrics, User Models, and Satisfaction

  2020cites this paper
• User behavior modeling for Web search evaluation

  2020cites this paper
• Effect of Ranking and Precision of Results on Users’ Satisfaction with Search-by-Video Sign-Language Dictionaries

  2020cites this paper
• Do better search engines really equate to better clinical decisions? If not, why not?

  2020cites this paper
• Models Versus Satisfaction: Towards a Better Understanding of Evaluation Metrics

  2020cites this paper
• Effect of Automatic Sign Recognition Performance on the Usability of Video-Based Search Interfaces for Sign Language Dictionaries

  2019influential citation
• Node embeddings in dynamic graphs

  2019influential citation
• Investigating the role of eye movements and physiological signals in search satisfaction prediction using geometric analysis

  2019cites this paper
• Grid-based Evaluation Metrics for Web Image Search

  2019cites this paper
• On Annotation Methodologies for Image Search Evaluation

  2019cites this paper
• A Study on Effective Measurement of Search Results from Search Engines

  2019cites this paper
• Using Implicit Job Seeker Preferences to Improve Job Recommendation Ranking

  2019cites this paper
• Investigating Cognitive Effects in Session-level Search User Satisfaction

  2019cites this paper
• Ensemble supervised learning for genomic selection

  2019cites this paper
• SAFE: Self-Attentive Function Embeddings for Binary Similarity

  2018cites this paper
• How Well do Offline and Online Evaluation Metrics Measure User Satisfaction in Web Image Search?

  2018cites this paper
• Temporal walk based centrality metric for graph streams

  2018cites this paper
• Efficient K-NN for Playlist Continuation

  2018cites this paper
• Direct Learning to Rank and Rerank

  2018cites this paper
• Statistical Analysis of Results in Music Information Retrieval: Why and How

  2018cites this paper
• "Satisfaction with Failure" or "Unsatisfied Success": Investigating the Relationship between Search Success and User Satisfaction

  2018cites this paper
• Geographic Information Retrieval: Progress and Challenges in Spatial Search of Text

  2018cites this paper
• Online Evaluation of Rankers Using Multileaving

  2018cites this paper
• User Experiments with Search Services: Methodological Challenges for Measuring the Perceived Quality

  2017cites this paper
• Catch Them If You Can A Simulation Study on Malicious Behavior in a Cultural Heritage Question Answering System

  2017cites this paper
• Scalability and Performance of Random Forest based Learning-to-Rank for Information Retrieval

  2017cites this paper
• Multi-Attribute Bayesian Optimization under Utility Uncertainty

  2017cites this paper
• Tutorial on Open Source Online Learning Recommenders

  2017cites this paper
• Tracking Events in Social Media

  2017cites this paper
• Establishing interoperability among knowledge organization systems for research management: a social network approach

  2017cites this paper
• Online Ranking Prediction in Non-stationary Environments

  2017cites this paper
• User Preference Prediction in Mobile Search

  2017cites this paper
• Evaluating Web Search with a Bejeweled Player Model

  2017cites this paper
• Meta-evaluation of Online and Offline Web Search Evaluation Metrics

  2017cites this paper
• PerfRanker: prioritization of performance regression tests for collection-intensive software

  2017influential citation
• Going beyond relevance: role of effort in information retrieval

  2017cites this paper
• E-commerce Sites Search Results Relevance Prediction Based on Ensemble Approach

  2017cites this paper
• Wikiometrics: a Wikipedia based ranking system

  2016cites this paper
• When does Relevance Mean Usefulness and User Satisfaction in Web Search?

  2016cites this paper
• Predicting User Satisfaction with Intelligent Assistants

  2016cites this paper
• TCPM: Topic-Based Clinical Pathway Mining

  2016cites this paper
• Unsupervised Detection of Abnormal Moments for Usability Testing of Mobile Apps

  2016cites this paper
• Finding diverse needles in a haystack of comments: social media exploration for news

  2016cites this paper
• Measuring and Predicting Search Engine Users’ Satisfaction

  2016influential citation
• Summarizing patient daily activities for clinical pathway mining

  2016cites this paper
• Towards reproducibility in recommender-systems research

  2016cites this paper
• Catch them if you can

  2016cites this paper
• Understanding User Satisfaction with Intelligent Assistants

  2016cites this paper
• Learning to Select Supplier Portfolios for Service Supply Chain

  2016cites this paper
• A reinforcement learning formulation to the complex question answering problem

  2015cites this paper
• Does Vertical Bring more Satisfaction?: Predicting Search Satisfaction in a Heterogeneous Environment

  2015cites this paper
• Understanding and Predicting Graded Search Satisfaction

  2015cites this paper
• Features of Disagreement Between Retrieval Effectiveness Measures

  2015cites this paper
• IR Evaluation: Designing an End-to-End Offline Evaluation Pipeline

  2015cites this paper
• Using Contextual Information to Understand Searching and Browsing Behavior

  2015influential citation
• Are Data Sets Like Documents?: Evaluating Similarity-Based Ranked Search over Scientific Data

  2015cites this paper
• Behavioral Dynamics from the SERP's Perspective: What are Failed SERPs and How to Fix Them?

  2015cites this paper
• How Do Gain and Discount Functions Affect the Correlation between DCG and User Satisfaction?

  2015cites this paper
• IR Evaluation: Modeling User Behavior for Measuring Effectiveness

  2015cites this paper
• Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems

  2015influential citation
• Research-paper recommender systems: a literature survey

  2015cites this paper
• Modelling and Detecting Changes in User Satisfaction

  2014cites this paper
• Novelty and diversity in search results

  2014cites this paper
• A Family of Rank Similarity Measures Based on Maximized Effectiveness Difference

  2014cites this paper
• Improving Stemming Algorithm for Arabic Text Search

  2014cites this paper
• Machine-Assisted Search Preference Evaluation

  2014cites this paper
• Ranked Similarity Search of Scientific Datasets: An Information Retrieval Approach

  2014cites this paper