Using statistical testing in the evaluation of retrieval experiments

No abstract is available for this paper.

• Publication year

  1993

• Venue

  Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

• Publication date

  1993-07-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/160688.160758
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Presenting Results of Experimental Retrieval Comparisons

  1997cited by this paper
• The Pragmatics of Information Retrieval Experimentation Revisited

  1997cited by this paper
• Improving retrieval performance by relevance feedback

  1997cited by this paper
• The State of Retrieval System Evaluation

  1992cited by this paper
• Incremental relevance feedback

  1992cited by this paper
• Determining the effectiveness of retrieval algorithms

  1991cited by this paper
• A comparison of two-poisson, inverse document frequency and discrimination value models of document representation

  1990cited by this paper
• Term-Weighting Approaches in Automatic Text Retrieval

  1988cited by this paper
• Approximations of the critical region of the fbietkan statistic

  1980cited by this paper
• Applied Linear Statistical Models

  1975cited by this paper
• Expected search length: A single measure of retrieval effectiveness based on the weak ordering action of retrieval systems

  1968cited by this paper
• Information Retrieval Systems.

  1963cited by this paper

• A transformer-based stacked ensemble framework for software defect prediction

  2026cites this paper
• UCS2GUI: GUIs generator from use case specification

  2026cites this paper
• My System Is As Effective As Yours: Reproducibility, Sustainability, and More

  2025cites this paper
• Evaluation of U-Net + + architectures in high resolution image classification for urban planning

  2025cites this paper
• Hierarchical text classification with enhanced graph encoding and dual-Natured text-label relationship

  2025cites this paper
• Predicting Course Grades Through Comprehensive Modeling of Students’ Learning Behavioral Patterns

  2025cites this paper
• Revisiting Relevance Feedback for CLIP-based Interactive Image Retrieval

  2024influential citation
• A Noise-Oriented and Redundancy-Aware Instance Selection Framework

  2024cites this paper
• Methods, Applications, and Directions of Learning-to-Rank in NLP Research

  2024cites this paper
• Local Hierarchy-Aware Text-Label Association for Hierarchical Text Classification

  2024influential citation
• Meta network attention-based feature matching for heterogeneous defect prediction

  2024cites this paper
• HLC: hierarchically-aware label correlation for hierarchical text classification

  2024cites this paper
• Modeling question difficulty for unbiased cognitive diagnosis: A causal perspective

  2024cites this paper
• Classification of MRI brain tumors based on registration preprocessing and deep belief networks

  2024cites this paper
• Modeling Text-Label Alignment for Hierarchical Text Classification

  2024cites this paper
• Evaluating and mitigating the impact of OCR errors on information retrieval

  2023cites this paper
• The MAP Metric in Information Retrieval Fault Localization

  2023cites this paper
• IR Systems Evaluation via Generalized Linear Models

  2023cites this paper
• Inference at Scale: Significance Testing for Large Search and Recommendation Experiments

  2023cites this paper
• How Discriminative Are Your Qrels? How To Study the Statistical Significance of Document Adjudication Methods

  2023cites this paper
• A Comparative Survey of Instance Selection Methods applied to Non-Neural and Transformer-Based Text Classification

  2023cites this paper
• Link-Driven Study to Enhance Text-Based Image Retrieval: Implicit Links Versus Explicit Links

  2023cites this paper
• How to do human evaluation: A brief introduction to user studies in NLP

  2023cites this paper
• TME: Tree-guided Multi-task Embedding Learning towards Semantic Venue Annotation

  2023influential citation
• An Effective, Efficient, and Scalable Confidence-based Instance Selection Framework for Transformer-Based Text Classification

  2023cites this paper
• An Intrinsic Framework of Information Retrieval Evaluation Measures

  2023cites this paper
• Pre-Trained Semantic Embeddings for POI Categories Based on Multiple Contexts

  2023influential citation
• Comparing ANOVA Approaches to Detect Significantly Different IR Systems

  2022cites this paper
• On the Cost-Effectiveness of Stacking of Neural and Non-Neural Methods for Text Classification: Scenarios and Performance Prediction

  2022cites this paper
• Q-Learning for Shift-Reduce Parsing in Indonesian Tree-LSTM-Based Text Generation

  2022cites this paper
• How Do You Test a Test?: A Multifaceted Examination of Significance Tests

  2022cites this paper
• Measuring user interactions with websites: A comparison of two industry standard analytics approaches using data of 86 websites

  2022cites this paper
• CAVE-SC: Inferring categories for venues using check-ins

  2022cites this paper
• Detecting Significant Differences Between Information Retrieval Systems via Generalized Linear Models

  2022cites this paper
• Linguistic Pattern–Infused Dual-Channel Bidirectional Long Short-term Memory With Attention for Dengue Case Summary Generation From the Program for Monitoring Emerging Diseases–Mail Database: Algorithm Development Study

  2022cites this paper
• Embedding Hierarchical Structures for Venue Category Representation

  2021influential citation
• Missing data imputation for traffic congestion data based on joint matrix factorization

  2021cites this paper
• Predicting Course Grade through Comprehensive Modelling of Students' Learning Behavioral Pattern

  2021cites this paper
• Summary Generation of Dengue Outbreaks from ProMED-mail Database using a Linguistic Pattern-infused Dual-channel BiLSTM (Preprint)

  2021cites this paper
• How do Metric Score Distributions affect the Type I Error Rate of Statistical Significance Tests in Information Retrieval?

  2021cites this paper
• Origin-Aware Location Prediction Based on Historical Vehicle Trajectories

  2021cites this paper
• Spelling Errors in Korean Students’ Constructed Responses and the Efficacy of Automatic Spelling Correction on Automated Computer Scoring

  2021cites this paper
• PR-LTTE: Link travel time estimation based on path recovery from large-scale incomplete trip data

  2021cites this paper
• A Fast and Exact Randomisation Test for Comparing Two Systems with Paired Data

  2021cites this paper
• Too few, too many, just right: Creating the necessary number of segments for large online customer populations

  2021cites this paper
• Defect count prediction via metric-based convolutional neural network

  2021cites this paper
• How to Do Human Evaluation: Best Practices for User Studies in NLP

  2021cites this paper
• Enabling the interpretability of pretrained venue representations using semantic categories

  2021cites this paper
• MS MARCO: Benchmarking Ranking Models in the Large-Data Regime

  2021cites this paper
• System Effect Estimation by Sharding: A Comparison Between ANOVA Approaches to Detect Significant Differences

  2021cites this paper
• On the cost-effectiveness of neural and non-neural approaches and representations for text classification: A comprehensive comparative study

  2021cites this paper
• Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales

  2021cites this paper
• Optimising HEP parameter fits via Monte Carlo weight derivative regression

  2020cites this paper
• Automatic Recognition of Children Engagement from Facial Video Using Convolutional Neural Networks

  2020cites this paper
• Personas and Analytics: A Comparative User Study of Efficiency and Effectiveness for a User Identification Task

  2020cites this paper
• Information Retrieval Technology: 15th Asia Information Retrieval Societies Conference, AIRS 2019, Hong Kong, China, November 7–9, 2019, Proceedings

  2020cites this paper
• Modeling Spatial Trajectories With Attribute Representation Learning

  2020cites this paper
• Exploiting Neural Query Translation into Cross Lingual Information Retrieval

  2020cites this paper
• Eating Healthier: Exploring Nutrition Information for Healthier Recipe Recommendation

  2020influential citation
• Tagging Reading Comprehension Materials With Document Extraction Attention Networks

  2020cites this paper
• Finding Useful Solutions in Online Knowledge Communities: A Theory-Driven Design and Multilevel Analysis

  2020cites this paper
• Document Translation vs. Query Translation for Cross-Lingual Information Retrieval in the Medical Domain

  2020cites this paper
• CEM: A Convolutional Embedding Model for Predicting Next Locations

  2020cites this paper
• Document/query expansion based on selecting significant concepts for context based retrieval of medical images

  2019cites this paper
• TraLFM: Latent Factor Modeling of Traffic Trajectory Data

  2019influential citation
• Enhancing intraday stock price manipulation detection by leveraging recurrent neural networks with ensemble learning

  2019cites this paper
• Term Selection for Query Expansion in Medical Cross-Lingual Information Retrieval

  2019cites this paper
• Text-based Medical Image Retrieval using Convolutional Neural Network and Specific Medical Features

  2019influential citation
• Using Collection Shards to Study Retrieval Performance Effect Sizes

  2019cites this paper
• Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors

  2019cites this paper
• The Evolution of Cranfield

  2019cites this paper
• GPS: Factorized group preference-based similarity models for sparse sequential recommendation

  2019cites this paper
• From Multilingual to Multimodal: The Evolution of CLEF over Two Decades

  2019cites this paper
• A Thorough exploitation of distance-based meta-features for Automated text classification

  2019cites this paper
• TTDM: A Travel Time Difference Model for Next Location Prediction

  2019cites this paper
• A Comparative Study between Possibilistic and Probabilistic Approaches for Query Translation Disambiguation

  2019cites this paper
• Using score distributions to compare statistical significance tests for information retrieval evaluation

  2019influential citation
• Towards Automatic Evaluation of Reused Answers in Community Question Answering

  2019cites this paper
• Automatic Generation of Initial Reading Lists: Requirements and Solutions

  2019influential citation
• The Correct Ways to Use Significance Tests

  2018cites this paper
• WordNet-Based Information Retrieval Using Common Hypernyms and Combined Features

  2018cites this paper
• Statistical Analysis of Results in Music Information Retrieval: Why and How

  2018cites this paper
• Topic Set Size Design for Paired and Unpaired Data

  2018cites this paper
• Exploiting recommendation confidence in decision-aware recommender systems

  2018cites this paper
• Mining microblogs for culture-awareness in web adaptation

  2018cites this paper
• Deep Unfolding for Topic Models

  2018cites this paper
• Laboratory Experiments in Information Retrieval

  2018cites this paper
• A Comparison of Android Reverse Engineering Tools via Program Behaviors Validation Based on Intermediate Languages Transformation

  2018cites this paper
• Analyse de requêtes en langue naturelle et extraction d'informations bibliographiques pour une recherche de livres orientée contenu efficace

  2017cites this paper
• Techniques for comparing and recommending conferences

  2017cites this paper
• But Is It Statistically Significant?: Statistical Significance in IR Research, 1995-2014

  2017cites this paper
• An Interval-Like Scale Property for I. R. Evaluation Measures

  2017cites this paper
• Determining threat status for data-limited fisheries based on catch-only stock assessment models

  2017cites this paper
• Data Mining Techniques for Mining Query Logs in Web Search Engines

  2017cites this paper
• Efficient and effective retrieval using Higher-Order proximity models

  2017cites this paper
• Evaluating the impact of MeSH (Medical Subject Headings) terms on different types of searchers

  2017cites this paper
• Using Replicates in Information Retrieval Evaluation

  2017cites this paper
• Effects of Stop Words Elimination for Arabic Information Retrieval: A Comparative Study

  2017cites this paper
• A Discriminative Possibilistic Approach for Query Translation Disambiguation

  2017cites this paper
• Towards a new possibilistic query translation tool for cross-language information retrieval

  2017cites this paper