Sequential testing in classifier evaluation yields biased estimates of effectiveness

No abstract is available for this paper.

• Publication year

  2013

• Venue

  Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

• Publication date

  2013-07-28

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/2484028.2484159
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Approximate Recall Confidence Intervals

  2012cited by this paper
• Training linear SVMs in linear time

  2006influential reference
• A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation

  2005cited by this paper
• RCV1: A New Benchmark Collection for Text Categorization Research

  2004cited by this paper
• Algorithmic Stability and Sanity-Check Bounds for Leave-One-Out Cross-Validation

  1997cited by this paper
• Evaluating and optimizing autonomous text classification systems

  1995cited by this paper
• Rigorous learning curve bounds from statistical mechanics

  1994cited by this paper
• Sequential Analysis: Tests and Confidence Intervals

  1985cited by this paper
• Bibliography on estimation of misclassification

  1974cited by this paper
• Sequential Methods in Statistics

  1966cited by this paper

• A New Text Compression Algorithm Based on Index Permutation and Suffix Coding

  2025cites this paper
• Confidence Sequences for Evaluating One-Phase Technology-Assisted Review

  2023cites this paper
• Heuristic stopping rules for technology-assisted review

  2021cites this paper
• Certifying One-Phase Technology-Assisted Reviews

  2021cites this paper
• When to Stop Reviewing in Technology-Assisted Reviews

  2020cites this paper
• UvA-DARE (Digital Academic Repository) When to Stop Reviewing in Technology-Assisted Reviews Sampling from an Adaptive Distribution to Estimate Residual Relevant Documents

  2020cites this paper
• Effective collection construction for information retrieval evaluation and optimization

  2020cites this paper
• UvA-DARE (Digital Academic Repository) When to Stop Reviewing in Technology-Assisted Reviews Sampling from an Adaptive Distribution to Estimate Residual Relevant Documents

  2020cites this paper
• Increasing the Efficiency of High-Recall Information Retrieval

  2019cites this paper
• Stochastic Simulation of Test Collections: Evaluation Scores

  2018cites this paper
• Enhancing the Effectiveness of Information Retrieval Systems

  2017cites this paper
• On Design and Evaluation of High-Recall Retrieval Systems for Electronic Discovery

  2017cites this paper
• Scalability of Continuous Active Learning for Reliable High-Recall Text Classification

  2016cites this paper
• Draft Submitted for publication in PERSPECTIVES

  2015cites this paper
• Multi-Faceted Recall of Continuous Active Learning for Technology-Assisted Review

  2015cites this paper
• Comments on “ The Implications of Rule 26 ( g ) on the Use of Technology-Assisted Review ”

  2014cites this paper
• Towards minimizing the annotation cost of certified text classification

  2013influential citation
• UvA-DARE (Digital Academic Repository) When to Stop Reviewing in Technology-Assisted Reviews Sampling from an Adaptive Distribution to Estimate Residual Relevant Documents

  year unknowncites this paper