Challenges of Reliable, Realistic and Comparable Active Learning Evaluation

No abstract is available for this paper.

• Publication year

  2017

• Venue

  IAL@PKDD/ECML

• Publication date

  2017-09-13

• Fields of study

  Computer Science, Education

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Active learning for penalized logistic regression via sequential experimental design

  2017cited by this paper
• Multi-Class Probabilistic Active Learning

  2016cited by this paper
• Active learning using transductive sparse Bayesian regression

  2016cited by this paper
• Lifelong Learning and Collaboration of Smart Technical Systems in Open-Ended Environments -- Opportunistic Collaborative Interactive Learning

  2016cited by this paper
• A Novel Uncertainty Sampling Algorithm for Cost-Sensitive Multiclass Active Learning

  2016cited by this paper
• From Active Learning to Dedicated Collaborative Interactive Learning

  2016cited by this paper
• An adaptive streaming active learning strategy based on instance weighting

  2016cited by this paper
• Active learning for sketch recognition

  2015cited by this paper
• Optimised probabilistic active learning ( OPAL ) For fast , non-myopic , cost-sensitive active classification

  2015cited by this paper
• Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization

  2015cited by this paper
• A Comparison Study on Ensemble Strategies and Feature Sets for Sentiment Analysis

  2015cited by this paper
• Optimised probabilistic active learning (OPAL)

  2015cited by this paper
• Scientific method: Statistical errors

  2014cited by this paper
• Active Learning: A Survey

  2014cited by this paper
• Active learning strategies for exploratory mobile recommender systems

  2014cited by this paper
• Active Learning for Support Vector Machines with Maximum Model Change

  2014cited by this paper
• OpenML: networked science in machine learning

  2014cited by this paper
• Probabilistic Active Learning: Towards Combining Versatility, Optimality and Efficiency

  2014cited by this paper
• A study on cost behaviors of binary classification measures in class-imbalanced problems

  2014cited by this paper
• Let us know your decision: Pool-based active training of a generative classifier with the selection strategy 4DS

  2013cited by this paper
• A survey on instance selection for active learning

  2012cited by this paper
• Scalable Active Learning for Multiclass Image Classification

  2012cited by this paper
• An Analysis of Performance Measures for Binary Classifiers

  2011cited by this paper
• Active learning for on-road vehicle detection: a comparative study

  2011cited by this paper
• Baseline Methods for Active Learning

  2011cited by this paper
• A Coherent Interpretation of AUC as a Measure of Aggregated Classification Performance

  2011cited by this paper
• Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images

  2011cited by this paper
• A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification

  2011cited by this paper
• Active Learning from Crowds

  2011cited by this paper
• Inspecting Sample Reusability for Active Learning

  2011cited by this paper
• Vuvuzelas & Active Learning for Online Classification

  2010cited by this paper
• Active Learning by Querying Informative and Representative Examples

  2010cited by this paper
• Active Learning for Networked Data

  2010cited by this paper
• Improving activity classification for health applications on mobile devices using active and semi-supervised learning

  2010cited by this paper
• Active Learning Methods for Electrocardiographic Signal Classification

  2010influential reference
• Measuring classifier performance: a coherent alternative to the area under the ROC curve

  2009cited by this paper
• An Intrinsic Stopping Criterion for Committee-Based Active Learning

  2009cited by this paper
• Active Dual Supervision: Reducing the Cost of Annotating Examples and Features

  2009cited by this paper
• Active Learning Literature Survey

  2009cited by this paper
• A stopping criterion for active learning

  2008cited by this paper
• Hierarchical sampling for active learning

  2008cited by this paper
• Bootstrap Methods: Another Look at the Jackknife

  2008cited by this paper
• Cost-Minimising Strategies for Data Labelling: Optimal Stopping and Active Learning

  2007cited by this paper
• Selective Supervision: Guiding Supervised Learning with Decision-Theoretic Active Learning

  2007cited by this paper
• Learning on the border: active learning in imbalanced data classification

  2007cited by this paper
• Active Learning for Parzen Window Classifier

  2005cited by this paper
• Incorporating Diversity in Active Learning with Support Vector Machines

  2003cited by this paper
• A sequential algorithm for training text classifiers

  1994cited by this paper
• Individual Comparisons by Ranking Methods

  1945cited by this paper
• Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Active Learning with Multi-Label SVM Classification

  year unknowninfluential reference

• Survey of Active Learning Hyperparameters: Insights from a Large-Scale Experimental Grid

  2025influential citation
• Actively evaluating and learning the distinctions that matter: Vaccine safety signal detection from emergency triage notes

  2025cites this paper
• Evidential uncertainty sampling strategies for active learning

  2024cites this paper
• Evidential uncertainty sampling for active learning

  2023cites this paper
• Towards Enhancing Deep Active Learning with Weak Supervision and Constrained Clustering

  2023cites this paper
• Mind the User! Measures to More Accurately Evaluate the Practical Value of Active Learning Strategies

  2023cites this paper
• ActiveGLAE: A Benchmark for Deep Active Learning with Transformers

  2023influential citation
• An Expanded Benchmark that Rediscovers and Affirms the Edge of Uncertainty Sampling for Active Learning in Tabular Datasets

  2023cites this paper
• OpenAL: Evaluation and Interpretation of Active Learning Strategies

  2023influential citation
• Improving Active Learning Performance through the Use of Data Augmentation

  2023cites this paper
• DADO – Low-Cost Query Strategies for Deep Active Design Optimization

  2023cites this paper
• Randomness is the Root of All Evil: More Reliable Evaluation of Deep Active Learning

  2023cites this paper
• DADO - Low-Cost Selection Strategies for Deep Active Design Optimization

  2023cites this paper
• A Stopping Criterion for Transductive Active Learning

  2022cites this paper
• Interactive Visual Explanation of Incremental Data Labeling

  2022cites this paper
• To Actively Initialize Active Learning

  2022cites this paper
• Practical Active Learning with Model Selection for Small Data

  2021cites this paper
• scikit-activeml: A Library and Toolbox for Active Learning Algorithms

  2021cites this paper
• Increasing the Effectiveness of Active Learning: Introducing Artificial Data Generation in Active Learning for Land Use/Land Cover Classification

  2021influential citation
• Hitting the target: stopping active learning at the cost-based optimum

  2021cites this paper
• QuestionComb: A Gamification Approach for the Visual Explanation of Linguistic Phenomena through Interactive Labeling

  2021cites this paper
• Active Class Selection with Uncertain Class Proportions

  2021cites this paper
• Improving Self-Adaptation For Multi-Sensor Activity Recognition with Active Learning

  2020cites this paper
• Learning Active Learning at the Crossroads? Evaluation and Discussion

  2020cites this paper
• Rebuilding Trust in Active Learning with Actionable Metrics

  2020influential citation
• User-Centric Active Learning for Outlier Detection

  2020cites this paper
• Interactive visual labelling versus active learning: an experimental comparison

  2020cites this paper
• Limitations of Assessing Active Learning Performance at Runtime

  2019cites this paper
• Validating one-class active learning with user studies – A prototype and open challenges

  2019cites this paper
• An Overview and a Benchmark of Active Learning for One-Class Classification

  2018cites this paper
• Automated Active Learning with a Robot

  2018cites this paper
• An overview and a benchmark of active learning for outlier detection with one-class classifiers

  2018cites this paper
• The Other Human in The Loop – A Pilot Study to Find Selection Strategies for Active Learning

  2018cites this paper
• Active Sorting – An Efficient Training of a Sorting Robot with Active Learning Techniques

  2018cites this paper
• Towards User‐Centered Active Learning Algorithms

  2018cites this paper