Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement

No abstract is available for this paper.

• Publication year

  2010

• Venue

  SKDD

• Publication date

  2010-11-09

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/1882471.1882479
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Data Mining: Foundations and Intelligent Paradigms

  2012cited by this paper
• The WEKA data mining software: an update

  2009influential reference
• BNS feature scaling: an improved representation over tf-idf for svm text classification

  2008cited by this paper
• YALE: rapid prototyping for complex data mining tasks

  2006cited by this paper
• RCV1: A New Benchmark Collection for Text Categorization Research

  2004cited by this paper
• Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.

  1999cited by this paper
• A comparison of two learning algorithms for text categorization

  1994cited by this paper

• Multimodal machine learning for video based single question mental health assessment

  2025cites this paper
• Optimizing Memory Allocation in Distributed Clusters with Predictive Modeling

  2025cites this paper
• The European Forest Disturbance Atlas: a forest disturbance monitoring system using the Landsat archive

  2025cites this paper
• Discriminative ability, responsiveness, and interpretability of smoothness index of gait in people with multiple sclerosis

  2025cites this paper
• Restoring data balance via generative models of T cell receptors for antigen-binding prediction

  2025cites this paper
• VitroBert: modeling DILI by pretraining BERT on in vitro data

  2025cites this paper
• ‘Machine Learning’ multiclassification for stage diagnosis of Alzheimer’s disease utilizing augmented blood gene expression and feature fusion

  2025cites this paper
• ASAudio: A Survey of Advanced Spatial Audio Research

  2025cites this paper
• Development of an integrated searching system for rapid and accurate classification of edible oils by matrix-assisted laser desorption/ionization mass spectrometry.

  2025cites this paper
• Lessons from the trenches on evaluating machine-learning systems in materials science

  2025cites this paper
• Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost

  2025cites this paper
• Impacts of Data Splitting Strategies on Parameterized Link Prediction Algorithms

  2025cites this paper
• Deep Learning-Enhanced Diagnosis of Sow Pregnancy Through Low-Frequency Ultrasound Imaging

  2025cites this paper
• Development of Stacking Ensemble Machine Learning Algorithm for Fish Species Classification

  2025cites this paper
• Enhancing Mode-Choice Models with Conformal Prediction: Uncertainty Quantification and Decision Support Using Tree-Based Machine Learning

  2025cites this paper
• Intelligent Network Intrusion Detection Using ML With Hybrid XGBoost and Anomaly Fusion

  2025cites this paper
• Exploring the Utilities of the Rationales from Large Language Models to Enhance Automated Essay Scoring

  2025cites this paper
• Automated Segmentation of Subretinal Fluid from OCT: A Vision Transformer Approach with Cross-Validation

  2025influential citation
• Learning Software Bug Reports: A Systematic Literature Review

  2025cites this paper
• Relative Code Comprehensibility Prediction

  2025cites this paper
• Public Perceptions of Telegram’s Association with Illicit Activities: A Sentiment Analysis Using VADER and Machine Learning

  2025cites this paper
• Data-Driven Development of Occupancy Profiles: A Detailed Analysis of Key Influencing Factors

  2025cites this paper
• The Sweet Danger of Sugar: Debunking Representation Learning for Encrypted Traffic Classification

  2025cites this paper
• High-content microscopy and machine learning characterize a cell morphology signature of NF1 genotype in Schwann cells

  2025cites this paper
• Assessing external validity in practice

  2024cites this paper
• Integrated drug response prediction models pinpoint repurposed drugs with effectiveness against rhabdomyosarcoma

  2024cites this paper
• Machine learning for surficial geologic mapping

  2024cites this paper
• Evaluating deep learning methods applied to Landsat time series subsequences to detect and classify boreal forest disturbances events: The challenge of partial and progressive disturbances

  2024cites this paper
• GeM-LR: Discovering predictive biomarkers for small datasets in vaccine studies

  2024cites this paper
• METAPHOR: Metabolic evaluation through phasor-based hyperspectral imaging and organelle recognition for mouse blastocysts and oocytes

  2024cites this paper
• Infectious risk events and their novelty in event-based surveillance: new definitions and annotated corpus

  2024cites this paper
• Data-Driven Prediction and Uncertainty Quantification of PWR Crud-Induced Power Shift Using Convolutional Neural Networks

  2024cites this paper
• Convolutional neural network-based real-time mosquito genus identification using wingbeat frequency: A binary and multiclass classification approach

  2024cites this paper
• AALF: Almost Always Linear Forecasting

  2024cites this paper
• The spatial structure of the tumor immune microenvironment can explain and predict patient response in high-grade serous carcinoma

  2024cites this paper
• Next-generation fall detection: harnessing human pose estimation and transformer technology

  2024cites this paper
• Bioactivity predictions and virtual screening using machine learning predictive model

  2024cites this paper
• Using Vital Signs for the Early Prediction of Necrotizing Enterocolitis in Preterm Neonates with Machine Learning

  2024cites this paper
• Estimator for generalization performance of machine learning model trained by biased data collected from multiple references

  2023cites this paper
• Estimating ground reaction force with novel carbon nanotube-based textile insole pressure sensors

  2023cites this paper
• Predicting the presence of tinnitus using ecological momentary assessments

  2023cites this paper
• Early Warning Software for Emergency Department Crowding

  2023cites this paper
• A Comparative Study of the Use of Stratified Cross-Validation and Distribution-Balanced Stratified Cross-Validation in Imbalanced Learning

  2023cites this paper
• Robust classification using average correlations as features (ACF)

  2023cites this paper
• Towards Learning to Discover Money Laundering Sub-network in Massive Transaction Network

  2023cites this paper
• ON THE EFFECTIVENESS OF PARAGRAPH VECTOR MODELS IN DOCUMENT SIMILARITY ESTIMATION FOR TURKISH NEWS CATEGORIZATION

  2023cites this paper
• HMSS2: an advanced tool for the analysis of sulfur metabolism, including organosulfur compound transformation, in genome and metagenome assemblies

  2023cites this paper
• Classifying Malignancy in Prostate Glandular Structures from Biopsy Scans with Deep Learning

  2023cites this paper
• Bag of Words and Embedding Text Representation Methods for Medical Article Classification

  2023cites this paper
• On Scene Injury Severity Prediction (OSISP) model for trauma developed using the Swedish Trauma Registry

  2023cites this paper
• Random forest kernel for high-dimension low sample size classification

  2023cites this paper
• Mapping Underwater Aquatic Vegetation Using Foundation Models With Air- and Space-Borne Images: The Case of Polyphytos Lake

  2023cites this paper
• A Meta-dataset of German Medical Corpora: Harmonization of Annotations and Cross-corpus NER Evaluation

  2023cites this paper
• HMSS2: An advanced tool for the analysis of sulphur metabolism, including organosulphur compound transformation, in genome and metagenome assemblies

  2023cites this paper
• Integrative bioinformatics and artificial intelligence analyses of transcriptomics data identified genes associated with major depressive disorders including NRG1

  2023cites this paper
• DeepGAMI: deep biologically guided auxiliary learning for multimodal integration and imputation to improve genotype–phenotype prediction

  2023cites this paper
• Novel Method of Characterization of Heart Disease Prediction Using Sequential Feature Selection-Based Ensemble Technique

  2023cites this paper
• Classification tree analysis to evaluate the most useful magnetic resonance image type in the differentiation between early and progressed hepatocellular carcinoma

  2023cites this paper
• GEMTELLIGENCE: Accelerating gemstone classification with deep learning

  2023cites this paper
• Real-Time Wildfire Detection Algorithm Based on VIIRS Fire Product and Himawari-8 Data

  2023cites this paper
• Analysis and Prediction of Apple’s iphone Sales and Factors Causing Downfall using Deep Learning Techniques

  2023cites this paper
• Which data subset should be augmented for deep learning? a simulation study using urothelial cell carcinoma histopathology images

  2023cites this paper
• FSA-IDS: A Flow-based Self-Active Intrusion Detection System

  2023influential citation
• Modelling assistants based on information reuse: a user evaluation for language engineering

  2023cites this paper
• Identification of Indoor Radio Environment Properties from Channel Impulse Response with Machine Learning Models

  2023cites this paper
• Energy Theft Detection in Smart Grids via Explainable Attention Maps

  2023cites this paper
• Anomaly detection in sleep: detecting mouth breathing in children

  2023cites this paper
• Network traffic analysis through node behaviour classification: a graph-based approach with temporal dissection and data-level preprocessing

  2022cites this paper
• Characterizing polarization in online vaccine discourse—A large-scale study

  2022cites this paper
• Word Embeddings for Automatic Equalization in Audio Mixing

  2022cites this paper
• A systematic comparative evaluation of machine learning classifiers and discrete choice models for travel mode choice in the presence of response heterogeneity

  2022cites this paper
• A Decision Support System for the Identification of Metastases of Metastatic Melanoma Using Whole-Body FDG PET/CT Images

  2022cites this paper
• Machine trainable software models towards a cognitive thinking AI with the natural language processing platform NLX

  2022cites this paper
• A Statistical Learning Approach to Evaluate Factors Associated With Post-Traumatic Stress Symptoms in Physicians: Insights From the COVID-19 Pandemic

  2022cites this paper
• Quicksort leave-pair-out cross-validation for ROC curve analysis

  2022cites this paper
• Towards Reliable Baselines for Document-Level Sentiment Analysis in the Czech and Slovak Languages

  2022cites this paper
• Reliability Analysis for Finger Movement Recognition With Raw Electromyographic Signal by Evidential Convolutional Networks

  2022cites this paper
• Data Leakage and Evaluation Issues in Micro-Expression Analysis

  2022influential citation
• A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2

  2022cites this paper
• Predicting ACL Injury Using Machine Learning on Data From an Extensive Screening Test Battery of 880 Female Elite Athletes

  2022cites this paper
• Self-admitted technical debt in R: detection and causes

  2022cites this paper
• Endorectal ultrasound radiomics in locally advanced rectal cancer patients: despeckling and radiotherapy response prediction using machine learning

  2022cites this paper
• On the use of evaluation measures for defect prediction studies

  2022cites this paper
• Machine learning-based prediction of massive perioperative allogeneic blood transfusion in cardiac surgery

  2022cites this paper
• Benchmarking Deep Learning Models for Tooth Structure Segmentation

  2022cites this paper
• Detecting Suicide Risk in Online Counseling Services: A Study in a Low-Resource Language

  2022cites this paper
• Predictors Using Machine Learning of Complete Peroneal Nerve Palsy Recovery After Multiligamentous Knee Injury: A Multicenter Retrospective Cohort Study

  2022cites this paper
• Using forensic analytics and machine learning to detect bribe payments in regime-switching environments: Evidence from the India demonetization

  2022cites this paper
• Öğrenme Yönetim Sistemi Log Kayıtlarının Akademik Başarı Tahmininde Kullanılması

  2022cites this paper
• Improvements in Patch-Based Machine Learning for Analyzing Three-Dimensional Seismic Sequence Data

  2022cites this paper
• Data Augmentation in Machine Learning for Cheating Detection in Large-Scale Assessment: An Illustration with the Blending Ensemble Learning Algorithm

  2022cites this paper
• Why only Micro-F1? Class Weighting of Measures for Relation Classification

  2022cites this paper
• Predictive Modeling of Mental Illness Onset Using Wearable Devices and Medical Examination Data: Machine Learning Approach

  2022cites this paper
• Exploration of the Stacking Ensemble Machine Learning Algorithm for Cheating Detection in Large-Scale Assessment

  2022cites this paper
• HMS‐S‐S: A tool for the identification of Sulphur metabolism‐related genes and analysis of operon structures in genome and metagenome assemblies

  2022cites this paper
• Evaluation of Low-cost Air Quality Sensor Calibration Models

  2022cites this paper
• Extending electronic medical records vector models with knowledge graphs to improve hospitalization prediction

  2022cites this paper
• Habitat classification from satellite observations with sparse annotations

  2022cites this paper
• Trade-offs in Sampling and Search for Early-stage Interactive Text Classification

  2022cites this paper
• Are You Misinformed? A Study of Covid-Related Fake News in Bengali on Facebook

  2022cites this paper