An empirical assessment of validation practices for molecular classifiers

No abstract is available for this paper.

• Publication year

  2011

• Venue

  Briefings Bioinform.

• Publication date

  2011-02-07

• Fields of study

  Biology, Medicine, Computer Science

• Identifiers
  DOI 10.1093/bib/bbq073PMID 21300697PMCID PMC3088312
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• ISI Web of Knowledge.

  2013cited by this paper
• Fish oil slows prostate cancer xenograft growth relative to other dietary fats and is associated with decreased mitochondrial and insulin pathway gene expression

  2013cited by this paper
• Expectations, validity, and reality in gene expression profiling.

  2010cited by this paper
• Reporting bias when using real data sets to analyze classification performance

  2010cited by this paper
• Prospective Comparison of Clinical and Genomic Multivariate Predictors of Response to Neoadjuvant Chemotherapy in Breast Cancer

  2010cited by this paper
• Over-optimism in bioinformatics: an illustration

  2010cited by this paper
• Expectations, validity, and reality in omics.

  2010cited by this paper
• Accurate prediction of repeat prostate biopsy outcomes by a mitochondrial DNA deletion assay

  2010cited by this paper
• Exonic expression profiling of breast cancer and benign lesions: a retrospective analysis.

  2009cited by this paper
• Identification of two new serum protein profiles for renal cell carcinoma.

  2009cited by this paper
• Bmc Medical Research Methodology Open Access Optimal Classifier Selection and Negative Bias in Error Rate Estimation: an Empirical Study on High-dimensional Prediction

  2009influential reference
• Highly sensitive detection of melanoma based on serum proteomic profiling

  2009cited by this paper
• A multi-marker assay to distinguish malignant melanomas from benign nevi

  2009cited by this paper
• Mostly, your results matter to others

  2009cited by this paper
• A user-centred evaluation framework for the Sealife semantic web browsers

  2009cited by this paper
• Proteomic expression signature distinguishes cancerous and nonmalignant tissues in hepatocellular carcinoma.

  2009cited by this paper
• Multi-SNP pharmacogenomic classifier is superior to single-SNP models for predicting drug outcome in complex diseases

  2009cited by this paper
• Repeatability of published microarray gene expression analyses

  2009cited by this paper
• A method for constructing a confidence bound for the actual error rate of a prediction rule in high dimensions.

  2009cited by this paper
• A subtype of childhood acute lymphoblastic leukaemia with poor treatment outcome: a genome-wide classification study.

  2009cited by this paper
• Serum biomarkers of vascular cognitive impairment evaluated by bead-based proteomic technology.

  2009cited by this paper
• Discovery of the gene signature for acute lung injury in patients with sepsis.

  2009cited by this paper
• An Eight-Gene Blood Expression Profile Predicts the Response to Infliximab in Rheumatoid Arthritis

  2009cited by this paper
• Outcome prediction based on microarray analysis: a critical perspective on methods

  2009cited by this paper
• Gene expression profiles in peripheral blood mononuclear cells can distinguish patients with non-small cell lung cancer from patients with nonmalignant lung disease.

  2009cited by this paper
• Identification of a unique urinary biomarker profile in patients with autosomal dominant polycystic kidney disease.

  2009cited by this paper
• Overinterpretation of clinical applicability in molecular diagnostic research.

  2009cited by this paper
• Cytosolic N-terminal arginine-based signals together with a luminal signal target a type II membrane protein to the plant ER

  2009cited by this paper
• Prediction of relapse in paediatric pre‐B acute lymphoblastic leukaemia using a three‐gene risk index

  2008cited by this paper
• Validation of Biomarker-Based Risk Prediction Models

  2008cited by this paper
• Diagnosis of gastric cancer using near-infrared Raman spectroscopy and classification and regression tree techniques.

  2008cited by this paper
• Mitochondrial genome deletion aids in the identification of false- and true-negative prostate needle core biopsy specimens.

  2008cited by this paper
• Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias

  2008cited by this paper
• Bmc Medical Informatics and Decision Making Logical Analysis of Data (lad) Model for the Early Diagnosis of Acute Ischemic Stroke

  2008cited by this paper
• Prediction of lymphatic metastasis based on gene expression profile analysis after brachytherapy for early-stage oral tongue carcinoma.

  2008cited by this paper
• Does the 3‐gene diagnostic assay accurately distinguish benign from malignant thyroid neoplasms?

  2008cited by this paper
• Classification based upon gene expression data: bias and precision of error rates

  2007cited by this paper
• Uncertainty in heterogeneity estimates in meta-analyses

  2007cited by this paper
• Gene Expression Signature in Peripheral Blood Detects Thoracic Aortic Aneurysm

  2007cited by this paper
• Autoantibody profiles reveal ubiquilin 1 as a humoral immune response target in lung adenocarcinoma.

  2007cited by this paper
• Is molecular profiling ready for use in clinical decision making?

  2007cited by this paper
• Critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting.

  2007cited by this paper
• Appropriateness of some resampling‐based inference procedures for assessing performance of prognostic classifiers derived from microarray data

  2007influential reference
• Panel of serum biomarkers for the diagnosis of lung cancer.

  2007cited by this paper
• An integrated genomic-based approach to individualized treatment of patients with advanced-stage ovarian cancer.

  2007cited by this paper
• Serum proteome profiling detects myelodysplastic syndromes and identifies CXC chemokine ligands 4 and 7 as markers for advanced disease

  2007cited by this paper
• The case of the misleading funnel plot

  2006cited by this paper
• Bias in error estimation when using cross-validation for model selection

  2006cited by this paper
• Pharmacogenomic predictor of sensitivity to preoperative chemotherapy with paclitaxel and fluorouracil, doxorubicin, and cyclophosphamide in breast cancer.

  2006cited by this paper
• Urinary biomarker profiling in transitional cell carcinoma

  2006cited by this paper
• A Rapid, Fully Automated, Molecular-Based Assay Accurately Analyzes Sentinel Lymph Nodes for the Presence of Metastatic Breast Cancer

  2006cited by this paper
• Evidence of bias and variation in diagnostic accuracy studies

  2006cited by this paper
• Molecular profiling of platinum resistant ovarian cancer

  2006cited by this paper
• Identification of a Gene Signature for Rapid Screening of Oral Squamous Cell Carcinoma

  2006cited by this paper
• Gene Expression Profile Associated with Response to Doxorubicin-Based Therapy in Breast Cancer

  2005cited by this paper
• Prediction error estimation: a comparison of resampling methods

  2005cited by this paper
• Roadmap for developing and validating therapeutically relevant genomic classifiers.

  2005influential reference
• REporting recommendations for tumor MARKer prognostic studies (REMARK)

  2005cited by this paper
• Molecular staging of lymph nodes from patients with esophageal adenocarcinoma.

  2005cited by this paper
• Gene expression profiling in follicular lymphoma to assess clinical aggressiveness and to guide the choice of treatment.

  2005cited by this paper
• Possible Prediction of Chemoradiosensitivity of Esophageal Cancer by Serum Protein Profiling

  2005cited by this paper
• Genetic classification of benign and malignant thyroid follicular neoplasia based on a three-gene combination.

  2005cited by this paper
• Microarrays and molecular research: noise discovery?

  2005cited by this paper
• Gene expression profiles predict complete pathologic response to neoadjuvant paclitaxel and fluorouracil, doxorubicin, and cyclophosphamide chemotherapy in breast cancer.

  2004cited by this paper
• Analysis of serum proteomic patterns for early cancer diagnosis: drawing attention to potential problems.

  2004cited by this paper
• Is cross-validation valid for small-sample microarray classification?

  2004cited by this paper
• Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments

  2004cited by this paper
• Three Biomarkers Identified from Serum Proteomic Analysis for the Detection of Early Stage Ovarian Cancer

  2004cited by this paper
• Predictive ability of DNA microarrays for cancer outcomes and correlates: an empirical assessment.

  2003cited by this paper
• Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification.

  2003cited by this paper
• Class prediction and discovery using gene microarray and proteomics mass spectroscopy data: curses, caveats, cautions

  2003cited by this paper
• The diagnostic odds ratio: a single indicator of test performance.

  2003cited by this paper
• Improved tests for a random effects meta‐regression with a single covariate

  2003cited by this paper
• Interaction revisited: the difference between two estimates

  2003cited by this paper
• How should meta‐regression analyses be undertaken and interpreted?

  2002cited by this paper
• Quantifying heterogeneity in a meta‐analysis

  2002cited by this paper
• Power by Simulation

  2002cited by this paper
• Gene expression profiling predicts clinical outcome of breast cancer

  2002cited by this paper
• Selection bias in gene extraction on the basis of microarray gene-expression data

  2002influential reference
• Stata Statistical Software: Release 7.

  2001cited by this paper
• The odds ratio

  2000cited by this paper
• Empirical evidence of design-related bias in studies of diagnostic tests.

  1999cited by this paper
• Meta-analysis in clinical trials.

  1986cited by this paper
• Problems of spectrum and bias in evaluating the efficacy of diagnostic tests.

  1978cited by this paper
• The combination of estimates from different experiments.

  1954cited by this paper
• Array of hope

  year unknowncited by this paper

• Independent Validation of Population-Specific Equations for Sex and Stature Estimation from the Humerus in Northeastern Thailand

  2026influential citation
• What is “accuracy”? Rethinking machine learning classifier performance metrics for highly imbalanced, high variance, zero‐inflated species count data

  2025cites this paper
• Mass spectrometry-based proteomics of FFPE tissues: progress, limitations, and clinical translation barriers

  2025cites this paper
• Multivariable Prediction Models for Atrial Fibrillation after Cardiac Surgery: A Systematic Review and Critical Appraisal.

  2025cites this paper
• microRNA Biomarkers in Paediatric Infection Diagnostics—Bridging the Gap Between Evidence and Clinical Application: A Scoping Review

  2025cites this paper
• Large language models enable tumor-type classification and localization of cancers of unknown primary from genomic data

  2025cites this paper
• Prediction of Deleterious Single Amino Acid Polymorphisms with a Consensus Holdout Sampler

  2024cites this paper
• Blood-based biomarkers and novel technologies for the diagnosis of colorectal cancer and adenomas: a narrative review.

  2024cites this paper
• Role of diagnostic tests for sepsis in children: a review

  2024cites this paper
• Computational Tools to Assist in Analyzing Effects of the SERPINA1 Gene Variation on Alpha-1 Antitrypsin (AAT)

  2024cites this paper
• Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness

  2024cites this paper
• BayesAge 2.0: a maximum likelihood algorithm to predict transcriptomic age

  2024cites this paper
• SERS microscopy as a tool for comprehensive biochemical characterization in complex samples.

  2024cites this paper
• The impact of sources of heterogeneity on accuracy of genomic prediction

  2023cites this paper
• Predictive Performance of Cell-Free Nucleic Acid-Based Multi-Cancer Early Detection Tests: A Systematic Review.

  2023cites this paper
• Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): Explanation and Elaboration. Translation into Russian

  2023cites this paper
• Multilingual RECIST classification of radiology reports using supervised learning

  2023cites this paper
• Selection of optimal validation methods for quantitative structure–activity relationships and applicability domain

  2023cites this paper
• Addressing Noise and Estimating Uncertainty in Biomedical Data through the Exploration of Chemical Space

  2022cites this paper
• Access to ground truth at unconstrained size makes simulated data as indispensable as experimental data for bioinformatics methods development and benchmarking

  2022cites this paper
• Multi-Study Boosting: Theoretical Considerations for Merging vs. Ensembling

  2022cites this paper
• Generalizing predictions to unseen sequencing profiles via deep generative models

  2022cites this paper
• Clinical prediction models in psychiatry: a systematic review of two decades of progress and challenges

  2022cites this paper
• Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration. Russian translation

  2022cites this paper
• Predicting genotoxicity of viral vectors for stem cell gene therapy using gene expression-based machine learning

  2021cites this paper
• Development and validation of a dynamic 48-hour in-hospital mortality risk stratification for COVID-19 in a UK teaching hospital: a retrospective cohort study

  2021cites this paper
• Development and validation of a dynamic 48-hour in-hospital prognostic risk stratification for COVID-19 in a UK teaching hospital: a retrospective cohort study

  2021cites this paper
• Sex Difference In Identification Of Predictive Tumor Tissue Metabolites Associated With Colorectal Cancer Prognosis

  2021cites this paper
• Prognostic Models Predicting Mortality in Preterm Infants: Systematic Review and Meta-analysis

  2021cites this paper
• Prediction of Hereditary Cancers Using Neural Networks

  2021cites this paper
• Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness

  2020cites this paper
• Large-scale benchmark study of survival prediction methods using multi-omics data

  2020cites this paper
• Gene Networks Constructed Through Simulated Treatment Learning can Predict Proteasome Inhibitor Benefit in Multiple Myeloma

  2020cites this paper
• Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness

  2020cites this paper
• Merging versus Ensembling in Multi-Study Machine Learning: Theoretical Insight from Random Effects

  2019cites this paper
• Combining elemental analysis of toenails and machine learning techniques as a non-invasive diagnostic tool for the robust classification of type-2 diabetes

  2019cites this paper
• A robust gene expression signature to predict proteasome inhibitor benefit in Multiple 1 Myeloma 2

  2019cites this paper
• A robust gene expression signature to predict proteasome inhibitor benefit in Multiple Myeloma

  2019cites this paper
• A decision-theoretic approach to the evaluation of machine learning algorithms in computational drug discovery

  2019cites this paper
• Merging versus Ensembling in Multi-Study Prediction: Theoretical Insight from Random Effects

  2019cites this paper
• PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration

  2019cites this paper
• Variable selection and validation in multivariate modelling

  2018cites this paper
• Big Data in Public Health: Terminology, Machine Learning, and Privacy.

  2018cites this paper
• Challenges and emergent solutions for LC-MS/MS based untargeted metabolomics in diseases.

  2018cites this paper
• The impact of different sources of heterogeneity on loss of accuracy from genomic prediction models

  2018cites this paper
• Machine learning and AI research for Patient Benefit: 20 Critical Questions on Transparency, Replicability, Ethics and Effectiveness

  2018cites this paper
• A data-driven interactome of synergistic genes improves network-based cancer outcome prediction

  2018cites this paper
• A decision theoretic approach to model evaluation in computational drug discovery

  2018cites this paper
• Statistical Inference in High‐Dimensional Omics Data

  2018cites this paper
• Waste, Leaks, and Failures in the Biomarker Pipeline.

  2017cites this paper
• Developing the Evidence to Support Clinical Use of Genomics

  2017cites this paper
• Is Bootstrapping Sufficient for Validating a Risk Model for Selection of Participants for a Lung Cancer Screening Program?

  2017cites this paper
• A comparative Study of Machine Learning Classifiers over Gene expressions towards Cardio Vascular Diseases Prediction

  2017cites this paper
• Molecular Diagnostics of Ageing and Tackling Age-related Disease.

  2017cites this paper
• Biomarker Guidelines for High-Dimensional Genomic Studies in Transplantation: Adding Method to the Madness

  2017cites this paper
• Platform-independent gene expression signature differentiates sessile serrated adenomas/polyps and hyperplastic polyps of the colon

  2017cites this paper
• Characteristics and Validation Techniques for PCA-Based Gene-Expression Signatures

  2017cites this paper
• Modèles d'appariement du greffon à son hôte, gestion de file d'attente et évaluation du bénéfice de survie en transplantation hépatique à partir de la base nationale de l'Agence de la Biomédecine.

  2017cites this paper
• Emerging applications of metabolomics in drug discovery and precision medicine

  2016cites this paper
• Exploitation de méthodes biostatistiques factorielles pour l'investigation de la relation nutrition-cancer dans la cohorte Européenne sur le Cancer et la Nutrition (EPIC)

  2016cites this paper
• Boulesteix Improving cross-study prediction through addon batch effect adjustment and addon normalization

  2016cites this paper
• Development of a "Cytology-on-Chip" Sensor for Monitoring Potentially Malignant Oral Lesions

  2016cites this paper
• 'Cytology-on-a-chip' based sensors for monitoring of potentially malignant oral lesions.

  2016cites this paper
• COPD subtypes identified by network-based clustering of blood gene expression.

  2016cites this paper
• Improving cross‐study prediction through addon batch effect adjustment or addon normalization

  2016cites this paper
• Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and

  2015cites this paper
• Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration

  2015cites this paper
• Analytical strategies for studying stem cell metabolism

  2015cites this paper
• Scalable Feature Selection Applications for Genome-Wide Association Studies of Complex Diseases

  2015cites this paper
• Statistical flaws in the development of a prediction model.

  2015cites this paper
• A Five-Gene Hedgehog Signature Developed as a Patient Preselection Tool for Hedgehog Inhibitor Therapy in Medulloblastoma

  2014cites this paper
• Increasing value and reducing waste in research design, conduct, and analysis.

  2014cites this paper
• Biomarkers, Genetic Association, and Genomic Studies

  2014cites this paper
• Added predictive value of omics data: specific issues related to validation illustrated by two case studies

  2014cites this paper
• Cross-study validation for the assessment of prediction algorithms

  2014cites this paper
• Design and analysis of metabolomics studies in epidemiologic research: a primer on -omic technologies.

  2014cites this paper
• Investigating the prediction ability of survival models based on both clinical and omics data: two case studies

  2014cites this paper
• PredictSNP: Robust and Accurate Consensus Classifier for Prediction of Disease-Related Mutations

  2014cites this paper
• An Introduction to Feature Selection

  2013cites this paper
• Remedies for Severe Class Imbalance

  2013cites this paper
• Factors That Can Affect Model Performance

  2013cites this paper
• Applied Predictive Modeling

  2013cites this paper
• Linear Regression and Its Cousins

  2013cites this paper
• Potentials and pitfalls of clinical peptidomics and metabolomics.

  2013cites this paper
• An industry statistician's perspective on PHC drug development.

  2013cites this paper
• A Short Tour of the Predictive Modeling Process

  2013cites this paper
• Genetic variants and their interactions in disease risk prediction – machine learning and network perspectives

  2013cites this paper
• Clinical outcome prediction by microRNAs in human cancer: a systematic review.

  2012cites this paper
• Why your new cancer biomarker may never work: recurrent patterns and remarkable diversity in biomarker failures.

  2012cites this paper
• Transcriptomics: mRNA and alternative splicing.

  2012cites this paper
• Multi-Analyte Network Markers for Tumor Prognosis

  2012cites this paper
• Performance reproducibility index for classification

  2012cites this paper
• Opportunities and Challenges for Selected Emerging Technologies in Cancer Epidemiology: Mitochondrial, Epigenomic, Metabolomic, and Telomerase Profiling

  2012cites this paper
• Comparison and evaluation of pathway-level aggregation methods of gene expression data

  2012cites this paper
• Towards a gold standard: regarding quality in public domain chemistry databases and approaches to improving the situation.

  2012cites this paper
• STrengthening the Reporting of OBservational studies in Epidemiology – Molecular Epidemiology (STROBE-ME): An Extension of the STROBE Statement

  2011cites this paper
• Improving Validation Practices in “Omics” Research

  2011cites this paper
• A roadmap for successful applications of clinical proteomics

  2011cites this paper
• STrengthening the Reporting of OBservational studies in Epidemiology--Molecular Epidemiology (STROBE-ME): an extension of the STROBE statement.

  2011cites this paper
• STrengthening the Reporting of OBservational studies in Epidemiology: Molecular Epidemiology STROBE-ME. An extension of the STROBE statement

  2011cites this paper