Testing for improvement in prediction model performance

No abstract is available for this paper.

• Publication year

  2013

• Venue

  Statistics in Medicine

• Publication date

  2013-04-30

• Fields of study

  Mathematics, Medicine

• Identifiers
  DOI 10.1002/sim.5727PMID 23296397PMCID PMC3625503
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Misuse of DeLong test to compare AUCs for nested models

  2012cited by this paper
• Two Criteria for Evaluating Risk Prediction Models

  2011influential reference
• Evaluating the incremental value of new biomarkers with integrated discrimination improvement.

  2011cited by this paper
• Performance of reclassification statistics in comparing risk prediction models

  2011cited by this paper
• Re: "problems with risk reclassification methods for evaluating prediction models".

  2011cited by this paper
• Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers

  2011cited by this paper
• One statistical test is sufficient for assessing new predictive markers

  2011cited by this paper
• A framework for quantifying net benefits of alternative prognostic models

  2011cited by this paper
• Performance of common genetic variants in breast-cancer risk models.

  2010cited by this paper
• The Potential of Genes and Other Markers to Inform about Risk

  2010cited by this paper
• Putting risk prediction in perspective: relative utility curves.

  2009cited by this paper
• Assessment of claims of improved prediction beyond the Framingham risk score.

  2009cited by this paper
• Estimation and Comparison of Receiver Operating Characteristic Curves

  2009cited by this paper
• Adjusting for covariate effects on classification accuracy using the covariate-adjusted receiver operating characteristic curve.

  2009cited by this paper
• Clinical Prediction Models—a Practical Approach to Development, Validation and Updating

  2009cited by this paper
• Using relative utility curves to evaluate risk prediction

  2009cited by this paper
• Advances in Measuring the Effect of Individual Predictors of Cardiovascular Risk: The Role of Reclassification Measures

  2009cited by this paper
• Value of adding single-nucleotide polymorphism genotypes to a breast cancer risk model.

  2009cited by this paper
• Measures to Summarize and Compare the Predictive Capacity of Markers

  2009cited by this paper
• A Parametric ROC Model‐Based Approach for Evaluating the Predictiveness of Continuous Markers in Case–Control Studies

  2009influential reference
• Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)

  2008cited by this paper
• Discriminatory accuracy from single-nucleotide polymorphisms in models to predict breast cancer risk.

  2008cited by this paper
• Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond

  2008cited by this paper
• Matching in Studies of Classification Accuracy: Implications for Analysis, Efficiency, and Assessment of Incremental Value

  2008cited by this paper
• Evaluating New Cardiovascular Risk Factors for Risk Stratification

  2008cited by this paper
• Integrating the predictiveness of a marker with its performance as a classifier.

  2007cited by this paper
• Evaluating the Predictiveness of a Continuous Marker

  2007cited by this paper
• Decision Curve Analysis: A Novel Method for Evaluating Prediction Models

  2006influential reference
• Projecting absolute invasive breast cancer risk in white women with a model that includes mammographic density.

  2006cited by this paper
• Prospective breast cancer risk prediction model for women undergoing screening mammography.

  2006cited by this paper
• Adjusting for Covariate Effects on Classification Accuracy Using the Covariate-Adjusted ROC Curve

  2006cited by this paper
• On criteria for evaluating models of absolute risk.

  2005cited by this paper
• The Statistical Evaluation of Medical Tests for Classification and Prediction

  2005cited by this paper
• A New Logistic Regression Approach for the Evaluation of Diagnostic Test Results

  2005cited by this paper
• Applied Logistic Regression

  2002cited by this paper
• Combining Several Screening Tests: Optimality of the Risk Score

  2002cited by this paper
• Validating and improving models for projecting the absolute risk of breast cancer.

  2001cited by this paper
• The binary regression quantile plot : Assessing the importance of predictors in binary regression visually

  2001cited by this paper
• Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis

  2001cited by this paper
• Validation, calibration, revision and combination of prognostic survival models.

  2000cited by this paper
• Validation, calibration, revision and combination of prognostic survival models

  2000cited by this paper
• Prediction of coronary heart disease using risk factor categories.

  1998cited by this paper
• A comparison of goodness-of-fit tests for the logistic regression model.

  1997cited by this paper
• Fatherhood and distal adenomas of the large bowel: a study of male self-defense officials in Japan.

  1994cited by this paper
• Projecting individualized probabilities of developing breast cancer for white females who are being examined annually.

  1989cited by this paper
• Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.

  1988cited by this paper
• Signal detection theory and psychophysics

  1966cited by this paper
• On the Problem of the Most Efficient Tests of Statistical Hypotheses

  1933cited by this paper
• Performance of Common Genetic Variants in Breast-cancer Risk Models

  year unknowncited by this paper

• Inference on the difference of AUCs based on fitted values under the null

  2026cites this paper
• Added value of the combination of radiomics and visual features based on CECT images for predicting the invasiveness of pGGNs

  2025cites this paper
• Visualizing a marker’s degrees of necessity and of sufficiency in the predictiveness curve

  2025cites this paper
• Radiomic Parenchymal Phenotypes of Breast Texture from Mammography and Association with Risk of Breast Cancer.

  2025cites this paper
• Postthrombectomy Flat-Panel CT Contrast Staining ASPECTS and Functional Outcome Prediction.

  2025cites this paper
• Circulating cardiovascular biomarkers in motion: redefining cardiovascular risk with dynamic prediction.

  2025cites this paper
• A Weighted Survival Regression Framework for Incorporating External Prediction Information

  2025cites this paper
• Plasma proteomic signatures for type 2 diabetes and related traits in the UK Biobank cohort.

  2025cites this paper
• Intratumoral and peritumoral radiomics for forecasting microsatellite status in gastric cancer: a multicenter study

  2025cites this paper
• Statistically Significant Association Does not Imply Improvement in Prediction of Clinical Outcomes

  2025cites this paper
• Improving stroke risk prediction in atrial fibrillation with circulating biomarkers: the CHA2DS2-VASc-Biomarkers model.

  2025cites this paper
• Integration of PNPLA3 and TM6SF2 genotypes provides incremental improvement in advanced fibrosis prediction among MASLD patients with type 2 diabetes mellitus

  2025cites this paper
• Adjustment of the SMART risk score by bioactive adrenomedullin enables a more accurate prediction of mortality in patients with ASCVD.

  2025cites this paper
• Added predictive value of childhood physical fitness to traditional risk factors for adult cardiovascular disease.

  2025cites this paper
• Improving the Estimation of Prediction Increment Measures in Logistic and Survival Analysis

  2025cites this paper
• EMI-LTI: An enhanced integrated model for lung tumor identification using Gabor filter and ROI

  2025cites this paper
• Development and internal validation of prediction model for rebleeding within one year after endoscopic treatment of cirrhotic varices: consideration from organ-based CT radiomics signature

  2024cites this paper
• The Application of Machine Learning to Empowerment, Stress and Workplace Outcomes

  2024cites this paper
• Plasma proteomic signatures for type 2 diabetes mellitus and related traits in the UK Biobank cohort

  2024cites this paper
• U-Turn Design Metatarsal Artery Flap

  2024cites this paper
• Early detection of pancreatic cancer: Study design and analytical considerations in biomarker discovery and early phase validation studies.

  2024cites this paper
• Validation of a clinical breast cancer risk assessment tool combining a polygenic score for all ancestries with traditional risk factors.

  2024cites this paper
• Letter: Adding a Coefficient for Race to the 4Kscore Improves Calibration for Black Men.

  2024cites this paper
• Development of a novel model to estimate the separation of organic compounds via porous membranes through artificial intelligence technique

  2024cites this paper
• Novel physiologic predictors of positive airway pressure effectiveness (NICEPAP) study: rationale, design and methods

  2024cites this paper
• Prediction of Recidivism and Detection of Risk Factors Under Different Time Windows Using Machine Learning Techniques

  2024cites this paper
• Neurofilament Light Chain and Risk of Stroke in Patients With Atrial Fibrillation

  2024cites this paper
• Predicting Risk of Colorectal Cancer After Adenoma Removal in a Large Community-Based Setting

  2024cites this paper
• Comparing regression curves: an L^1-point of view

  2023cites this paper
• Design of prediction model for multiple feature-type problems based on improved PSO-RBF neural network

  2023cites this paper
• Impact of Artificial Intelligence System and Volumetric Density on Risk Prediction of Interval, Screen-Detected, and Advanced Breast Cancer

  2023cites this paper
• Plasma proteomic signatures of a direct measure of insulin sensitivity in two population cohorts

  2023cites this paper
• Carotid Plaque Score for Stroke and Cardiovascular Risk Prediction in a Middle‐Aged Cohort From the General Population

  2023cites this paper
• Machine learning–based biomarker profile derived from 4210 serially measured proteins predicts clinical outcome of patients with heart failure

  2023cites this paper
• Validation of a Novel Clinical Dyspnea Scale – A Retrospective Pilot Study

  2023cites this paper
• The ASSESS-AKI Study found urinary epidermal growth factor is associated with reduced risk of major adverse kidney events.

  2023cites this paper
• Comparing regression curves -- an $L^1$-point of view

  2023cites this paper
• Cardiovascular Disease Risk Assessment Using Traditional Risk Factors and Polygenic Risk Scores in the Million Veteran Program.

  2023cites this paper
• Screening tools for predicting mortality of adults with suspected sepsis: an international sepsis cohort validation study

  2023cites this paper
• Exploring the added value of pretherapeutic MR descriptors in predicting breast cancer pathologic complete response to neoadjuvant chemotherapy

  2023cites this paper
• Prognostic value of temporal patterns of global longitudinal strain in patients with chronic heart failure

  2023cites this paper
• Assessing the clinical utility of biomarkers using the intervention probability curve (IPC).

  2023cites this paper
• Presence of cells in the polyaneuploid cancer cell (PACC) state predicts risk of recurrence in prostate cancer

  2022cites this paper
• Presence of cells in the polyaneuploid cancer cell (PACC) state predicts risk of recurrence in prostate cancer

  2022cites this paper
• A Framework for Evaluating the Technical Performance of Multiparameter Quantitative Imaging Biomarkers (mp-QIBs).

  2022cites this paper
• The performance of screening tools for predicting mortality across multi-site international sepsis cohorts

  2022cites this paper
• Deep learning predicts all-cause mortality from longitudinal total-body DXA imaging

  2022influential citation
• Contribution of Genome-Wide Polygenic Score to Risk of Coronary Artery Disease in Childhood Cancer Survivors

  2022cites this paper
• Are serum estrogen concentrations associated with menopausal symptom bother among postmenopausal women? Baseline results from two MsFLASH clinical trials.

  2022cites this paper
• Added prognostic value of Doppler ultrasound for adverse perinatal outcomes: A pooled analysis of three cohort studies

  2022cites this paper
• Multiparametric Quantitative Imaging Biomarkers for Phenotype Classification: A Framework for Development and Validation.

  2022cites this paper
• Presence of cells in the polyaneuploid cancer cell (PACC) state predicts the risk of recurrence in prostate cancer

  2022cites this paper
• Effective Text Augmentation Strategy for NLP Models

  2022cites this paper
• Stratification in systemic sclerosis according to autoantibody status versus skin involvement: a study of the prospective EUSTAR cohort.

  2022cites this paper
• Admission lactate level and the GRACE 2.0 score are independent and additive predictors of 30-day mortality of STEMI patients treated with primary PCI—Results of a real-world registry

  2022cites this paper
• Additional value of chest CT AI-based quantification of lung involvement in predicting death and ICU admission for COVID-19 patients

  2022cites this paper
• A Modified Net Reclassification Improvement Statistic.

  2022cites this paper
• Integrated Biomarkers for the Management of Indeterminate Pulmonary Nodules.

  2021cites this paper
• Study of Diffusion Weighted Imaging Derived Diffusion Parameters as Biomarkers for the Microenvironment in Gliomas

  2021cites this paper
• Predictive Added Value of Selected Plasma Lipids to a Re-estimated Minimal Risk Tool

  2021cites this paper
• A relationship between the incremental values of area under the ROC curve and of area under the precision-recall curve

  2021cites this paper
• Development and Internal Validation of a Preoperative Prediction Model for Sentinel Lymph Node Status in Breast Cancer: Combining Radiomics Signature and Clinical Factors

  2021cites this paper
• Polysomnographic Phenotypes of Obstructive Sleep Apnea and Incident Type 2 Diabetes: Results from the DREAM Study.

  2021cites this paper
• Cardiac troponin I measured with a very high sensitivity assay predicts subclinical carotid atherosclerosis: The Akershus Cardiac Examination 1950 Study.

  2021cites this paper
• Performance of the IBIS/Tyrer‐Cuzick model of breast cancer risk by race and ethnicity in the Women's Health Initiative

  2021cites this paper
• Free Hemoglobin Ratio as a Novel Biomarker of Acute Kidney Injury After On-Pump Cardiac Surgery: Secondary Analysis of a Randomized Controlled Trial

  2021cites this paper
• Bioactive adrenomedullin a prognostic biomarker in patients with mild to moderate dyspnea at the emergency department: an observational study

  2021cites this paper
• On Gains from Biomarker Optimization Toward ROC-Related Targets in Real-Life Data by

  2021cites this paper
• Nested logistic regression models and ΔAUC applications: Change-point analysis

  2021cites this paper
• Validation of the adjusted multi-biomarker disease activity score as a prognostic test for radiographic progression in rheumatoid arthritis: a combined analysis of multiple studies

  2021cites this paper
• Noninvasive biomarkers for lung cancer diagnosis, where do we stand?

  2020cites this paper
• Clinical Application of High-Sensitivity Troponin Testing in the Atherosclerotic Cardiovascular Disease Framework of the Current Cholesterol Guidelines.

  2020cites this paper
• Metabolomic Markers of Kidney Function Decline in Patients With Diabetes: Evidence From the Chronic Renal Insufficiency Cohort (CRIC) Study.

  2020cites this paper
• Whole-Lesion DCE-MRI Intensity Histogram Analysis for Diagnosis in Patients with Suspected Lung Cancer.

  2020cites this paper
• Blood-based biomarkers for prediction of intracranial hemorrhage and outcome in patients with moderate or severe traumatic brain injury

  2020cites this paper
• Contribution of social factors to readmissions within 30 days after hospitalization for COPD exacerbation

  2020cites this paper
• Practice of Epidemiology PTC1 and PTC2: New Indices of Blood Pressure Waveforms and Cardiovascular Disease

  2020cites this paper
• Association of Established Blood Pressure Loci With 10‐Year Change in Blood Pressure and Their Ability to Predict Incident Hypertension

  2020cites this paper
• Vascular injury biomarkers and stroke risk

  2020cites this paper
• PTC1 and PTC2: New Indices of Blood Pressure Waveforms and Cardiovascular Disease.

  2020cites this paper
• Inclusion of Endogenous Plasma Dehydroepiandrosterone Sulfate and Mammographic Density in Risk Prediction Models for Breast Cancer

  2020cites this paper
• Relationship between baseline cardiac biomarkers and cardiovascular death or hospitalization for heart failure with and without sodium–glucose co‐transporter 2 inhibitor therapy in DECLARE‐TIMI 58

  2020cites this paper
• Cervical Cancer Stem-Like Cell Transcriptome Profiles Predict Response to Chemoradiotherapy

  2020cites this paper
• Utility of the “omics” in kidney disease: Methods of analysis, sampling considerations, and technical approaches in renal biomarkers

  2020cites this paper
• Is the new model better? One metric says yes, but the other says no. Which metric do I use?.

  2020cites this paper
• Long-term prognostic potential of microRNA-150-5p in optimally treated heart failure patients with reduced ejection fraction. A pilot study.

  2020cites this paper
• Contribution of Predictive and Prognostic Biomarkers to Clinical Research on Chronic Kidney Disease

  2020cites this paper
• Evaluating the incremental value of a new model: Area under the ROC curve or under the PR curve

  2020cites this paper
• The added value of new covariates to the brier score in cox survival models

  2020cites this paper
• Physiological Traits and Adherence to Obstructive Sleep Apnea Treatment in Patients with Stroke.

  2020cites this paper
• Precision Nephrology Is a Non-Negligible State of Mind in Clinical Research: Remember the Past to Face the Future

  2020cites this paper
• Repeated Echocardiograms Do Not Provide Incremental Prognostic Value to Single Echocardiographic Assessment in Minimally Symptomatic Patients with Chronic Heart Failure: Results of the Bio-SHiFT Study.

  2019cites this paper
• Measures for evaluation of prognostic improvement under multivariate normality for nested and nonnested models

  2019cites this paper
• Traditional cardiovascular risk factors and individual prediction of cardiovascular events in childhood cancer survivors.

  2019cites this paper
• Statistical methods for building better biomarkers of chronic kidney disease

  2019cites this paper
• Use of PRECISE-DAPT Score and Admission Platelet Count to Predict Mortality Risk in Patients With Acute Coronary Syndrome

  2019cites this paper
• The association between first trimester AFP to PAPP-A ratio and placentally-related adverse pregnancy outcome.

  2019cites this paper
• Biomarkers of Vascular Injury and Type 2 Diabetes: A Prospective Study, Systematic Review and Meta-Analysis

  2019cites this paper
• Evaluation of Risk Prediction Models of Atrial Fibrillation (from the Multi-Ethnic Study of Atherosclerosis [MESA]).

  2019cites this paper
• Plasma Fibrinogen and sP-Selectin are Associated with the Risk of Lung Cancer in a Prospective Study

  2019cites this paper