Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures

No abstract is available for this paper.

• Publication year

  2010

• Venue

  Epidemiology

• Publication date

  2010-01-01

• Fields of study

  Mathematics, Medicine

• Identifiers
  DOI 10.1097/EDE.0b013e3181c30fb2PMID 20010215PMCID PMC3575184
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Advances in Measuring the Effect of Individual Predictors of Cardiovascular Risk: The Role of Reclassification Measures

  2009cited by this paper
• Clinical Prediction Models—a Practical Approach to Development, Validation and Updating

  2009cited by this paper
• The need for reorientation toward cost‐effective prediction: Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)

  2008cited by this paper
• Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)

  2008cited by this paper
• The Performance of Risk Prediction Models

  2008influential reference
• The need for reorientation toward cost‐effective prediction: Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)

  2008cited by this paper
• Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond

  2008cited by this paper
• Decision Curve Analysis: A Discussion

  2008cited by this paper
• Why Most Discovered True Associations Are Inflated

  2008cited by this paper
• Assessing new biomarkers and predictive models for use in clinical practice: a clinician's guide.

  2008cited by this paper
• Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve.

  2008cited by this paper
• Assessing the Value of Risk Predictions by Using Risk Stratification Tables

  2008cited by this paper
• Comments on ‘Integrated discrimination and net reclassification improvements—Practical advice’

  2008cited by this paper
• Assessment of survival prediction models based on microarray data

  2007cited by this paper
• Integrating the predictiveness of a marker with its performance as a classifier.

  2007cited by this paper
• Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction

  2007cited by this paper
• External validation of prognostic models for critically ill patients required substantial sample sizes.

  2007cited by this paper
• Letter by Pepe et al regarding article, "Use and misuse of the receiver operating characteristic curve in risk prediction".

  2007cited by this paper
• Actual and actuarial probabilities of competing risks: apples and lemons.

  2007cited by this paper
• Selecting patients for randomized trials: a systematic approach based on risk group

  2006cited by this paper
• A checklist for evaluating reports of expression profiling for treatment selection.

  2006cited by this paper
• Consistent Estimation of the Expected Brier Score in General Survival Models with Right‐Censored Event Times

  2006cited by this paper
• Regression Methods in Biostatistics: Linear, Logistic, Survival and Repeated Measures Models

  2006cited by this paper
• Decision Curve Analysis: A Novel Method for Evaluating Prediction Models

  2006influential reference
• Randomized controlled trials with time-to-event outcomes: how much does prespecified covariate adjustment increase power?

  2006cited by this paper
• Properties of R2 statistics for logistic regression

  2006cited by this paper
• Translating Clinical Research into Clinical Practice: Impact of Using Prediction Rules To Make Decisions

  2006cited by this paper
• Estimation of time‐dependent area under the ROC curve for long‐term risk prediction

  2006cited by this paper
• Survival Model Predictive Accuracy and ROC Curves

  2005cited by this paper
• Concordance probability and discriminatory power in proportional hazards regression

  2005cited by this paper
• On criteria for evaluating models of absolute risk.

  2005cited by this paper
• Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements.

  2004cited by this paper
• Two new prediction rules for spontaneous pregnancy leading to live birth among subfertile couples, based on the synthesis of three previous models.

  2004cited by this paper
• Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker.

  2004cited by this paper
• Validation and updating of predictive logistic regression models: a study on sample size and shrinkage

  2004cited by this paper
• Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis

  2003influential reference
• Judging new markers by their ability to improve predictive accuracy.

  2003cited by this paper
• Receiver operating characteristic curves and their use in radiology.

  2003cited by this paper
• How to Assess Prognostic Models for Survival Data: A Case Study in Oncology

  2003cited by this paper
• Validity of prognostic models: when is a model clinically useful?

  2002cited by this paper
• Internal validation of predictive models: efficiency of some procedures for logistic regression analysis.

  2001cited by this paper
• Residual mass histology in testicular cancer: development and validation of a clinical prediction rule

  2001cited by this paper
• Validation of a prediction model and its predictors for the histology of residual masses in nonseminomatous testicular cancer.

  2001cited by this paper
• What do we mean by validating a prognostic model?

  2000cited by this paper
• Resection of small, residual retroperitoneal masses after chemotherapy for nonseminomatous testicular cancer

  1999cited by this paper
• Assessing the Generalizability of Prognostic Information

  1999cited by this paper
• A Proportional Hazards Model for the Subdistribution of a Competing Risk

  1999cited by this paper
• A comparison of goodness-of-fit tests for the logistic regression model.

  1997cited by this paper
• Risk adjustment for measuring health care outcomes

  1996cited by this paper
• Prediction of residual retroperitoneal mass histology after chemotherapy for metastatic nonseminomatous germ cell tumor: multivariate analysis of individual patient data from six study groups.

  1995cited by this paper
• Risk Adjustment for Measuring Healthcare Outcomes

  1994cited by this paper
• Validation of Probabilistic Predictions

  1993cited by this paper
• Statistical methods in diagnosis

  1992cited by this paper
• The Area under the ROC Curve and Its Competitors

  1991cited by this paper
• A note on a general definition of the coefficient of determination

  1991cited by this paper
• Predictive value of statistical models.

  1990cited by this paper
• Regression, Prediction and Shrinkage

  1983cited by this paper
• External correspondence: Decompositions of the mean probability score

  1982cited by this paper
• The toss-up.

  1981cited by this paper
• The Measurement of Performance in Probabilistic Diagnosis IV. Utility Considerations in Therapeutics and Prognostics

  1981cited by this paper
• The threshold approach to clinical decision making.

  1980cited by this paper
• The Measurement of Performance in Probabilistic Diagnosis

  1978cited by this paper
• A review and critique of some models used in competing risk analysis.

  1975cited by this paper
• Primer on certain elements of medical decision making.

  1975cited by this paper
• Two further applications of a model for binary regression

  1958cited by this paper
• VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY

  1950cited by this paper
• Index for rating diagnostic tests

  1950cited by this paper
• The numerical measure of the success of predictions.

  1884cited by this paper

• Ensemble Machine Learning Models for Predicting Patients With High Usage: Model Validation and Economic Impact Analysis.

  2026cites this paper
• Bridging performance and uncertainty: Cautionary notes on machine learning and large language models in TBI prognostication

  2026cites this paper
• Reproducing real-world clinical prediction models using the DIVE platform: A comparative validation study across three chronic diseases

  2026cites this paper
• A machine learning approach to predicting clinical trajectories in bipolar disorder.

  2026cites this paper
• " Pharmacomicrobiomics in blood cancers: how the gut microbiome and its metabolites shape drug efficacy and toxicity ".

  2026cites this paper
• Large-scale DNA organization analysis of primary breast cancers for prediction of axillary lymph node metastases

  2026cites this paper
• Toward clinical implementation of interpretable machine learning for early risk stratification in acute pancreatitis.

  2026cites this paper
• Exploring the determinants of non-suicidal self-injury among university students in Jordan: a cross-sectional study

  2026cites this paper
• An Updated Mortality and Community Discharge Prognostic Model for Older Adults Admitted to Skilled Nursing Facilities for Post-Acute Care.

  2026cites this paper
• Hospital standardised mortality ratio: a novel method and approach to risk adjustment

  2026influential citation
• TRIAGE: Trustworthy Reporting and Assessment for Clinical Gain and Effectiveness of AI Models

  2026cites this paper
• A Bayesian copula framework to infer ontogenetic relationships and predict associated parameters in human growth and development

  2026cites this paper
• BRD4-associated chromatin remodelling signature links epigenetic regulation to immune landscape in ovarian cancer.

  2026cites this paper
• Survival without bronchopulmonary dysplasia in extremely preterm infants: an external, population-based validation, comparison and optimisation study of recent prediction models at baseline

  2026cites this paper
• Trajectories of daily inpatient blood biomarkers of physiological function improve mortality and morbidity prognostic model performance for patients with severe traumatic brain injury.

  2026cites this paper
• Integrating GFAP Testing With Clinical Scores for Prehospital Large Vessel Occlusion Detection in Patients With Acute Stroke (DETECT LVO).

  2026cites this paper
• Machine Learning-driven Probability Calculators Can Accurately Predict 1-year Mortality After Proximal Humerus Fractures in Patients Over the Age of 65 Years.

  2026cites this paper
• Legislative Debate-Attributed Suicidality Among LGBTQ+ Adults: The Buffering Effect of Community Belongingness

  2026cites this paper
• Comparison of the predictive performance of machine learning and conventional logistic regression models for poor discharge outcomes in patients with Aneurysmal subarachnoid hemorrhage: A retrospective cohort study

  2026cites this paper
• Predicting non-emergency healthcare use in Australia using machine learning on longitudinal household data

  2026cites this paper
• Tabular foundation models as a new portable standard in local surgical risk prediction.

  2026cites this paper
• Characteristics, cost/effect consideration of clinical examinations, and construction of machine learning models of restrictive cardiomyopathy: insights from Peking Union Medical College Hospital.

  2026cites this paper
• A Practical Roadmap for Clinical Translation of Metabolic Biomarkers: A Review.

  2026cites this paper
• Cross-population validation of the pediatric chronic kidney disease risk-prediction tool

  2026cites this paper
• Multidomain post-stroke cognitive impairment: development and validation of a clinical prediction model.

  2026cites this paper
• Spatiotemporal Modeling and Future Trends of Land Surface Temperature Using Remote Sensing and CA-ANN in Industrial Narayanganj, Bangladesh

  2026cites this paper
• From Branch to Digital: Modeling Customer Channel Preferences in Electronic Banking Services

  2026influential citation
• The impact of violation of the proportional hazards assumption on the discrimination of the Cox proportional hazards model

  2026cites this paper
• Admission serum tropomyosin 4 levels predict 1-year functional outcomes in acute ischemic stroke

  2026cites this paper
• Machine learning for predicting outcomes, complications and resource utilisation after hip arthroscopy: A systematic review.

  2026cites this paper
• Sepsis Endotypes Defined by Lymphocyte Thresholds and Inflammation Inform Precision Immunomodulation

  2026cites this paper
• Machine learning-based cardiovascular risk calculator for non-cardiac surgery

  2026cites this paper
• Heterogeneity in Treatment Effects of Reduced Versus Standard Dose of Cabazitaxel in Metastatic Castration‐Resistant Prostate Cancer

  2026cites this paper
• Association of Carboxypeptidase B2 Gene Polymorphisms With Graft Loss in Kidney Transplantation

  2026cites this paper
• An interpretable machine learning model for prediction of significant liver fibrosis in comorbid chronic hepatitis B and nonalcoholic fatty liver disease: a retrospective development and validation study

  2026cites this paper
• How Clinicians Think and What AI Can Learn From It

  2026cites this paper
• CABIT: a novel biomarkers-integrated inflammatory risk tool for ischemic heart disease developed in the USA and prospectively validated in China

  2026cites this paper
• A predictor finding study found patient-reported outcomes improve the prediction of mortality of incident dialysis patients.

  2026cites this paper
• Individualized Treatment in Distal and Medium Vessel Occlusion Stroke Using a Validated Explainable Counterfactual Treatment Estimation Model.

  2026cites this paper
• A Multi-Gene Signature Associated with 1-Year Survival in Patients with Stage I Liver Cancer: Integration of Preclinical and TCGA Data.

  2026cites this paper
• Enhancing cancer prognostics with group penalty models: a comparative study on radiomics feature selection in lung adenocarcinomas and meningiomas

  2026cites this paper
• AgentScore: Autoformulation of Deployable Clinical Scoring Systems

  2026cites this paper
• Short-Term Biceps Muscle Wasting Assessed by Serial Ultrasound as a Predictor of Survival Duration in Terminally Ill Cancer Patients: A Retrospective Cohort Study.

  2026cites this paper
• Artificial Intelligence and the Expanding Universe of Cardio-Oncology: Beyond Detection Toward Prediction and Prevention of Therapy-Related Cardiotoxicity—A Comprehensive Review

  2026cites this paper
• Mode Choice Analysis between Executive Rail and Sleeper Bus on the Surabaya – Jakarta Corridor Using Binary Logit Regression

  2026cites this paper
• An online machine learning model for predicting medication adherence in hypertensive patients: data from the China health and retirement longitudinal study (CHARLS).

  2026cites this paper
• A comparative analysis of data-driven models for breast cancer survival prediction.

  2026cites this paper
• Epidemiology of Acute and Long-Term Outcomes of Critically Ill Pregnant Women Admitted to the Intensive Care Unit With COVID-19: A Cohort Study in Saudi Arabia

  2026cites this paper
• Endometriosis pain index: development of a model to predict poor pain-related quality of life after endometriosis surgery through machine learning analysis of registry data.

  2026cites this paper
• An Instrumental Activities of Daily Living Decline Detection Analysis Pipeline Using Temporal Changes in In-Home Sensor Data

  2026cites this paper
• A study protocol for a predictive model to assess population‑based risk of adverse pregnancy outcomes: The Adverse Pregnancy Outcomes Population Risk Tool (PregPoRT)

  2026cites this paper
• Tipping the Balance: Impact of Class Imbalance Correction on the Performance of Clinical Risk Prediction Models

  2026cites this paper
• Machine Learning and Statistical Approaches for Predicting Breast Cancer Recurrence and Metastasis: A Systematic Review

  2026cites this paper
• Introduction of the neural framework for stationary and nonstationary probability distribution modelling of hydroclimatological extremes in Canada, and performance comparison with classical models

  2026cites this paper
• The Association Between the Aggregate Index of Systemic Inflammation (AISI) and Prevalence of Psoriasis: Cross Sectional NHANES Study 2003-2006 and 2009-2014.

  2026cites this paper
• AIM2 inflammasome and pyroptosis biomarkers in oncology.

  2026cites this paper
• Prognostic value of a mortality risk nomogram model for sepsis combined with COPD patients based on the MIMIC-III database.

  2026cites this paper
• Predicting emergency department disposition using machine learning and large language models to support proactive capacity management: a multicenter retrospective study.

  2026cites this paper
• Predictors of Brucella spp. bacteraemia at admission among adults with brucellosis: a two-centre retrospective cohort study in Ningxia, China.

  2026cites this paper
• Symptom burden in dialysis patients: determinants and impact on mortality.

  2026cites this paper
• Stroke risk nomograms from machine learning need clearer calibration and transportability assessment

  2026cites this paper
• Development and temporal validation of SCRAPS scoring tool to predict poor prognosis in gram negative sepsis patients requiring early intensive care or high dependency unit admission

  2026cites this paper
• PointExplainer: Towards transparent Parkinson's disease diagnosis

  2026cites this paper
• Development and validation of a novel clinical decision support tool for sustained remission in Crohn’s disease: a multi-center real-world study

  2026influential citation
• Diagnostic Gap in Rural Maternal Health: Initial Validation of a Parsimonious Clinical Model for Hypertensive Disorders of Pregnancy in a Honduran Hospital

  2026cites this paper
• Development of a prediction model for mortality in infants undergoing therapeutic hypothermia for neonatal encephalopathy.

  2026cites this paper
• Anchoring Pelvic AI: A Hip Bone Reference Frame for Sacral Tumor Classification in Noncontrast CT.

  2026cites this paper
• Development and validation of predictive models for 6-month gastrostomy timing in amyotrophic lateral sclerosis

  2026influential citation
• A Bayesian network for identifying causes of breathlessness using a national electronic medical records (EMR) database

  2026cites this paper
• Beyond Accuracy: A Decision-Theoretic Framework for Allocation-Aware Healthcare AI

  2026cites this paper
• A scientific note on the prevalence of Nosema spp in honey bee colonies in relation to the proximity of mining regions and levels of heavy metal contamination

  2026cites this paper
• New models to predict survival of patients with difficult ventilator-weaning diagnosed with community-acquired pneumonia

  2026cites this paper
• Time-sequential prediction of postoperative complications after gastric cancer surgery using machine learning

  2026cites this paper
• Predicting high health care use in patients with spinal disorder in secondary care: model development and validation

  2026cites this paper
• Evaluating methodological quality of prognostic prediction models on patient-reported outcome measurements after total hip and total knee arthroplasty

  2026cites this paper
• Discrete-time neural Markov models

  2026cites this paper
• Gut microbiota-based prediction of clinical response to sublingual immunotherapy in Artemisia pollen-induced allergic rhinitis: A prospective cohort study.

  2026cites this paper
• Integration of focused cardiac ultrasound in the HEAR and HEART scores in emergency department patients with chest pain.

  2026cites this paper
• AI-driven Forecasting for Medicarerisk Score Modernization

  2026cites this paper
• A machine learning model for predicting complete virological response in chronic hepatitis B patients receiving first-line nucleos(t)ide analogues therapy.

  2026cites this paper
• Commentary on "Deep learning enhanced MRI radiomics in predicting pathologic response of head and neck squamous carcinoma to neoadjuvant chemoimmunotherapy: a retrospective analysis".

  2026cites this paper
• Transparency of reporting and methodological conduct of prognostic and diagnostic clinical prediction models developed using machine learning in total shoulder arthroplasty: A systematic review and critical appraisal.

  2026cites this paper
• Improving Early Prediction of Type 2 Diabetes Mellitus with ECG-DiaNet: A Multimodal Neural Network Leveraging Electrocardiogram and Clinical Risk Factors

  2025cites this paper
• On misconceptions about the Brier score in binary prediction models

  2025cites this paper
• Modelling the effects of diurnal temperature variation on malaria infection dynamics in mosquitoes

  2025influential citation
• Predicting hospital admissions, ICU utilization, and prolonged length of stay among febrile pediatric emergency department patients using incomplete and imbalanced electronic health record (EHR) data strategies

  2025cites this paper
• Clinical prognostic models for sarcomas: a systematic review and critical appraisal of development and validation studies

  2025cites this paper
• Evaluating the performance of existing tools to predict clinically significant prostate cancer in men with indeterminate lesions on biparametric MRI and development of a novel multiplex model: a prospective cohort study

  2025cites this paper
• The value of fetal growth trajectory during pregnancy in predicting small for gestational age neonates at term

  2025influential citation
• Machine Learning Insight: Unveiling Overlooked Risk Factors for Postoperative Complications in Gastric Cancer

  2025cites this paper
• Genetic, clinical, lifestyle and sociodemographic risk factors for head and neck cancer: A UK Biobank study

  2025influential citation
• Uptake rates for non‐invasive prenatal screening for single‐gene disorders associated with advanced paternal age

  2025influential citation
• Prediction Models for Risk of Cardiorespiratory Morbidity/Mortality and Fracture Among Young Adults With Cerebral Palsy

  2025influential citation
• Assessing the Adequacy of a Prediction Model

  2025cites this paper
• Developing and validating a nomogram prediction model for osteoporosis risk in the UK biobank: a national prospective cohort

  2025cites this paper
• Common genetic variants do not impact clinical prediction of methotrexate treatment outcomes in early rheumatoid arthritis

  2025cites this paper
• Clinical prediction study on the risk of atrial fibrillation in hypertensive patients based on metabolism, inflammation, and gender differences

  2025cites this paper
• The Naples pediatric food allergy (NAPFA) score: A multivariable model for the prediction of food allergy in children

  2025cites this paper
• Decision tree-based machine learning algorithm for prediction of acute radiation esophagitis

  2025cites this paper
• Working Toward Defining Frailty in Breast Surgery

  2025cites this paper