A spline-based tool to assess and visualize the calibration of multiclass risk predictions

No abstract is available for this paper.

• Publication year

  2015

• Venue

  Journal of Biomedical Informatics

• Publication date

  2015-04-01

• Fields of study

  Medicine, Mathematics, Computer Science

• Identifiers
  DOI 10.1016/j.jbi.2014.12.016PMID 25579635
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Naïve Bayes

  2020cited by this paper
• Calibration of Risk Prediction Models

  2015cited by this paper
• F1000Prime recommendation of Calibration of risk prediction models: impact on decision-analytic performance.

  2014cited by this paper
• Quantifying surgical complexity with machine learning: looking beyond patient factors to improve surgical models.

  2014cited by this paper
• A Framework for Evaluating Markers Used to Select Patient Treatment

  2014cited by this paper
• Support vector machine-based prediction of local tumor control after stereotactic body radiation therapy for early-stage non-small cell lung cancer.

  2014cited by this paper
• Evaluating the risk of ovarian cancer before surgery using the ADNEX model to differentiate between benign, borderline, early and advanced stage invasive, and secondary metastatic tumours: prospective multicentre diagnostic study

  2014cited by this paper
• Probability estimation with machine learning methods for dichotomous and multicategory outcome: Applications

  2014cited by this paper
• Probability estimation with machine learning methods for dichotomous and multicategory outcome: Theory

  2014influential reference
• Assessing calibration of multinomial risk prediction models

  2014influential reference
• Risk prediction with machine learning and regression methods

  2014cited by this paper
• Clinical prognostic methods: trends and developments.

  2014cited by this paper
• Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers

  2013cited by this paper
• Assessing the discriminative ability of risk models for more than two outcome categories

  2012cited by this paper
• Risk estimation and risk prediction using machine-learning methods

  2012cited by this paper
• Doubly Optimized Calibrated Support Vector Machine (DOC-SVM): An Algorithm for Joint Optimization of Discrimination and Calibration

  2012cited by this paper
• A comparison of the performance of a model based on administrative data and a model based on clinical data: Effect of severity of illness on standardized mortality ratios of intensive care units*

  2012cited by this paper
• Extending the c‐statistic to nominal polytomous outcomes: the Polytomous Discrimination Index

  2012cited by this paper
• Probability Machines

  2011cited by this paper
• Calibrating predictive model estimates to support personalized medicine

  2011cited by this paper
• Viability of intrauterine pregnancy in women with pregnancy of unknown location: prediction using human chorionic gonadotropin ratio vs. progesterone

  2010cited by this paper
• Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures

  2010cited by this paper
• Ovarian cancer prediction in adnexal masses using ultrasound‐based logistic regression models: a temporal and external validation study by the IOTA group

  2010cited by this paper
• The Top Ten Algorithms in Data Mining

  2009cited by this paper
• Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls

  2009cited by this paper
• Prospective Internal Validation of Mathematical Models to Predict Malignancy in Adnexal Masses: Results from the International Ovarian Tumor Analysis Study

  2009cited by this paper
• Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating By Ewout W. Steyerberg

  2009cited by this paper
• Prognosis and prognostic research: validating a prognostic model

  2009cited by this paper
• kNN: k-Nearest Neighbors

  2009cited by this paper
• Clinical Prediction Models—a Practical Approach to Development, Validation and Updating

  2009cited by this paper
• EDITOR Comments on ‘Practical experiences on the necessity of external validation’

  2008cited by this paper
• A web-based tool for the assessment of discrimination and calibration properties of prognostic models

  2008cited by this paper
• Validation, updating and impact of clinical prediction rules: a review.

  2008cited by this paper
• The Use of Genomics in Clinical Trial Design

  2008cited by this paper
• Effects of SVM parameter optimization on discrimination and calibration for post-procedural PCI mortality

  2007cited by this paper
• Shared Decision Making, Decision Aids, and Risk Communication

  2007cited by this paper
• Prediction of ectopic pregnancy in women with a pregnancy of unknown location

  2007cited by this paper
• Comparing Methods for Multi-class Probabilities in Medical Decision Making Using LS-SVMs and Kernel Logistic Regression

  2007cited by this paper
• Practical experiences on the necessity of external validation

  2007cited by this paper
• Machine learning for detection and diagnosis of disease.

  2006cited by this paper
• The use of artificial neural networks in decision support in cancer: A systematic review

  2006cited by this paper
• Applications of Machine Learning in Cancer Prediction and Prognosis

  2006cited by this paper
• Logistic regression model to distinguish between the benign and malignant adnexal mass before surgery: a multicenter study by the International Ovarian Tumor Analysis Group.

  2005cited by this paper
• Discrimination and calibration of mortality risk prediction models in interventional cardiology

  2005cited by this paper
• The use of receiver operating characteristic curves in biomedical informatics

  2005influential reference
• Ensembles of nested dichotomies for multi-class problems

  2004cited by this paper
• Probability Estimates for Multi-class Classification by Pairwise Coupling

  2003cited by this paper
• Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis

  2003cited by this paper
• Comparison of Cox regression with other methods for determining prediction models and nomograms.

  2003cited by this paper
• Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond

  2003cited by this paper
• Class Prediction by Nearest Shrunken Centroids, with Applications to DNA Microarrays

  2003cited by this paper
• Categorical Data Analysis

  2003cited by this paper
• Novel artificial neural network for early detection of prostate cancer.

  2002cited by this paper
• Transforming classifier scores into accurate multiclass probability estimates

  2002cited by this paper
• An empirical study of the naive Bayes classifier

  2001cited by this paper
• A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems

  2001cited by this paper
• Random Forests

  2001cited by this paper
• Vector splines and other vector smoothers

  2000cited by this paper
• A comparison of goodness-of-fit tests for the logistic regression model.

  1997cited by this paper
• Classification by Pairwise Coupling

  1997cited by this paper
• Vector Generalized Additive Models

  1996cited by this paper
• Partially parametric techniques for multiple imputation

  1996cited by this paper
• Generalized cross-validation as a method for choosing a good ridge parameter

  1979cited by this paper
• Therapeutic decision making: a cost-benefit analysis.

  1975cited by this paper

• Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance.

  2025cites this paper
• Non-parametric assessment of the calibration of individualized treatment effects

  2025cites this paper
• calibmsm: An R package for calibration plots of the transition probabilities in a multistate model

  2025cites this paper
• Risk prediction of multiple cardiometabolic diseases in middle-aged and older adults using lipid metabolism biomarkers and derived composite measures based on machine learning: a prospective cohort study of CHARLS

  2025cites this paper
• A-calibration: assessment of prediction models for survival data under censoring

  2025cites this paper
• Multicenter validation of a scalable, interpretable, multitask prediction model for multiple clinical outcomes

  2025cites this paper
• Multimodal deep learning to predict postoperative major adverse cardiac and cerebrovascular events after noncardiac surgery

  2025cites this paper
• Estimation of Multi‐Category Youden Index Based on the Lehmann Assumption

  2025cites this paper
• A comparison of modeling approaches for static and dynamic prediction of central line-associated bloodstream infections using electronic health records (part 2): random forest models

  2025cites this paper
• A comparison of modeling approaches for static and dynamic prediction of central-line bloodstream infections using electronic health records (part 1): regression models

  2025cites this paper
• Comment on: “A Machine Learning Approach to Concussion Risk Estimation Among Players Exhibiting Visible Signs in Professional Hockey”

  2025cites this paper
• Clustered flexible calibration plots for binary outcomes using random effects modeling

  2025cites this paper
• Validation and Recalibration of a Model for Predicting Surgical-Site Infection After Pelvic Organ Prolapse Surgery

  2025cites this paper
• Evaluating Posterior Probabilities: Decision Theory, Proper Scoring Rules, and Calibration

  2024influential citation
• External validation and calibration of the HoLISTIC Consortium's advanced‐stage Hodgkin lymphoma international prognostic index (A‐HIPI) in the Brazilian Hodgkin lymphoma registry

  2024cites this paper
• Prediction of incident atrial fibrillation using deep learning, clinical models, and polygenic scores

  2024cites this paper
• Fracture risk assessment in the presence of competing risk of death

  2024cites this paper
• Multicenter external validation of prediction models for clinical outcomes after spinal fusion for lumbar degenerative disease

  2024cites this paper
• External validation of a nomogram for outcome prediction in management of medium-sized (1-2 cm) kidney stones.

  2024cites this paper
• A comparison of regression models for static and dynamic prediction of a prognostic outcome during admission in electronic health care records

  2024cites this paper
• Specific Gravity Improves Identification of Clinically Significant Quantitative Proteinuria from the Dipstick Urinalysis

  2024cites this paper
• Multicentre validation of a machine learning model for predicting respiratory failure after noncardiac surgery.

  2024cites this paper
• Evaluation of clinical prediction models (part 2): how to undertake an external validation study

  2024cites this paper
• A comparison of machine learning algorithms and traditional regression-based statistical modeling for predicting hypertension incidence in a Canadian population

  2023cites this paper
• Calibration plots for multistate risk predictions models

  2023cites this paper
• Non‐parametric inference on calibration of predicted risks

  2023cites this paper
• QuantProb: Generalizing Probabilities along with Predictions for a Pre-trained Classifier

  2023cites this paper
• Recommendations for Performance Evaluation of Machine Learning in Pathology: A Concept Paper From the College of American Pathologists.

  2023cites this paper
• Risk Prediction for Acute Kidney Injury in Patients Hospitalized With COVID-19

  2022cites this paper
• Validation of prediction models in the presence of competing risks: a guide through modern methods

  2022cites this paper
• A novel lifelong machine learning-based method to eliminate calibration drift in clinical prediction models

  2022cites this paper
• Pre-operative prediction of extracapsular extension of prostate cancer: first external validation of the PRECE model on an independent dataset

  2022cites this paper
• Maintaining a National Acute Kidney Injury Risk Prediction Model to Support Local Quality Benchmarking

  2022cites this paper
• Development and internal validation of a prognostic model for 15-year risk of Alzheimer dementia in primary care patients

  2022cites this paper
• Circulation: Cardiovascular Quality and Outcomes

  2021cites this paper
• Ensemble machine learning prediction and variable importance analysis of 5-year mortality after cardiac valve and CABG operations

  2021cites this paper
• Improving prediction for medical institution with limited patient data: Leveraging hospital-specific data based on multicenter collaborative research network

  2021cites this paper
• Risk prediction models for discrete ordinal outcomes: Calibration and the impact of the proportional odds assumption

  2021cites this paper
• Minimum sample size for external validation of a clinical prediction model with a binary outcome

  2021cites this paper
• Utilizing machine learning to improve clinical trial design for acute respiratory distress syndrome

  2021cites this paper
• Bayesian logistic regression for online recalibration and revision of risk prediction models with performance guarantees

  2021cites this paper
• Predicting Prolonged Length of ICU Stay through Machine Learning

  2021cites this paper
• Foundations of Machine Learning-Based Clinical Prediction Modeling: Part III-Model Evaluation and Other Points of Significance.

  2021cites this paper
• [Predicting prolonged length of intensive care unit stay via machine learning].

  2021cites this paper
• Derivation and Validation of a Prediction Model for Venous Thromboembolism in Primary Care

  2020cites this paper
• A multicenter random forest model for effective prognosis prediction in collaborative clinical research network

  2020cites this paper
• Predicting Prolonged Length of Hospital Stay for Peritoneal Dialysis–Treated Patients Using Stacked Generalization: Model Development and Validation Study

  2020cites this paper
• Detection of calibration drift in clinical prediction models to inform model updating

  2020cites this paper
• Development of a scoring tool for predicting prolonged length of hospital stay in peritoneal dialysis patients through data mining

  2020influential citation
• Clinical prediction models to predict the risk of multiple binary outcomes: a comparison of approaches

  2020cites this paper
• Risk Assessment Program of Highly Pathogenic Avian Influenza with Deep Learning Algorithm

  2020cites this paper
• CORR Synthesis: When Should We Be Skeptical of Clinical Prediction Models?

  2020cites this paper
• Model-Based ROC Curve: Examining the Effect of Case Mix and Model Calibration on the ROC Plot

  2020cites this paper
• Establishment and evaluation of a multicenter collaborative prediction model construction framework supporting model generalization and continuous improvement: A pilot study

  2020cites this paper
• Comparison of Prediction Model Performance Updating Protocols: Using a Data-Driven Testing Procedure to Guide Updating

  2020cites this paper
• Semi-supervised learning to improve generalizability of risk prediction models

  2019cites this paper
• validation of the GRace Score (Global Registry of acute coronary events) as Predictor of in-hospital Mortality in acute coronary Syndromes in Buenos aires

  2019cites this paper
• A clinical risk prediction model to identify patients with hepatorenal syndrome at hospital admission

  2019cites this paper
• Is Extraprostatic Extension of Cancer Predictable? A Review of Predictive Tools and an External Validation Based on a Large and a Single Center Cohort of Prostate Cancer Patients.

  2019cites this paper
• 10-year performance of four models of breast cancer risk: a validation study.

  2019cites this paper
• Utilizing dynamic treatment information for MACE prediction of acute coronary syndrome

  2019cites this paper
• Development of a national Department of Veterans Affairs mortality risk prediction model among patients with cirrhosis

  2019cites this paper
• Calibration: the Achilles heel of predictive analytics

  2019cites this paper
• External validation of a prediction model for pain and functional outcome after elective lumbar spinal fusion

  2019cites this paper
• Predicting 30-Day Hospital Readmission Risk in a National Cohort of Patients with Cirrhosis

  2019cites this paper
• Development of an automated phenotyping algorithm for hepatorenal syndrome

  2018cites this paper
• POPCORN: A web service for individual PrognOsis prediction based on multi-center clinical data CollabORatioN without patient-level data sharing

  2018cites this paper
• Nonparametric estimation and inference for polytomous discrimination index

  2018cites this paper
• Calibration of Prognostic Risk Scores

  2018cites this paper
• Calibration drift in regression and machine learning models for acute kidney injury

  2017cites this paper
• Erratum to: Assessing risk of osteoporotic fractures in primary care: development and validation of the FRA-HS algorithm

  2017cites this paper
• Key steps and common pitfalls in developing and validating risk models

  2017cites this paper
• Calibration Drift Among Regression and Machine Learning Models for Hospital Mortality

  2017cites this paper
• Sample size calculation to externally validate scoring systems based on logistic regression models

  2017cites this paper
• Approaches for credit scorecard calibration: An empirical analysis

  2017cites this paper
• A calibration hierarchy for risk models was defined: from utopia to empirical data.

  2016cites this paper
• Assessing Risk of Osteoporotic Fractures in Primary Care: Development and Validation of the FRA-HS Algorithm

  2016cites this paper
• Improving patient prostate cancer risk assessment: Moving from static, globally-applied to dynamic, practice-specific risk calculators

  2015cites this paper
• A calibration hierarchy for risk models: strong calibration occurs only in utopia

  2015influential citation
• calibmsm: An R package for calibration plots of the transition probabilities from a multistate model

  year unknowncites this paper
• References

  year unknowncites this paper
• Risk Prediction for Acute Kidney Injury in Patients Hospitalized With Coronavirus Disease 2019

  year unknowncites this paper
• Adapting Language Models to Produce Good Class Probabilities for Classification Tasks

  year unknowncites this paper