Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies: The CHARMS Checklist

Carl Moons and colleagues provide a checklist and background explanation for critically appraising and extracting data from systematic reviews of prognostic and diagnostic prediction modelling studies. Please see later in the article for the Editors' Summary

• Publication year

  2014

• Venue

  PLoS Medicine

• Publication date

  2014-10-01

• Fields of study

  Medicine

• Identifiers
  DOI 10.1371/journal.pmed.1001744PMID 25314315PMCID 4196729
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Early prediction of outcome of activities of daily living after stroke : a systematic

  2015cited by this paper
• 2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines

  2014cited by this paper
• Circulating MicroRNAs as a Novel Class of Diagnostic Biomarkers in Gastrointestinal Tumors Detection: A Meta-Analysis Based on 42 Articles

  2014cited by this paper
• Discrepancies in predicted fracture risk in elderly people

  2013cited by this paper
• Effect of changes over time in the performance of a customized SAPS-II model on the quality of care assessment

  2013cited by this paper
• Assessing Bias in Studies of Prognostic Factors

  2013cited by this paper
• A systematic review finds prediction models for chronic kidney disease were poorly reported and often developed using inappropriate methods.

  2013cited by this paper
• Prognosis Research Strategy (PROGRESS) 3: Prognostic Model Research

  2013cited by this paper
• External validation of a Cox prognostic model: principles and methods

  2013cited by this paper
• 2013 ACCF/AHA guideline for the management of heart failure: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines.

  2013cited by this paper
• Performance of the original EuroSCORE.

  2012cited by this paper
• Comparison of approaches to estimate confidence intervals of post-test probabilities of diagnostic test results in a nested case-control study

  2012cited by this paper
• Predicting the 10 year risk of cardiovascular disease in the United Kingdom: independent and external validation of an updated version of QRISK2

  2012cited by this paper
• Search Filters for Finding Prognostic and Diagnostic Prediction Studies in Medline to Enhance Systematic Reviews

  2012cited by this paper
• Reporting and Methods in Clinical Prediction Research: A Systematic Review

  2012influential reference
• Comparisons of established risk prediction models for cardiovascular disease: systematic review

  2012cited by this paper
• A simple adaptation method improved the interpretability of prediction models for composite end points.

  2012cited by this paper
• Risk assessment of fragility fractures: summary of NICE guidance

  2012cited by this paper
• Risk prediction models: II. External validation, model updating, and impact assessment

  2012influential reference
• Comparing risk prediction models

  2012cited by this paper
• Against quantiles: categorization of continuous variables in epidemiologic research, and its discontents

  2012cited by this paper
• Risk prediction measures for case-cohort and nested case-control designs: an application to cardiovascular disease.

  2012cited by this paper
• Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker

  2012cited by this paper
• Practice of Epidemiology Problems With Risk Reclassification Methods for Evaluating Prediction Models

  2011cited by this paper
• Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers

  2011cited by this paper
• Effect of changes over time in the performance of a customized SAPS-II model on the quality of care assessment

  2011cited by this paper
• Strengthening the reporting of genetic risk prediction studies (GRIPS): explanation and elaboration

  2011cited by this paper
• Optimized retrieval of primary care clinical prediction rules from MEDLINE to establish a Web-based register.

  2011cited by this paper
• Improvements in risk stratification for the occurrence of cardiovascular disease by imaging subclinical atherosclerosis: a systematic review

  2011cited by this paper
• Performance of logistic regression modeling: beyond the number of events per variable, the role of data structure.

  2011cited by this paper
• Prediction models for the risk of cardiovascular disease in patients with type 2 diabetes: a systematic review

  2011cited by this paper
• The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials

  2011cited by this paper
• Early Prediction of Outcome of Activities of Daily Living After Stroke: A Systematic Review

  2011cited by this paper
• Regression with Missing X's: A Review

  2011cited by this paper
• What is a systematic review?

  2011cited by this paper
• Developing risk prediction models for type 2 diabetes: a systematic review of methodology and reporting

  2011influential reference
• Multiple imputation using chained equations: Issues and guidance for practice

  2011cited by this paper
• QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies

  2011cited by this paper
• Reporting performance of prognostic models in cancer: a review

  2010cited by this paper
• Clinical Prediction Models: A Practical Approach to Development, Validation and Updating by STEYERBERG, E. W

  2010influential reference
• Accuracy and quality of clinical decision rules for syncope in the emergency department: a systematic review and meta-analysis.

  2010cited by this paper
• Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures

  2010cited by this paper
• CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials

  2010cited by this paper
• Missing covariate data in medical research: to impute is better than to ignore.

  2010cited by this paper
• Reporting methods in studies developing prognostic models in cancer: a review

  2010influential reference
• Comparison of techniques for handling missing covariate data within prognostic modelling studies: a simulation study

  2010cited by this paper
• External validity of risk models: Use of benchmark values to disentangle a case-mix effect from incorrect coefficients.

  2010cited by this paper
• Prediction Models for Prolonged Intensive Care Unit Stay After Cardiac Surgery: Systematic Review and Validation Study

  2010cited by this paper
• Everything you always wanted to know about evaluating prediction models (but were too afraid to ask).

  2010cited by this paper
• The use and reporting of multiple imputation in medical research – a review

  2010cited by this paper
• Development and validation of a prediction model with missing predictor data: a practical approach.

  2010cited by this paper
• Prognosis and prognostic research: application and impact of prognostic models in clinical practice

  2009cited by this paper
• The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

  2009cited by this paper
• Prognosis and prognostic research: Developing a prognostic model

  2009cited by this paper
• Dealing with missing predictor values when applying clinical prediction models.

  2009cited by this paper
• Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls

  2009cited by this paper
• Should a Head-Injured Child Receive a Head CT Scan? A Systematic Review of Clinical Prediction Rules

  2009cited by this paper
• Assessment of claims of improved prediction beyond the Framingham risk score.

  2009cited by this paper
• A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard.

  2009cited by this paper
• Prognosis and prognostic research: validating a prognostic model

  2009influential reference
• Prediction models in reproductive medicine: a critical appraisal.

  2009cited by this paper
• Prognosis and prognostic research: what, why, and how?

  2009influential reference
• The Accuracy of Risk Scores in Predicting Ovarian Malignancy: A Systematic Review

  2009cited by this paper
• Clinical Prediction Rules for Physical Therapy Interventions: A Systematic Review

  2009cited by this paper
• Reporting of prognostic studies of tumour markers: a review of published articles in relation to REMARK guidelines

  2009cited by this paper
• Clinical Prediction Models—a Practical Approach to Development, Validation and Updating

  2009cited by this paper
• The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

  2009cited by this paper
• Prognostic Models: A Methodological Framework and Review of Models for Breast Cancer

  2009cited by this paper
• How should variable selection be performed with multiply imputed data?

  2008cited by this paper
• Updating methods improved the performance of a clinical prediction model in new patients.

  2008cited by this paper
• Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve.

  2008cited by this paper
• Assessing new biomarkers and predictive models for use in clinical practice: a clinician's guide.

  2008cited by this paper
• Inventory of prostate cancer predictive tools

  2008cited by this paper
• Bias in sensitivity and specificity caused by data-driven selection of optimal cutoff values: mechanisms, magnitude, and solutions.

  2008cited by this paper
• Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond

  2008cited by this paper
• Diagnostic accuracy of clinical prediction rules to exclude acute coronary syndrome in the emergency department setting: a systematic review.

  2008cited by this paper
• Validation, updating and impact of clinical prediction rules: a review.

  2008cited by this paper
• Clinical Epidemiology: Principles, Methods, and Applications for Clinical Research

  2008cited by this paper
• Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)

  2008cited by this paper
• Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)

  2008cited by this paper
• Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)

  2008cited by this paper
• Prognosis research: toward evidence-based results and a Cochrane methods group.

  2007cited by this paper
• Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies

  2007cited by this paper
• Relaxing the rule of ten events per variable in logistic and Cox regression.

  2007cited by this paper
• Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials

  2007cited by this paper
• Quality of reporting of cancer prognostic marker studies: association with reported prognostic effect.

  2007cited by this paper
• External validation of prognostic models for critically ill patients required substantial sample sizes.

  2007cited by this paper
• Evaluation of diagnostic tests when there is no gold standard. A review of methods.

  2007cited by this paper
• Breast Cancer—Translational Therapeutic Strategies

  2007cited by this paper
• The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies

  2007cited by this paper
• Prognosis research: why is Dr. Lydgate still waiting?

  2006cited by this paper
• Evidence of bias and variation in diagnostic accuracy studies

  2006cited by this paper
• The cost of dichotomising continuous variables

  2006cited by this paper
• Bmc Medical Research Methodology Open Access Intra-cluster Correlation Coefficients in Adults with Diabetes in Primary Care Practices: the Vermont Diabetes Information System Field Survey

  2006cited by this paper
• Decision Curve Analysis: A Novel Method for Evaluating Prediction Models

  2006cited by this paper
• SPECIAL SERIES: ORIGINAL ARTICLES Using the outcome for imputation of missing predictor values was preferred

  2006cited by this paper
• Some prognostic models for traumatic brain injury were not valid.

  2006cited by this paper
• Evaluation of the Quality of Prognosis Studies in Systematic Reviews

  2006cited by this paper
• SPECIAL SERIES: MISSING DATA Review: A gentle introduction to imputation of missing values

  2006cited by this paper
• Translating Clinical Research into Clinical Practice: Impact of Using Prediction Rules To Make Decisions

  2006influential reference

• Barriers students with epilepsy and their caregivers face regarding school participation and seizure management within school.

  2026cites this paper
• Risk prediction model for peripherally inserted central catheters related bloodstream infection: a systematic review.

  2026cites this paper
• Predicting neoadjuvant immunotherapy efficacy with machine learning models in non-small cell lung cancer: A systematic review and meta analysis.

  2026cites this paper
• Prognostic models in populations with heart failure: a systematic review and meta-analysis.

  2026cites this paper
• Artificial intelligence in electrocardiogram-based prediction of heart failure: a systematic review and meta-analysis

  2026cites this paper
• Risk prediction models for malignant cerebral edema after endovascular therapy in patients with acute anterior circulation large vessel occlusion stroke: a systematic review and meta-analysis.

  2026cites this paper
• Prognostic factors for mortality in patients infected with New World hantaviruses: a systematic review and meta-analysis

  2026cites this paper
• Risk prediction models for sepsis-associated encephalopathy: a systematic evaluation and meta-analysis

  2026cites this paper
• Artificial intelligence-enabled electrocardiography to predict impending episodes of ventricular tachycardia in individuals under continuous heart rhythm monitoring.

  2026cites this paper
• Comparisons of Machine Learning Models to Logistic Regression in Orthopedic Sports Medicine are Confounded by Methodological Heterogeneity: A Systematic Review and Meta-Analysis.

  2026cites this paper
• Risk factors for renal stone development in adults with primary hyperparathyroidism: a protocol for a systematic review and meta-analysis

  2026cites this paper
• Risk prediction models for blood transfusion in patients undergoing total hip and knee arthroplasty: a systematic review and meta-analysis

  2026cites this paper
• MaAsLin 3: refining and extending generalized multivariable linear models for meta-omic association discovery.

  2026cites this paper
• Prognostic value of machine learning for brain computed tomography as a predictor of neurologic outcomes after cardiac arrest: a systematic review and meta-analysis

  2026cites this paper
• Performance of the Leicester risk assessment and Leicester practice risk scores for assessing the risk of undiagnosed type 2 diabetes or prediabetes in diverse populations: protocol for a systematic review of published validations and updates

  2026cites this paper
• Evaluating methodological quality of prognostic prediction models on patient-reported outcome measurements after total hip and total knee arthroplasty

  2026cites this paper
• Machine learning-based COVID-19 prognostic models lag behind in reporting quality: findings from a TRIPOD/TRIPOD + AI systematic review

  2026cites this paper
• Risk prediction models for cardiac rupture after acute myocardial infarction: a systematic review and meta-analysis.

  2026cites this paper
• Oral mucosal pressure injury risk prediction models in intensive care unit patients with orotracheal intubation: A systematic review and meta-analysis.

  2026cites this paper
• Predictive factors in tomographic imaging for inferior alveolar nerve injury during third-molar surgery: A systematic review and meta-analysis.

  2026cites this paper
• Comparison of an Ultrasound-Based System and the Bishop Score for Predicting Labor Induction Timing in Singleton Pregnancies at Term: A Prospective Cohort Study.

  2026cites this paper
• Prediction models for early neurological deterioration in patients with acute ischemic stroke: a systematic review and critical appraisal

  2026cites this paper
• A comparison of methodological approaches to developing clinical prediction models for individuals living with multiple long-term conditions: a protocol for a systematic review

  2026cites this paper
• Can patient-reported outcome measures predict mortality in neurological populations? A systematic review

  2026cites this paper
• Prognostic significance of the dysplastic margin for predicting recurrence and survival in patients with primary oral squamous cell carcinoma resected with curative intent: a systematic review protocol.

  2026cites this paper
• Risk prediction models for postmenopausal osteoporosis: a systematic review and meta-analysis study

  2026cites this paper
• Association between C-reactive protein and adverse events in secondary cardiovascular prevention: A systematic review and meta-analysis of prognostic factor studies.

  2026cites this paper
• Prediction of frailty in community older adults based on machine learning: a systematic review and meta-analysis

  2026cites this paper
• Risk prediction models for detecting a new diagnosis of heart failure within 5 years in the community: a systematic review

  2026cites this paper
• Artificial Intelligence–Driven Differentiation Between Uveal Melanoma and Nevus Based on Fundus Photographs: A Systematic Review and Meta-Analysis

  2026cites this paper
• Systematic review and meta - analysis of risk prediction models for heart failure after PCI in patients with acute myocardial infarction

  2026cites this paper
• Systematic literature reviews in trauma research: what is important to know?

  2026cites this paper
• Prediction Models for Postoperative Delirium After Cardiovascular Surgery: A Systematic Review and Critical Appraisal

  2026cites this paper
• Prognostic factors for outcomes following needling and shockwave therapy in rotator cuff calcific tendinitis: A systematic review.

  2026cites this paper
• Prediction models for caesarean section following induction of labour: a systematic review of methodology and reporting quality

  2026cites this paper
• The risk prediction models for sarcopenia in older adults: a systematic review and critical appraisal

  2026cites this paper
• Risk prediction models for hepatic encephalopathy following TIPS: a systematic review and meta-analysis

  2026cites this paper
• Disability risk prediction models in community-dwelling older adults: a systematic review.

  2026cites this paper
• Healthcare practitioner involvement in data-driven clinical decision support development and evaluation: Critical narrative review of recommendations.

  2026cites this paper
• Risk prediction models for cognitive impairment in patients with cerebral small vessel disease: a systematic review and meta-analysis

  2026cites this paper
• Effect of statin use on the development of sarcopenia in older adults: A systematic review and meta-analysis.

  2026cites this paper
• Systematic review of risk prediction models for sepsis-associated brain dysfunction

  2026cites this paper
• Prognostic Models for Predicting Coronary Heart Disease Risk in Patients with Type 2 Diabetes Mellitus: A Systematic Review and Meta-Analysis

  2026cites this paper
• Machine learning for predictive risk stratification in recurrent miscarriage: a systematic review.

  2026cites this paper
• Community-based prediction models of cardiovascular events, acute exacerbations and all-cause mortality in individuals with chronic obstructive pulmonary disease: a systematic review and meta-analysis on behalf of the International Cardiovascular and Respiratory Alliance

  2026cites this paper
• Prognostic Factors Associated with Pneumonia in Patients with Traumatic Brain Injury: A Systematic Review and Meta-analysis.

  2026cites this paper
• Predictive models for acute kidney injury in acute pancreatitis: a systematic review and meta-analysis.

  2026cites this paper
• Can multiparametric FDG-PET/MRI analysis really enhance the prediction of myocardial recovery after CTO revascularization? A machine learning study

  2025cites this paper
• Machine learning-based prediction models for falls in hospitalized patients: A systematic review and meta-analysis.

  2025cites this paper
• Letter to 'Risk Prediction Models for Frailty in Adult Maintenance Haemodialysis Patients: A Systematic Review and Methodological Appraisal'.

  2025cites this paper
• Prediction Models for Postoperative Delirium of Cardiovascular Surgery (PODOCVS): Protocol for a Systematic Review

  2025cites this paper
• Clinical prediction models for medication adverse events in patients with rheumatic and musculoskeletal conditions: A systematic literature review.

  2025cites this paper
• Risk prediction models for non-suicidal self-injurious behavior in patient with depressive disorder: a protocol for systematic review and mata-analyisis

  2025cites this paper
• Predicting the natural history of unruptured brain arteriovenous malformations: external validation of rupture risk scores.

  2025cites this paper
• Evaluation of prognostic factors for mortality in cancer patients with sepsis in the intensive care unit: systematic review protocol

  2025cites this paper
• Towards good practice In engaging users In evaluation of computer model Software: Introducing the critical appraisal approach (CAA)

  2025cites this paper
• Rigorous validation of machine learning in laboratory medicine: guidance toward quality improvement

  2025cites this paper
• A comprehensive review of ICU readmission prediction models: From statistical methods to deep learning approaches

  2025cites this paper
• Prediction models for severe treatment-related toxicities in older adults with cancer: a systematic review.

  2025cites this paper
• Prediction models for liver decompensation in compensated advanced chronic liver disease: a systematic review.

  2025cites this paper
• Function in the first year after paediatric critical illness- a systematic review and meta-analysis

  2025cites this paper
• Comparison of machine learning models with conventional statistical methods for prediction of percutaneous coronary intervention outcomes: a systematic review and meta-analysis

  2025cites this paper
• Limited generalizability and high risk of bias in multivariable models predicting conversion risk from mild cognitive impairment to dementia: A systematic review

  2025cites this paper
• Clinical prognostic models for sarcomas: a systematic review and critical appraisal of development and validation studies

  2025cites this paper
• Systematic literature review on the application of explainable artificial intelligence in palliative care studies

  2025cites this paper
• Risk Prediction Models for Sarcopenia in Patients Undergoing Maintenance Haemodialysis: A Systematic Review and Meta-Analysis.

  2025cites this paper
• Microbiota as a state-of-the-art approach in precision medicine for pancreatic cancer management: A comprehensive systematic review

  2025cites this paper
• Prognostic prediction model for chronic postsurgical pain among adult patients: a systematic review and meta-analysis

  2025cites this paper
• Clinical prediction instruments available for clinicians treating major depressive disorder: A systematic review.

  2025cites this paper
• Systematic Review and Meta-Analysis of Machine Learning Models for Acute Kidney Injury Risk Classification.

  2025cites this paper
• Deep neural networks excel in COVID-19 disease severity prediction—a meta-regression analysis

  2025cites this paper
• Postoperative inflammatory responses and association with in‐hospital mortality after general surgery

  2025cites this paper
• PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods

  2025cites this paper
• Risk prediction models for frailty in older adults: A systematic review and critical appraisal.

  2025cites this paper
• Association between patient age and vital pulp therapy outcomes: A systematic review and meta-analysis of prognostic studies.

  2025cites this paper
• Preoperative Factors Associated With In-Hospital Major Bleeding After Percutaneous Coronary Intervention: A Systematic Review.

  2025cites this paper
• Systematic Analysis and Critical Appraisal of Predictive Models for Lung Infection Risk in ICU Patients

  2025cites this paper
• Risk Prediction Models for Contrast-associated Acute Kidney Injury After Percutaneous Coronary Intervention: A Systematic Review.

  2025cites this paper
• Risk of bias assessment of post-stroke mortality machine learning predictive models: Systematic review.

  2025cites this paper
• Using machine learning methods to predict the outcome of psychological therapies for post-traumatic stress disorder: A systematic review.

  2025cites this paper
• Return to work after major trauma: a systematic review

  2025cites this paper
• A systematic literature review of the National Early Warning Score (NEWS)-2 using Prediction Model Risk of Bias Assessment Tool (PROBAST)

  2025cites this paper
• Systematic review and critical appraisal of predictive models for diabetic peripheral neuropathy: Existing challenges and proposed enhancements

  2025cites this paper
• Risk prediction model for surgical site infection in patients with gastrointestinal cancer: a systematic review and meta-analysis

  2025cites this paper
• Risk prediction models for dental caries in children and adolescents: a systematic review and meta-analysis

  2025cites this paper
• Prediction models for adjacent vertebral fractures after vertebral augmentation: a systematic review and meta-analysis

  2025cites this paper
• Prediction Models for Intraoperative Acquired Pressure Injury of Adults: A Systematic Review and Critical Appraisal.

  2025cites this paper
• Prognostic models for survival predictions in advanced cancer patients: a systematic review and meta-analysis

  2025cites this paper
• The reporting quality and methodological quality of dynamic prediction models for cancer prognosis

  2025cites this paper
• Artificial intelligence based predictive tools for identifying type 2 diabetes patients at high risk of treatment Non-adherence: A systematic review

  2025cites this paper
• Preoperative prediction models for postoperative delirium in cardiac surgery patients – a scoping review

  2025cites this paper
• Risk Prediction Models for Sentinel Node Positivity in Melanoma: A Systematic Review and Meta-Analysis.

  2025cites this paper
• Risk Prediction Models for Stress Urinary Incontinence in Pregnant and Postpartum Women: A Systematic Review and Critical Appraisal

  2025cites this paper
• A Novel Nomogram Integrating Retinal Microvasculature and Clinical Indicators for Individualized Prediction of Early Neurological Deterioration in Single Subcortical Infarction

  2025cites this paper
• Sex as a prognostic factor for mortality in adults with acute symptomatic pulmonary embolism.

  2025cites this paper
• Do We Need to Add the Type of Treatment Planning System, Dose Calculation Grid Size, and CT Density Curve to Predictive Models?

  2025cites this paper
• Epidemiology and reporting characteristics of systematic reviews of clinical prediction models:a scoping review.

  2025cites this paper
• Prognostic factors predicting an unprovoked seizure recurrence in children and adults following a first unprovoked seizure.

  2025influential citation
• Upper Airway Collapse in Patients With Severe Acquired Brain Injury Who Underwent Tracheostomy

  2025cites this paper
• Prognostic models for unplanned intensive care unit readmission risk prediction: A systematic review and meta‐analysis based on HSROC model

  2025cites this paper