The Net Reclassification Index (NRI): A Misleading Measure of Prediction Improvement Even with Independent Test Data Sets

No abstract is available for this paper.

• Publication year

  2015

• Venue

  Statistics in Biosciences

• Publication date

  2015-10-01

• Fields of study

  Mathematics, Medicine

• Identifiers
  DOI 10.1007/S12561-014-9118-0PMID 26504496PMCID PMC4615606
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Does the Net Reclassification Improvement Help Us Evaluate Models and Markers?

  2014cited by this paper
• Net reclassification indices for evaluating risk prediction instruments: a critical review.

  2014cited by this paper
• A note on the evaluation of novel biomarkers: do not rely on integrated discrimination improvement and net reclassification index

  2014cited by this paper
• Commentary: On NRI, IDI, and "good-looking" statistics with nothing underneath.

  2014cited by this paper
• Net Reclassification Index: a Misleading Measure of Prediction Improvement

  2013cited by this paper
• Multicategory reclassification statistics for assessing improvements in diagnostic accuracy.

  2013cited by this paper
• Risk Assessment and Evaluation of Predictions

  2013cited by this paper
• Testing for improvement in prediction model performance

  2013cited by this paper
• Evaluating a New Marker for Risk Prediction Using the Test Tradeoff: An Update

  2012cited by this paper
• Novel metrics for evaluating improvement in discrimination: net reclassification and integrated discrimination improvement for normal variables and nested models

  2012cited by this paper
• Two Criteria for Evaluating Risk Prediction Models

  2011cited by this paper
• One statistical test is sufficient for assessing new predictive markers

  2011cited by this paper
• Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers

  2011cited by this paper
• Evaluating the incremental value of new biomarkers with integrated discrimination improvement.

  2011cited by this paper
• Traditional statistical methods for evaluating prediction models are uninformative as to clinical value: towards a decision analytic framework.

  2010cited by this paper
• Assessment of claims of improved prediction beyond the Framingham risk score.

  2009cited by this paper
• Using relative utility curves to evaluate risk prediction

  2009cited by this paper
• Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond

  2008influential reference
• Strictly Proper Scoring Rules, Prediction, and Estimation

  2007cited by this paper
• Decision Curve Analysis: A Novel Method for Evaluating Prediction Models

  2006cited by this paper
• Operating characteristics of prostate-specific antigen in men with an initial PSA level of 3.0 ng/ml or lower.

  2005cited by this paper
• The Elements of Statistical Learning: Data Mining, Inference, and Prediction

  2004cited by this paper
• Combining Several Screening Tests: Optimality of the Risk Score

  2002cited by this paper

• Development and validation of the A-TANGO organ failure score for acute-on-chronic liver failure in global cohorts.

  2026cites this paper
• Prognostic value of left atrial function in cardiac amyloidosis: a systematic review and meta‑analysis.

  2026cites this paper
• A Novel Cumulative Social Advantage Metric for Enhancing the Cardiovascular Health Construct and Predicting Mortality Risk.

  2025cites this paper
• Prediction of cardiovascular events by algorithm- and formula-based pulse wave velocity.

  2025cites this paper
• Machine learning prediction of overall survival in patients with cT1b renal cell carcinoma after surgical resection using the SEER database

  2025cites this paper
• Improving the diagnostic performance for prior COVID-19 with T-SPOT, an interferon-gamma release assay

  2025cites this paper
• Developing risk prediction models for type 2 diabetes and assessing the role of circulating metabolic biomarkers in five independent Finnish cohorts with over 22000 individuals.

  2025cites this paper
• Cardiac magnetic resonance versus echocardiography: An analysis examining risk reclassification by left ventricular ejection fraction and cost burden analysis

  2025cites this paper
• External validation of a novel HR-pQCT fracture risk assessment tool (μFRAC) in a female cohort: Sahlgrenska University Hospital Prospective Evaluation of Risk of Bone Fractures (SUPERB) study

  2025cites this paper
• Beyond Global Metrics: The U-Smile Method for Explainable, Interpretable, and Transparent Variable Selection in Risk Prediction Models

  2025cites this paper
• Predicting stroke with machine learning techniques in a sub-Saharan African population

  2025cites this paper
• Common pitfalls in critical care research

  2025cites this paper
• Enhancing Cardiovascular Risk Prediction with a Simplified Carotid IMT Protocol: Evidence from the IMPROVE Study

  2025cites this paper
• Mortality Risk Prediction Models for People With Kidney Failure

  2025cites this paper
• Predicting cognitive decline from neuropsychiatric symptoms and Alzheimer's disease biomarkers: A machine learning approach to a population-based data

  2025cites this paper
• Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance.

  2025cites this paper
• Weighted Brier Score - an Overall Summary Measure for Risk Prediction Models with Clinical Utility Consideration.

  2024cites this paper
• Twelve practical recommendations for developing and applying clinical predictive models

  2024cites this paper
• Refining the CHA2DS2VASc risk stratification scheme: shall we drop the sex category criterion?

  2024cites this paper
• Precautions to Consider in the Analysis of Prognostic and Predictive Indices

  2024cites this paper
• Prognostic value of left ventricular mass measured on coronary computed tomography angiography.

  2024cites this paper
• Validation of clinical risk assessment scores for venous thromboembolism in patients with cancer: a population-based cohort study.

  2024cites this paper
• Elevated Risk of Adverse Prognosis in Patients with T2-3 Stage Breast Cancer Exhibiting Non-Pathological Complete Response Following Neoadjuvant Chemotherapy: Significance of Regenerating Islet-Derived Family Member 4

  2024cites this paper
• Cardiovascular risk estimation: can a risk prediction model derived in one country be used in another?

  2024cites this paper
• Development and Validation of Prediction Models for Incident Reversible Cognitive Frailty Based on Social-Ecological Predictors Using Generalized Linear Mixed Model and Machine Learning Algorithms: A Prospective Cohort Study

  2024cites this paper
• Development and validation of a neoadjuvant chemotherapy pathological complete remission model based on Reg IV expression in breast cancer tissues: a clinical retrospective study

  2024cites this paper
• Genome-Wide Polygenic Risk Score Predicts Incident Type 2 Diabetes in Women With History of Gestational Diabetes.

  2024cites this paper
• Development and Validation of a Clinical Model for Predicting Delay in Postoperative Transfer Out of the Post-Anesthesia Care Unit: A Retrospective Cohort Study

  2024influential citation
• Visualising and quantifying the usefulness of new predictors stratified by outcome class: The U-smile method

  2024cites this paper
• Weighted metrics are required when evaluating the performance of prediction models in nested case–control studies

  2024cites this paper
• Leveraging Serial Low-Dose CT Scans in Radiomics-based Reinforcement Learning to Improve Early Diagnosis of Lung Cancer at Baseline Screening.

  2024cites this paper
• Development and validation of a point‐of‐care nursing mobile tool to guide the diagnosis of malnutrition in hospitalized adult patients: a multicenter, prospective cohort study

  2024cites this paper
• Incorporating polygenic risk into the Leicester Risk Assessment score for 10-year risk prediction of type 2 diabetes

  2024cites this paper
• Uncertainty-aware deep-learning model for prediction of supratentorial hematoma expansion from admission non-contrast head computed tomography scan

  2024cites this paper
• Derivation and Validation of a Clinical Risk Assessment Model for Cancer-Associated Thrombosis in Two Unique US Health Care Systems

  2023cites this paper
• Association and prognostic value of multi-domain frailty defined by cumulative deficit and phenotype models in patients with heart failure.

  2023cites this paper
• Development of a plasma-free amino acid-based risk score for the incidence of cardiovascular diseases in a general population: The Nagahama study.

  2023cites this paper
• Establishment and Validation of a Predictive Model for Post-Treatment Anxiety Based on Patient Attributes and Pre-Treatment Anxiety Scores

  2023cites this paper
• Development and validation of machine learning models for venous thromboembolism risk assessment at admission: a retrospective study

  2023cites this paper
• The value of blood-based measures of liver function and urate in lung cancer risk prediction: A cohort study and health economic analysis

  2023cites this paper
• Predictors and nomogram of in-hospital mortality in sepsis-induced myocardial injury: a retrospective cohort study

  2023cites this paper
• Validation of a Disease-Free Survival Prediction Model Using UBE2C and Clinical Indicators in Breast Cancer Patients

  2023cites this paper
• Response to Re: Modified Sequential Organ Failure Assessment score for predicting mortality in emergency department patients with sepsis

  2023cites this paper
• Comprehensive integrated analysis of MR and DCE-MR radiomics models for prognostic prediction in nasopharyngeal carcinoma

  2023cites this paper
• Severity of Illness Scores and Biomarkers for Prognosis of Patients with Coronavirus Disease 2019

  2023cites this paper
• Clinical utility gains from incorporating comorbidity and geographic location information into risk estimation equations for atherosclerotic cardiovascular disease

  2022cites this paper
• Prediction of Cardiovascular Events by Pulse Waveform Parameters: Analysis of CARTaGENE

  2022cites this paper
• Breast Arterial Calcification: a Novel Cardiovascular Risk Enhancer Among Postmenopausal Women

  2022cites this paper
• Methodological concerns about “concordance-statistic for benefit” as a measure of discrimination in predicting treatment benefit

  2022cites this paper
• Cohen’s Kappa Coefficient as a Measure to Assess Classification Improvement following the Addition of a New Marker to a Regression Model

  2022cites this paper
• Better prediction of stroke in atrial fibrillation with incorporation of cancer in CHA2DS2VASC score: CCHA2DS2VASC score

  2022cites this paper
• Statistical methods for validation of predictive models

  2022cites this paper
• A Biomarker‐Enhanced Model for Prediction of Acute Kidney Injury and Cardiovascular Risk Following Angiographic Procedures: CASABLANCA AKI Prediction Substudy

  2022cites this paper
• Application of the International IgA Nephropathy Prediction Tool one or two years post-biopsy.

  2022cites this paper
• Calculated versus measured albumin-creatinine ratio to predict kidney failure and death in people with chronic kidney disease.

  2022cites this paper
• A Novel Nomogram for Predicting Morbidity Risk in Patients with Secondary Malignant Neoplasm of Bone and Bone Marrow: An Analysis Based on the Large MIMIC-III Clinical Database

  2022cites this paper
• A Modified Net Reclassification Improvement Statistic.

  2022cites this paper
• The GROW customised fetal growth model: background, principles, validation and application

  2022cites this paper
• Polygenic risk scores for the prediction of cardiometabolic disease.

  2022cites this paper
• Methodological guidance for the evaluation and updating of clinical prediction models: a systematic review

  2022cites this paper
• Establishment and Validation of a Model for Disease-Free Survival Rate Prediction Using the Combination of microRNA-381 and Clinical Indicators in Patients with Breast Cancer

  2022cites this paper
• Serum insulin-like growth factor binding protein 3 as a promising diagnostic and prognostic biomarker in esophagogastric junction adenocarcinoma

  2022cites this paper
• Net Reclassification Index Statistics Do Not Help Assess New Risk Models.

  2022cites this paper
• Plasma extracellular vesicle SerpinG1 and CD14 levels are associated with MACE and MALE in patients undergoing femoral endarterectomy.

  2022cites this paper
• Stratification in systemic sclerosis according to autoantibody status versus skin involvement: a study of the prospective EUSTAR cohort.

  2022cites this paper
• Development and validation of novel multimorbidity indices for older adults

  2022cites this paper
• The clinical meaning of the area under a receiver operating characteristic curve for the evaluation of the performance of disease markers

  2022cites this paper
• Prognostic value of reverse remodelling criteria in heart failure with reduced or mid‐range ejection fraction

  2021cites this paper
• External validation of EPIC’s Risk of Unplanned Readmission model, the LACE+ index and SQLape as predictors of unplanned hospital readmissions: A monocentric, retrospective, diagnostic cohort study in Switzerland

  2021cites this paper
• Renal Disease and Atrial Fibrillation.

  2021cites this paper
• Development of an ensemble machine learning prognostic model to predict 60-day risk of major adverse cardiac events in adults with chest pain

  2021cites this paper
• Cystatin C predicts long term mortality better than creatinine in a nationwide study of intensive care patients

  2021cites this paper
• Prospective Validation and Comparative Analysis of Coronary Risk Stratification Strategies Among Emergency Department Patients With Chest Pain

  2021cites this paper
• Circulation: Cardiovascular Quality and Outcomes

  2021cites this paper
• Blood transcriptomics as non-invasive marker for kidney transplant rejection.

  2021cites this paper
• National Heart Foundation of Australia: position statement on coronary artery calcium scoring for the primary prevention of cardiovascular disease in Australia

  2021cites this paper
• Dynamic Amyloid PET: Relationships to 18F-Flortaucipir Tau PET Measures

  2021cites this paper
• Toward Dynamic Risk Prediction of Outcomes After Coronary Artery Bypass Graft

  2021cites this paper
• Area Deprivation Index and Cardiac Readmissions: Evaluating Risk‐Prediction in an Electronic Health Record

  2021cites this paper
• Additional Effect of Coronary High-Intensity Plaque on T1-Weighted Magnetic Resonance Imaging With Circulating Malondialdehyde-Modified Low-Density Lipoprotein on Cardiac Events.

  2021cites this paper
• European Heart Journal quality standards.

  2021cites this paper
• Perfusion imaging combined with coronary calcium scoring. A step further towards individualized medicine?

  2021cites this paper
• Coronary Microcirculatory Dysfunction and Acute Cellular Rejection After Heart Transplantation

  2021cites this paper
• Urinary Neutrophil Gelatinase–Associated Lipocalin/Hepcidin-25 Ratio for Early Identification of Patients at Risk for Renal Replacement Therapy After Cardiac Surgery: A Substudy of the BICARBONATE Trial

  2021cites this paper
• Clinical lipidomics: realizing the potential of lipid profiling

  2021cites this paper
• Establishment of a prognostic model for patients with sepsis based on SOFA: a retrospective cohort study

  2021cites this paper
• Recalibration Methods for Improved Clinical Utility of Risk Scores

  2021cites this paper
• Performance Metrics for the Comparative Analysis of Clinical Risk Prediction Models Employing Machine Learning

  2021cites this paper
• A Survival Prediction Nomogram for Esophageal Squamous Cell Carcinoma Treated with Neoadjuvant Chemoradiotherapy Followed by Surgery

  2021cites this paper
• Combined suPAR and qSOFA for the prediction of 28-day mortality in sepsis patients

  2021cites this paper
• Predictive Ability of European Heart Surgery Risk Assessment System II (EuroSCORE II) and the Society of Thoracic Surgeons (STS) Score for in-Hospital and Medium-Term Mortality of Patients Undergoing Coronary Artery Bypass Grafting

  2021cites this paper
• Are polygenic risk scores ready for the cancer clinic?—a perspective

  2021cites this paper
• A Systematic Framework for Assessing the Clinical Impact of Polygenic Risk Scores

  2021cites this paper
• Apply Four Laboratory Characteristics to Classify Critical Patients With COVID-19 After Admission

  2020cites this paper
• Which N descriptor is more predictive of prognosis in resected non-small cell lung cancer: the number of involved nodal stations versus the location-based pathological N stage?

  2020cites this paper
• Evaluating the incremental value of a new model: Area under the ROC curve or under the PR curve

  2020influential citation
• Benchmarking the Accuracy of Polygenic Risk Scores and their Generative Methods

  2020cites this paper
• Improved 30 day heart failure rehospitalization prediction through the addition of device‐measured parameters

  2020cites this paper
• A fundamental principle of coronary pathophysiology for risk stratifying coronary artery disease.

  2020cites this paper
• Criteria for evaluating risk prediction of multiple outcomes

  2020cites this paper