A Bootstrap Machine Learning Approach to Identify Rare Disease Patients from Electronic Health Records

Rare diseases are very difficult to identify among large number of other possible diagnoses. Better availability of patient data and improvement in machine learning algorithms empower us to tackle this problem computationally. In this paper, we target one such rare disease - cardiac amyloidosis. We aim to automate the process of identifying potential cardiac amyloidosis patients with the help of machine learning algorithms and also learn most predictive factors. With the help of experienced cardiologists, we prepared a gold standard with 73 positive (cardiac amyloidosis) and 197 negative instances. We achieved high average cross-validation F1 score of 0.98 using an ensemble machine learning classifier. Some of the predictive variables were: Age and Diagnosis of cardiac arrest, chest pain, congestive heart failure, hypertension, prim open angle glaucoma, and shoulder arthritis. Further studies are needed to validate the accuracy of the system across an entire health system and its generalizability for other diseases.

• Publication year

  2016

• Venue

  arXiv.org

• Publication date

  2016-09-06

• Fields of study

  Medicine, Computer Science, Mathematics

• Identifiers
  arXiv 1609.01586
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Using EHRs for Heart Failure Therapy Recommendation Using Multidimensional Patient Similarity Analytics

  2016cited by this paper
• PubMed-supported clinical term weighting approach for improving inter-patient similarity measure in diagnosis prediction

  2015cited by this paper
• Personalized Mortality Prediction Driven by Electronic Medical Data and a Patient Similarity Metric

  2015cited by this paper
• Identification of type 2 diabetes subgroups through topological analysis of patient similarity

  2015cited by this paper
• An Electronic Medical Record System with Treatment Recommendations Based on Patient Similarity

  2015cited by this paper
• Preliminary validation of a scale to measure patient perceived similarity to their navigator

  2015cited by this paper
• PSF: A Unified Patient Similarity Evaluation Framework Through Metric Learning With Weak Supervision

  2015cited by this paper
• Identifying prognostic factors predicting outcome in patients with chronic neck pain after multimodal treatment: A retrospective study.

  2015cited by this paper
• Personalized Predictive Modeling and Risk Factor Identification using Patient Similarity

  2015cited by this paper
• Similarity Measure Between Patient Traces for Clinical Pathway Analysis: Problem, Method, and Applications

  2014cited by this paper
• Towards Personalized Medicine: Leveraging Patient Similarity and Drug Similarity Analytics

  2014cited by this paper
• Conceptualising and creating a global learning health system

  2013cited by this paper
• Support vector machine

  2013cited by this paper
• Random Search for Hyper-Parameter Optimization

  2012cited by this paper
• Mining electronic health records: towards better research applications and clinical care

  2012cited by this paper
• Use of electronic health record data to evaluate overuse of cervical cancer screening

  2012cited by this paper
• The orphan disease networks.

  2011cited by this paper
• Detecting pregnancy use of non-hormonal category X medications in electronic medical records

  2011cited by this paper
• Achieving a Nationwide Learning Health System

  2010cited by this paper
• Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications

  2010cited by this paper
• Why rare diseases are an important medical and social issue.

  2008cited by this paper
• Classification and Regression by randomForest

  2007cited by this paper
• Support Vector Machine

  2007cited by this paper
• Association mining

  2006cited by this paper
• Handling imbalanced datasets: A review

  2006cited by this paper
• Rare essentials: drugs for rare diseases as essential medicines.

  2006cited by this paper
• Feature selection, L1 vs. L2 regularization, and rotational invariance

  2004cited by this paper
• On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality

  2004cited by this paper
• Induction of decision trees

  2004cited by this paper
• A two-gene expression ratio predicts clinical outcome in breast cancer patients treated with tamoxifen.

  2004cited by this paper
• Discretization: An Enabling Technique

  2002cited by this paper
• Soft Margins for AdaBoost

  2001cited by this paper
• An empirical study of the naive Bayes classifier

  2001cited by this paper
• An empirical study of the naive Bayes classifier

  2001cited by this paper
• Least Squares Support Vector Machine Classifiers

  1999cited by this paper
• A comparison of event models for naive bayes text classification

  1998cited by this paper
• Fast Algorithms for Mining Association Rules

  1998cited by this paper
• Wrappers for Feature Subset Selection

  1997cited by this paper
• An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression

  1992cited by this paper
• An algorithm for finding nearest neighbours in (approximately) constant average time

  1986cited by this paper
• An algorithm for finding nearest neighbours in (approximately) constant average time

  1986cited by this paper
• [Cardiac amyloidosis].

  1980cited by this paper

• Assessing the quality of reporting in artificial intelligence/machine learning research for cardiac amyloidosis.

  2025cites this paper
• The Role of Artificial Intelligence in the Detection of Cardiac Amyloidosis: A Systematic Review

  2025cites this paper
• Artificial Intelligence as a Tool for Diagnosis of Cardiac Amyloidosis: A Systematic Review

  2024cites this paper
• Predicting blind-use test (BUT) results from sensory testing using Bayesian bootstrapping

  2024cites this paper
• Risk Prediction and Calibration with Weak Supervision using the Electronic Health Record

  2023cites this paper
• Automatically pre-screening patients for the rare disease aromatic l-amino acid decarboxylase deficiency using knowledge engineering, natural language processing, and machine learning on a large EHR population

  2023cites this paper
• Reducing diagnostic delays in Acute Hepatic Porphyria using electronic health records data and machine learning: a multicenter development and validation study

  2023cites this paper
• A semi-supervised adaptive Markov Gaussian embedding process (SAMGEP) for prediction of phenotype event times using the electronic health record

  2022cites this paper
• SAMGEP: A Novel Method for Prediction of Phenotype Event Times Using the Electronic Health Record

  2021cites this paper
• Real-World Data and Machine Learning to Predict Cardiac Amyloidosis

  2021cites this paper
• Where Do We Stand in Regularization for Life Science Studies?

  2021cites this paper
• Multistage transfer learning technique for classifying rare medical datasets

  2021cites this paper
• RareBERT: Transformer Architecture for Rare Disease Patient Identification using Administrative Claims

  2021cites this paper
• What can machines learn about heart failure? A systematic literature review

  2021cites this paper
• Detecting rare diseases in electronic health records using machine learning and knowledge engineering: Case study of acute hepatic porphyria

  2020cites this paper
• Disease Prediction via Graph Neural Networks

  2020cites this paper
• The emerging landscape of health research based on biobanks linked to electronic health records: Existing resources, statistical challenges, and potential opportunities

  2019cites this paper
• A Review of Automatic Phenotyping Approaches using Electronic Health Records

  2019influential citation
• Applying Support Vector Machine to Electronic Health Records for Cancer Classification

  2019cites this paper
• Bridging the implementation gap of machine learning in healthcare

  2019cites this paper
• Robust Ensemble Learning to Identify Rare Disease Patients from Electronic Health Records

  2018cites this paper
• Extraction and Classification of Human Body Parameters for Gait Analysis

  2018cites this paper
• A Systematic Machine Learning Based Approach for the Diagnosis of Non-Alcoholic Fatty Liver Disease Risk and Progression

  2018cites this paper
• Learning to Identify Rare Disease Patients from Electronic Health Records

  2018cites this paper
• Towards use of electronic health records: cancer classification

  2017cites this paper