Mining Electronic Health Records: A Survey

The continuously increasing cost of the US healthcare system has received significant attention. Central to the ideas aimed at curbing this trend is the use of technology, in the form of the mandate to implement electronic health records (EHRs). EHRs consist of patient information such as demographics, medications, laboratory test results, diagnosis codes and procedures. Mining EHRs could lead to improvement in patient health management as EHRs contain detailed information related to disease prognosis for large patient populations. In this manuscript, we provide a structured and comprehensive overview of data mining techniques for modeling EHR data. We first provide a detailed understanding of the major application areas to which EHR mining has been applied and then discuss the nature of EHR data and its accompanying challenges. Next, we describe major approaches used for EHR mining, the metrics associated with EHRs, and the various study designs. With this foundation, we then provide a systematic and methodological organization of existing data mining techniques used to model EHRs and discuss ideas for future research. We conclude this survey with a comprehensive summary of clinical data mining applications of EHR data, as illustrated in the online supplement.

• Publication year

  2017

• Venue

  Unknown venue

• Publication date

  2017-02-09

• Fields of study

  Medicine, Computer Science

• Identifiers
  arXiv 1702.03222
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Introduction to Data Mining

  2019cited by this paper
• Principal Components Analysis

  2018cited by this paper
• Statins for Primary Prevention of Cardiovascular Disease.

  2017cited by this paper
• Secondary Analysis of an Electronic Surveillance System Combined with Multi-focal Interventions for Early Detection of Sepsis

  2017cited by this paper
• Risk Prediction with Electronic Health Records: A Deep Learning Approach

  2016cited by this paper
• A DICTIONARY OF EPIDEMIOLOGY

  2016influential reference
• Using EHRs for Heart Failure Therapy Recommendation Using Multidimensional Patient Similarity Analytics

  2016cited by this paper
• Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records

  2016cited by this paper
• Patient Stratification Using Electronic Health Records from a Chronic Disease Management Program.

  2016cited by this paper
• Multi-layer Representation Learning for Medical Concepts

  2016cited by this paper
• Adaptive Contextualization: Combating Bias During High-Dimensional Visualization and Data Selection

  2016cited by this paper
• Regularized Weighted Linear Regression for High-dimensional Censored Data

  2016cited by this paper
• Tensor factorization toward precision medicine

  2016cited by this paper
• A distributed ensemble approach for mining healthcare data under privacy constraints

  2016cited by this paper
• The mythos of model interpretability

  2016cited by this paper
• PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability

  2016cited by this paper
• Causal inference from observational data.

  2016cited by this paper
• Regularized Parametric Regression for High-dimensional Survival Analysis

  2016cited by this paper
• Parameterizing time in electronic health record studies

  2015cited by this paper
• SourceSeer: Forecasting Rare Disease Outbreaks Using Multiple Data Sources

  2015cited by this paper
• Label Propagation Prediction of Drug-Drug Interactions Based on Clinical Side Effects

  2015cited by this paper
• A Heterogeneous Multi-Task Learning for Predicting RBC Transfusion and Perioperative Outcomes

  2015cited by this paper
• Modeling Trajectories for Diabetes Complications

  2015cited by this paper
• Constrained elastic net based knowledge transfer for healthcare information exchange

  2015cited by this paper
• Clustering Longitudinal Clinical Marker Trajectories from Electronic Health Data: Applications to Phenotyping and Endotype Discovery

  2015cited by this paper
• Early Prediction of Cardiac Arrest (Code Blue) using Electronic Medical Records

  2015cited by this paper
• Doctor AI: Predicting Clinical Events via Recurrent Neural Networks

  2015influential reference
• Factors explaining variability in health literacy outcomes of public health nursing clients.

  2015cited by this paper
• Visual analytics in healthcare - opportunities and research challenges

  2015cited by this paper
• TR 15-016 Mining Electronic Health Records ( EHR ) : A Survey

  2015cited by this paper
• Forensic Style Analysis with Survival Trajectories

  2015cited by this paper
• Temporal Phenotyping from Longitudinal Electronic Health Records: A Graph Based Framework

  2015cited by this paper
• Rubik: Knowledge Guided Tensor Factorization and Completion for Health Data Analytics

  2015cited by this paper
• Dynamic Poisson Autoregression for Influenza-Like-Illness Case Count Prediction

  2015cited by this paper
• Iterative cohort analysis and exploration

  2015cited by this paper
• Clinical time series prediction: Toward a hierarchical dynamical system framework

  2015cited by this paper
• Stable feature selection for clinical prediction: Exploiting ICD tree structure using Tree-Lasso

  2015cited by this paper
• Using EHRs and Machine Learning for Heart Failure Survival Analysis

  2015cited by this paper
• A predictive framework for modeling healthcare data with evolving clinical interventions

  2015cited by this paper
• Comprehensible Predictive Modeling Using Regularized Logistic Regression and Comorbidity Based Features

  2015cited by this paper
• Deep Computational Phenotyping

  2015cited by this paper
• Building bridges across electronic health record systems through inferred phenotypic topics

  2015cited by this paper
• Limestone: High-throughput candidate phenotype generation via tensor factorization

  2014cited by this paper
• Developing and evaluating a machine learning based algorithm to predict the need of pediatric intensive care unit transfer for newly hospitalized children.

  2014cited by this paper
• Deep learning for healthcare decision making with EMRs

  2014cited by this paper
• PeGS: Perturbed Gibbs Samplers that Generate Privacy-Compliant Synthetic Data

  2014cited by this paper
• Predicting changes in hypertension control using electronic health records from a chronic disease management program

  2014cited by this paper
• PARAMO: A PARAllel predictive MOdeling platform for healthcare analytic research using electronic health records

  2014cited by this paper
• Toward smarter healthcare: Anonymizing medical data to support research studies

  2014cited by this paper
• Medical decision support using machine learning for early detection of late-onset neonatal sepsis

  2014cited by this paper
• Prevalence of heart failure signs and symptoms in a large primary care population identified through the use of text and data mining of the electronic health record.

  2014cited by this paper
• Commentary on the role of expert opinion in developing evidence‐based guidelines

  2014cited by this paper
• Extracting Phenotypes from Patient Claim Records Using Nonnegative Tensor Factorization

  2014cited by this paper
• A framework for feature extraction from hospital medical data with applications in risk prediction

  2014cited by this paper
• Survival analysis with electronic health record data: Experiments with chronic kidney disease

  2014cited by this paper
• A qualitative study of rural primary care clinician views on remote monitoring technologies.

  2014cited by this paper
• Clinical Decision Making: A Framework for Predicting Rx Response

  2014cited by this paper
• A methodology for interactive mining and visual analysis of clinical event patterns using electronic health record data

  2014cited by this paper
• Comorbidity Clusters in Autism Spectrum Disorders: An Electronic Health Record Time-Series Analysis

  2014cited by this paper
• A method for controlling complex confounding effects in the detection of adverse drug reactions using electronic health records

  2014cited by this paper
• Design patterns for the development of electronic health record-driven phenotype extraction algorithms

  2014cited by this paper
• Evidence-based prosthodontics: fundamental considerations, limitations, and guidelines.

  2014cited by this paper
• Automatic identification of heart failure diagnostic criteria, using text analysis of clinical notes from electronic health records

  2014cited by this paper
• Mining clinical text for signals of adverse drug-drug interactions

  2014cited by this paper
• Dynamic Bayesian Networks to predict sequences of organ failures in patients admitted to ICU

  2014cited by this paper
• The Maastricht Study: an extensive phenotyping study on determinants of type 2 diabetes, its complications and its comorbidities

  2014cited by this paper
• Ensembles of $({\alpha})$-Trees for Imbalanced Classification Problems

  2014cited by this paper
• Ministry of Health Clinical Practice Guidelines: Diabetes Mellitus.

  2014cited by this paper
• Nonparametric Discovery of Learning Patterns and Autism Subgroups from Therapeutic Data

  2014cited by this paper
• Admission duration model for infant treatment (ADMIT)

  2014cited by this paper
• Data Mining for Identifying Novel Associations and Temporal Relationships with Charcot Foot

  2014cited by this paper
• Learning Bayesian networks for clinical time series analysis

  2014cited by this paper
• Toward personalizing treatment for depression: predicting diagnosis and severity

  2014cited by this paper
• SCALING PERSONALIZED HEALTHCARE WITH BIG DATA

  2014cited by this paper
• Phenotyping for patient safety: algorithm development for electronic health record based automated adverse event and medical error detection in neonatal intensive care

  2014cited by this paper
• Using semantic web technologies for quality measure phenotyping algorithm representation and automatic execution on EHR data

  2014cited by this paper
• Towards Personalized Medicine: Leveraging Patient Similarity and Drug Similarity Analytics

  2014cited by this paper
• Temporal disease trajectories condensed from population-wide registry data covering 6.2 million patients

  2014cited by this paper
• Innovative information visualization of electronic health record data: a systematic review

  2014cited by this paper
• Stabilizing Sparse Cox Model using Clinical Structures in Electronic Medical Records

  2014cited by this paper
• Development and validation of an electronic phenotyping algorithm for chronic kidney disease

  2014cited by this paper
• A Hierarchical Ensemble of α-Trees for Predicting Expensive Hospital Visits

  2014cited by this paper
• A hazard based approach to user return time prediction

  2014cited by this paper
• Stabilized sparse ordinal regression for medical risk stratification

  2014cited by this paper
• DecisionFlow: Visual Analytics for High-Dimensional Temporal Event Sequence Data

  2014cited by this paper
• Temporal trends of hemoglobin A1c testing

  2014cited by this paper
• Active Learning based Survival Regression for Censored Data

  2014influential reference
• Clustering Multivariate Time Series Using Hidden Markov Models

  2014cited by this paper
• Learning using privileged information (LUPI) for modeling survival data

  2014cited by this paper
• Clinical risk prediction with multilinear sparse logistic regression

  2014cited by this paper
• A Data-Driven Model for Optimizing Therapy Duration for Septic Patients

  2014cited by this paper
• Dynamical Phenotyping: Using Temporal Analysis of Clinically Collected Physiologic Data to Stratify Populations

  2014cited by this paper
• Using Anchors to Estimate Clinical State without Labeled Data

  2014cited by this paper
• Systematic Review of Evidence-Based Guidelines on Medication Therapy for Upper Respiratory Tract Infection in Children with AGREE Instrument

  2014cited by this paper
• Publishing data from electronic health records while preserving privacy: A survey of algorithms

  2014cited by this paper
• Marble: high-throughput phenotyping from electronic health records via sparse nonnegative tensor factorization

  2014cited by this paper
• DISEASE AND MEDICATION NETWORKS: AN INSIGHT INTO DISEASE-DRUG INTERACTIONS

  2014cited by this paper
• A sense inventory for clinical abbreviations and acronyms created using clinical notes and medical dictionary resources

  2014cited by this paper
• Unintended effects of statins from observational studies in the general population: systematic review and meta-analysis

  2014cited by this paper
• Frequence: interactive mining and visualization of temporal frequent event sequences

  2014cited by this paper

• Subtype-Aware Registration of Longitudinal Electronic Health Records

  2025cites this paper
• MULTIPAR: Supervised Irregular Tensor Factorization with Multi-task Learning for Computational Phenotyping

  2023cites this paper
• A Graphical Model of Nocturnal Therapy of Juvenile Diabetics

  2023cites this paper
• Fuzzy, Graphical Model of Diabetic Therapy

  2023cites this paper
• A data-driven medical knowledge discovery framework to predict the length of ICU stay for patients undergoing craniotomy based on electronic medical records.

  2023cites this paper
• Detection of outlying patterns from sparse and irregularly sampled electronic health records data

  2023cites this paper
• Transformers for extracting breast cancer information from Spanish clinical narratives

  2023cites this paper
• Integrating domain knowledge for biomedical text analysis into deep learning: A survey

  2023cites this paper
• quEHRy: a question answering system to query electronic health records

  2023cites this paper
• Prediction of acute hypertensive episodes in critically ill patients

  2023cites this paper
• A Framework for User-Focused Electronic Health Record System Leveraging Hyperledger Fabric

  2023cites this paper
• Privacy preserving Federated Learning framework for IoMT based big data analysis using edge computing

  2023cites this paper
• Federated Learning in Health care Using Structured Medical Data.

  2023cites this paper
• Machine Learning-Based Digital Twin System for Predicting the Progression of Prostate Cancer

  2022cites this paper
• Classification of Alzheimer's Disease Stages Through Volumetric Analysis of MRI Data

  2022cites this paper
• Risk Classification and Subphenotyping of Acute Kidney Injury: Concepts and Methodologies.

  2022cites this paper
• Explaining predictive factors in patient pathways using autoencoders

  2022cites this paper
• Time interval uncertainty-aware and text-enhanced based disease prediction

  2022cites this paper
• Self-Supervised Representation Learning on Electronic Health Records with Graph Kernel Infomax

  2022cites this paper
• DCSF: Deep Convolutional Set Functions for Classification of Asynchronous Time Series

  2022cites this paper
• MULTIPAR: Supervised Irregular Tensor Factorization with Multi-task Learning

  2022cites this paper
• Iterative Annotation of Biomedical NER Corpora with Deep Neural Networks and Knowledge Bases

  2022cites this paper
• Optimization of the organizational structure in hospitals to account for patients with multiple diseases

  2022cites this paper
• Attempting cardiac arrest prediction using artificial intelligence on vital signs from Electronic Health Records

  2022cites this paper
• A systematic review of the prediction of hospital length of stay: Towards a unified framework

  2022cites this paper
• An interpretable framework to discover the medical decision rules of the length of ICU stay for patients undergoing craniotomy based on electronic medical records (Preprint)

  2022cites this paper
• Communicating Electronic Adherence Data to Physicians—Consensus-Based Development of a Compact Reporting Form

  2021cites this paper
• Identification of variation in nutritional practice in neonatal units in England and association with clinical outcomes using agnostic machine learning

  2021cites this paper
• A deep learning-based multi-turn conversation modeling for diagnostic Q&A document recommendation

  2021cites this paper
• Incorporating real-world evidence into the development of patient blood glucose prediction algorithms for the ICU

  2021cites this paper
• Prediction of Disease Using Machine Learning Algorithms

  2021cites this paper
• RETRACTED ARTICLE: Analysis of Electronic Health Records Based on Deep Learning with Natural Language Processing

  2021cites this paper
• IoT Performability for Medical Wearable Device by Data Privacy and Fault Tolerance

  2021cites this paper
• Making the COVID-19 Pandemic a Driver for Digital Health: Brazilian Strategies

  2021cites this paper
• What Can Knowledge Bring to Machine Learning?—A Survey of Low-shot Learning for Structured Data

  2021cites this paper
• Optimal sampling for design‐based estimators of regression models

  2021cites this paper
• A likelihood-based convolution approach to estimate major health events in longitudinal health records data: an external validation study

  2021cites this paper
• Multi-disease Predictive Analytics: A Clinical Knowledge-aware Approach

  2021cites this paper
• Decision Support System on Determination of Contraception Tools as an Effort to Suppress the Number of Growth Ratios in Indonesia

  2021cites this paper
• Ontology-Based IoT Healthcare Systems (IHS) for Senior Citizens

  2021cites this paper
• Tsflex: Flexible Time Series Processing & Feature Extraction

  2021cites this paper
• Training of Machine Learning Models for Recurrence Prediction in Patients with Respiratory Pathologies

  2021cites this paper
• A Survey on Knowledge Enhanced EHR Data Mining

  2021cites this paper
• Research and Application of Artificial Intelligence Based on Electronic Health Records of Patients With Cancer: Systematic Review

  2021cites this paper
• Clustering datasets with demographics and diagnosis codes

  2020cites this paper
• Generating real-world evidence from unstructured clinical notes to examine clinical utility of genetic tests: use case in BRCAness

  2020cites this paper
• Network analysis of autistic disease comorbidities in Chinese children based on ICD-10 codes

  2020cites this paper
• Using machine learning for predicting cervical cancer from Swedish electronic health records by mining hierarchical representations

  2020influential citation
• Cross-Global Attention Graph Kernel Network Prediction of Drug Prescription

  2020cites this paper
• Mining Time-Stamped Electronic Health Records with Referenced Sequences

  2020cites this paper
• Mining incomplete clinical data for the early assessment of Kawasaki disease based on feature clustering and convolutional neural networks

  2020cites this paper
• A fusion framework to extract typical treatment patterns from electronic medical records

  2020cites this paper
• Uncertainty-Gated Stochastic Sequential Model for EHR Mortality Prediction

  2020cites this paper
• SemClinBr - a multi-institutional and multi-specialty semantically annotated corpus for Portuguese clinical NLP tasks

  2020cites this paper
• Learning Phenotypes and Dynamic Patient Representations via RNN Regularized Collective Non-Negative Tensor Factorization

  2019cites this paper
• Predicting Adverse Outcomes for Febrile Patients in the Emergency Department Using Sparse Laboratory Data: Development of a Time Adaptive Model (Preprint)

  2019cites this paper
• Knowledge Graph-Based Clinical Decision Support System Reasoning: A Survey

  2019cites this paper
• Weight-based multiple empirical kernel learning with neighbor discriminant constraint for heart failure mortality prediction

  2019cites this paper
• Precision Medicine Informatics: Principles, Prospects, and Challenges

  2019cites this paper
• Multiple Graph Kernel Fusion Prediction of Drug Prescription

  2019cites this paper
• An ensemble of neural models for nested adverse drug events and medication extraction with subwords

  2019cites this paper
• Extraction of actionable knowledge to reduce hospital readmissions through patients personalization

  2019cites this paper
• Mining Typical Treatment Duration Patterns for Rational Drug Use from Electronic Medical Records

  2019cites this paper
• Structured and Unstructured Data Integration with Electronic Medical Records

  2019cites this paper
• Towards interoperable e-Health system in Tanzania: analysis and evaluation of the current security trends and big data sharing dynamics

  2019cites this paper
• An intelligent data-driven model for disease diagnosis based on machine learning theory

  2019cites this paper
• Big Data Analytics in Healthcare: Data-Driven Methods for Typical Treatment Pattern Mining

  2019cites this paper
• Merging Data Diversity of Clinical Medical Records to Improve Effectiveness

  2019influential citation
• Generating and evaluating a propensity model using textual features from electronic medical records

  2019cites this paper
• A Treatment Engine by Predicting Next-Period Prescriptions

  2018cites this paper
• Mining Typical Drug Use Patterns Based on Patient Similarity from Electronic Medical Records

  2018cites this paper
• Personalized method for self-management of trunk postural ergonomic hazards in construction rebar ironwork

  2018cites this paper
• Diabetes Disease Prediction Using Machine Learning on Big Data of Healthcare

  2018cites this paper
• Interpretable Representation Learning for Healthcare via Capturing Disease Progression through Time

  2018cites this paper
• Do Electronic Health Records support the complex needs of people with disability?

  2018cites this paper
• Early Prediction of Diabetes Complications from Electronic Health Records: A Multi-Task Survival Analysis Approach

  2018cites this paper
• Towards deep anchor learning

  2018cites this paper
• Analysis of Clinical Variations in Asthma Care Documented in Electronic Health Records Between Staff and Resident Physicians

  2018cites this paper
• A Structured Learning Approach with Neural Conditional Random Fields for Sleep Staging

  2018cites this paper
• A data-driven framework of typical treatment process extraction and evaluation

  2018cites this paper
• Don't Do Imputation: Dealing with Informative Missing Values in EHR Data Analysis

  2018cites this paper
• Mining for Context Sequences Identification

  2018cites this paper
• Joint learning of representations of medical concepts and words from EHR data

  2017cites this paper
• Structured Causal Inference for Rare Events: An Industrial Application to Analyze Heating-Cooling Device Failure

  2017cites this paper
• Unsupervised Phenotype Scoring

  2017cites this paper
• Mining Electronic Physical Records, a trial

  2016cites this paper