Ensemble Kalman Filtering without a Model

Drawing inferences from data is at the heart of many fields of science. A new kind of data analysis, free of assumptions from underlying models, is proposed and its use demonstrated on weather data.

• Publication year

  2016

• Venue

  Physical Review X

• Publication date

  2016-03-01

• Fields of study

  Physics, Computer Science

• Identifiers
  DOI 10.1103/PHYSREVX.6.011021
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Forecasting Turbulent Modes with Nonparametric Diffusion Models

  2015cited by this paper
• Nonlinear Time Series Analysis

  2015cited by this paper
• Predicting chaotic time series with a partial model.

  2015cited by this paper
• Nonparametric forecasting of low-dimensional dynamical systems.

  2014cited by this paper
• Variable Bandwidth Diffusion Kernels

  2014cited by this paper
• Adaptive ensemble Kalman filtering of non-linear systems

  2013influential reference
• Stochastic parametrizations and model uncertainty in the Lorenz ’96 system

  2013cited by this paper
• Linear theory for filtering nonlinear multiscale systems with model error

  2013cited by this paper
• I and J

  2012cited by this paper
• Evaluating Data Assimilation Algorithms

  2011cited by this paper
• Predicting stochastic systems by noise sampling, and application to the El Niño-Southern Oscillation

  2011cited by this paper
• An improved C-band scatterometer ocean geophysical model function: CMOD5

  2007cited by this paper
• Medium-term prediction of chaos.

  2006cited by this paper
• Optimal State Estimation

  2006cited by this paper
• Data Assimilation: The Ensemble Kalman Filter

  2006cited by this paper
• Handbook of time series analysis : recent theoretical developments and applications

  2006cited by this paper
• Parameter Estimation Using Kalman Filters with Constraints

  2006cited by this paper
• Regeneration of small eddies by data assimilation in turbulence.

  2005cited by this paper
• Distinguishing random environmental fluctuations from ecological catastrophes for the North Pacific Ocean

  2005cited by this paper
• Local polynomial method for ensemble forecast of time series

  2005cited by this paper
• Overview of global data assimilation developments in numerical weather‐prediction centres

  2005cited by this paper
• Operational multivariate ocean data assimilation

  2005cited by this paper
• Global assimilation of satellite surface soil moisture retrievals into the NASA Catchment land surface model

  2005cited by this paper
• Unscented filtering and nonlinear estimation

  2004cited by this paper
• Reconstruction of shared nonlinear dynamics in a network.

  2004cited by this paper
• Estimating the predictability of an oceanic time series using linear and nonlinear methods

  2004cited by this paper
• Four-dimensional ensemble Kalman filtering

  2004cited by this paper
• Analysis of observed chaotic data

  2004cited by this paper
• Estimation of parameters and unobserved components for nonlinear systems from noisy time series.

  2002cited by this paper
• Atmospheric Modeling, Data Assimilation and Predictability

  2002cited by this paper
• A nonlinear dynamical perspective on model error: A proposal for non‐local stochastic‐dynamic parametrization in weather and climate prediction models

  2001cited by this paper
• A new method for the nonlinear transformation of means and covariances in filters and estimators

  2000cited by this paper
• Optimal sites for supplementary weather observations: simulation with a small model

  1998cited by this paper
• Predicting Chaos Most of the Time from Embeddings with Self-Intersections

  1998cited by this paper
• Regularized local linear prediction of chaotic time series

  1998cited by this paper
• Coping with chaos: Analysis of chaotic data and the exploitation of chaotic systems

  1995cited by this paper
• Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches

  1995cited by this paper
• Nonlinear forecasting for the classification of natural time series

  1994cited by this paper
• Time Series Prediction : Forecasting The Future And Understanding The Past

  1994cited by this paper
• Forecasting on chaotic time series: A local optimal linear-reconstruction method.

  1992cited by this paper
• Identification and prediction of low dimensional dynamics

  1992cited by this paper
• Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series

  1990cited by this paper
• Nonlinear prediction of chaotic time series

  1989cited by this paper
• Predicting chaotic time series.

  1987cited by this paper
• Dynamical Systems and Turbulence

  1982cited by this paper
• Detecting strange attractors in turbulence

  1981cited by this paper
• Geometry from a Time Series

  1980cited by this paper
• Deterministic nonperiodic flow

  1963cited by this paper

• Model-free learning of random dynamical system from noisy observations

  2025cites this paper
• Predicting the Business Cycle in South Africa: Insights from a Real-Financial Activity Gap

  2025cites this paper
• Bridging Artificial Intelligence and Data Assimilation: The Data-driven Ensemble Forecasting System ClimaX-LETKF

  2025cites this paper
• Unsupervised Learning in Echo State Networks for Input Reconstruction

  2025cites this paper
• Computer vision model based robust lane detection using multiple model adaptive estimation methodology

  2025cites this paper
• Robust methods to detect coupling among nonlinear dynamic time series.

  2024cites this paper
• Covariance Linkage Assimilation method for Unobserved Data Exploration

  2024cites this paper
• Model free data assimilation with Takens embedding

  2024cites this paper
• Accounting for observation noise in equation‐free forecasting: The hidden‐Markov S‐map

  2024cites this paper
• Q‐learning based adaptive Kalman filtering for partial model‐free dynamic systems

  2024cites this paper
• STBGRN: A Traffic Prediction Model Based on Spatiotemporal Bidirectional Gated Recurrent Units and Graph Convolutional Residual Networks

  2024cites this paper
• Long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems

  2024cites this paper
• Learning dynamics on invariant measures using PDE-constrained optimization.

  2023cites this paper
• Model-Free Predictor of Signal-to-Noise Ratios for Mobile Communications Systems

  2023influential citation
• Recurrences reveal shared causal drivers of complex time series

  2023cites this paper
• Data assimilation with hybrid modeling

  2023cites this paper
• Control of complex systems with generalized embedding and empirical dynamic modeling

  2023cites this paper
• Matrix cocycles in the learning of dynamical systems

  2022cites this paper
• Online Model Error Correction With Neural Networks in the Incremental 4D‐Var Framework

  2022cites this paper
• Particle network EnKF for large-scale data assimilation

  2022cites this paper
• A Multi‐Model Ensemble Kalman Filter for Data Assimilation and Forecasting

  2022cites this paper
• Composing a surrogate observation operator for sequential data assimilation

  2022cites this paper
• Wind turbine quantification and reduction of uncertainties based on a data-driven data assimilation approach.

  2022cites this paper
• Learning Theory for Dynamical Systems

  2022cites this paper
• Probability distributions for analog-to-target distances

  2021cites this paper
• Towards physically consistent data-driven weather forecasting: Integrating data assimilation with geometric deep learning in a case study with ERA5

  2021cites this paper
• Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformers

  2021cites this paper
• Predicting the Effects of Solar Storms on the Ionosphere Based on a Comparison of Real-Time Solar Wind Data with the Best-Fitting Historical Storm Event

  2021cites this paper
• A Predictive Resource Allocation for Wireless Communications Systems

  2021cites this paper
• Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations

  2021cites this paper
• A comparison of combined data assimilation and machine learning methods for offline and online model error correction

  2021cites this paper
• A gradient-enhanced sequential nonparametric data assimilation framework for soil moisture flow

  2021cites this paper
• Combining a fully connected neural network with an ensemble Kalman filter to emulate a dynamic model in data assimilation

  2021cites this paper
• Particle Network Ensemble Kalman Filter

  2021cites this paper
• Coupling the K-nearest neighbors and locally weighted linear regression with ensemble Kalman filter for data-driven data assimilation

  2021cites this paper
• A nonparametric sequential data assimilation scheme for soil moisture flow

  2020cites this paper
• Satellite Remote Sensing in Hydrological Data Assimilation

  2020influential citation
• A Sequential Monte Carlo Framework for Noise Filtering in InSAR Time Series

  2020influential citation
• Variational inference formulation for a model-free simulation of a dynamical system with unknown parameters by a recurrent neural network

  2020cites this paper
• Model-free detection of unique events in time series

  2020cites this paper
• Kernel Analog Forecasting: Multiscale Test Problems

  2020cites this paper
• A Higher Order Unscented Transform

  2020cites this paper
• Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation

  2020cites this paper
• Using local dynamics to explain analog forecasting of chaotic systems

  2020cites this paper
• Machine learning modeling and predictive control of nonlinear processes using noisy data

  2020cites this paper
• How to find a unicorn: a novel model-free, unsupervised anomaly detection method for time series

  2020cites this paper
• Modeling IoT Equipment With Graph Neural Networks

  2019cites this paper
• Data Driven Prediction Without a Model

  2019influential citation
• Combining multiple forecasts for multivariate time series via state-dependent weighting.

  2019cites this paper
• Integrating satellite soil-moisture estimates and hydrological model products over Australia

  2019cites this paper
• When to Ease Off the Brakes--and Hopefully Prevent Recessions

  2019cites this paper
• Quantum mechanics and data assimilation.

  2019cites this paper
• Assessing data assimilation frameworks for using multi-mission satellite products in a hydrological context.

  2019influential citation
• A Decoupled Data Based Control (D2C) Approach to Generalized Motion Planning Problems

  2019cites this paper
• Deep learning algorithm for data-driven simulation of noisy dynamical system

  2018cites this paper
• Operational Nowcasting of Electron Flux Levels in the Outer Zone of Earth's Radiation Belt

  2018cites this paper
• Can SWOT Improve the Reconstruction of Sea Level Anomaly Fields? Insights for Data-driven Approaches in the Western Mediterranean Sea

  2018cites this paper
• Nonparametric Data Assimilation Scheme for Land Hydrological Applications

  2018influential citation
• Information-theoretic model selection for optimal prediction of stochastic dynamical systems from data.

  2018cites this paper
• Correcting observation model error in data assimilation.

  2018cites this paper
• Forecasting and Uncertainty Quantification Using a Hybrid of Mechanistic and Non-mechanistic Models for an Age-Structured Population Model

  2018cites this paper
• The Analog Data Assimilation

  2017cites this paper
• A Separation-based Approach to Data-based Control for Large-Scale Partially Observed Systems

  2017cites this paper
• Diffusion Maps Kalman Filter for a Class of Systems With Gradient Flows

  2017cites this paper
• Adaptive Filtering to Enhance Noise Immunity of Impedance and Admittance Spectroscopy: Comparison with Fourier Transformation

  2017cites this paper
• Machine Learning for Predictive Estimation of Qubit Dynamics Subject to Dephasing

  2017cites this paper
• Stochastic parameterization identification using ensemble Kalman filtering combined with maximum likelihood methods

  2017cites this paper
• Adaptive filtering for hidden node detection and tracking in networks.

  2017cites this paper
• Data-Driven Models for the Spatio-Temporal Interpolation of Satellite-Derived SST Fields

  2017cites this paper
• Diffusion Maps Kalman Filter

  2017cites this paper
• Hybrid modeling and prediction of dynamical systems

  2017influential citation
• Data-driven assimilation of irregularly-sampled image time series

  2017cites this paper
• Stabilizing embedology: Geometry-preserving delay-coordinate maps.

  2016cites this paper
• Noisy Nonlinear Gene Regulatory Networks Analysis Using Ensemble Kalman Filter Based Particle Filter without a Model

  2016cites this paper
• Optimal Localization for Ensemble Kalman Filter Systems

  2014cites this paper
• Robust methods to detect coupling among nonlinear time series

  year unknowncites this paper