Variational data assimilation for very large environmental problems

Variational data assimilation is commonly used in environmental forecasting to estimate the current state of the system from a model forecast and observational data. The assimilation problem can be written simply in the form of a nonlinear least squares optimization problem. However the practical solution of the problem in large systems requires many careful choices to be made in the implementation. In this article we present the theory of variational data assimilation and then discuss in detail how it is implemented in practice. Current solutions and open questions are discussed.

• Publication year

  2013

• Venue

  Unknown venue

• Publication date

  2013-08-16

• Fields of study

  Mathematics, Environmental Science

• Identifiers
  DOI 10.1515/9783110282269.55
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• On the diffusion equation and its application to isotropic and anisotropic correlation modelling in variational assimilation

  2013cited by this paper
• Nonlinear error dynamics for cycled data assimilation methods

  2013cited by this paper
• On the use of EDA background error variances in the ECMWF 4D‐Var

  2012cited by this paper
• The Regional Ocean Modeling System (ROMS) 4-dimensional variational data assimilation systems Part I - System overview and formulation

  2011cited by this paper
• Correlations of control variables in variational data assimilation

  2011cited by this paper
• Four-dimensional variational data assimilation for high resolution nested models

  2011cited by this paper
• Conditioning and preconditioning of the variational data assimilation problem

  2011influential reference
• State estimation using model order reduction for unstable systems

  2011cited by this paper
• Conditioning of incremental variational data assimilation, with application to the Met Office system

  2011cited by this paper
• A demonstration of 4D‐Var using a time‐distributed background term

  2010cited by this paper
• Intercomparison of Variational Data Assimilation and the Ensemble Kalman Filter for Global Deterministic NWP. Part I: Description and Single-Observation Experiments

  2010cited by this paper
• Estimates of spatial and interchannel observation‐error characteristics for current sounder radiances for numerical weather prediction. I: Methods and application to ATOVS data

  2010cited by this paper
• A note on the analysis error associated with 3D‐FGAT

  2010cited by this paper
• Beyond Gaussian Statistical Modeling in Geophysical Data Assimilation

  2010cited by this paper
• Intercomparison of Variational Data Assimilation and the Ensemble Kalman Filter for Global Deterministic NWP. Part II: One-Month Experiments with Real Observations

  2010cited by this paper
• h2-norm optimal model reduction for large scale discrete dynamical MIMO systems

  2010cited by this paper
• A weak‐constraint four‐dimensional variational analysis system in the stratosphere

  2009cited by this paper
• Data Assimilation for Geophysical Fluids

  2009cited by this paper
• Data assimilation in weather forecasting: a case study in PDE-constrained optimization

  2009influential reference
• Seasonal climate modeling over the Indian Ocean by employing a 4D-VAR coupled data assimilation approach

  2009cited by this paper
• Assimilation of IASI at the Met Office and assessment of its impact through observing system experiments

  2009cited by this paper
• Four-Dimensional Variational Data Assimilation for WRF : Formulation and Preliminary Results

  2009influential reference
• A Dual-Weighted Approach to Order Reduction in 4DVAR Data Assimilation

  2008cited by this paper
• An Ensemble-Based Four-dimensional Variational Data Assimilation Scheme

  2008cited by this paper
• Correlated observation errors in data assimilation

  2008cited by this paper
• Ocean altimeter assimilation with observational‐ and model‐bias correction

  2008cited by this paper
• An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test

  2008cited by this paper
• Introducing the coupling information in a limited‐area variational assimilation

  2008cited by this paper
• Development of a four‐dimensional variational coupled data assimilation system for enhanced analysis and prediction of seasonal to interannual climate variations

  2008cited by this paper
• Approximate Gauss–Newton methods for optimal state estimation using reduced‐order models

  2008cited by this paper
• A review of forecast error covariance statistics in atmospheric variational data assimilation. II: Modelling the forecast error covariance statistics

  2008cited by this paper
• Using Model Reduction Methods within Incremental Four-Dimensional Variational Data Assimilation

  2008cited by this paper
• A review of forecast error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast error covariances

  2008cited by this paper
• Limited‐memory preconditioners, with application to incremental four‐dimensional variational data assimilation

  2008influential reference
• An Assimilation and Forecasting Experiment of the Nerima Heavy Rainfa11 with a Cloud-Resolving Nonhydrostatic 4-Dimensional Variational Data Assimilation System

  2007cited by this paper
• Extension of 3DVAR to 4DVAR: Implementation of 4DVAR at the Meteorological Service of Canada

  2007influential reference
• A Regime-dependent balanced control variable based on potential vorticity

  2007cited by this paper
• On the use and significance of isentropic potential vorticity maps

  2007cited by this paper
• Adaptive bias correction for satellite data in a numerical weather prediction system

  2007cited by this paper
• Can wavelets improve the representation of forecast error covariances in variational data assimilation

  2007cited by this paper
• The optimal density of atmospheric sounder observations in the Met Office NWP system

  2007cited by this paper
• Model‐error estimation in 4D‐Var

  2007cited by this paper
• 4D‐Var and the butterfly effect: Statistical four‐dimensional data assimilation for a wide range of scales

  2007cited by this paper
• Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. Ii: Numerical Results

  2007cited by this paper
• A reduced‐order approach to four‐dimensional variational data assimilation using proper orthogonal decomposition

  2007cited by this paper
• The Met Office global four‐dimensional variational data assimilation scheme

  2007influential reference
• Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. I: Theory

  2007cited by this paper
• The ECMWF operational implementation of four‐dimensional variational assimilation. I: Experimental results with simplified physics

  2007cited by this paper
• Approximate Gauss-Newton Methods for Nonlinear Least Squares Problems

  2007influential reference
• Accounting for an imperfect model in 4D‐Var

  2006cited by this paper
• Use of potential vorticity for incremental data assimilation

  2006cited by this paper
• Efficiency of reduced-order, time-dependent adjoint data assimilation approaches

  2006cited by this paper
• Reduced-Order Modeling of the Upper Tropical Pacific Ocean Model using Proper Orthogonal Decomposition

  2006cited by this paper
• A data assimilation method for log‐normally distributed observational errors

  2006cited by this paper
• Inner-Loop Stopping Criteria for Incremental Four-Dimensional Variational Data Assimilation

  2006cited by this paper
• A multivariate balance operator for variational ocean data assimilation

  2005cited by this paper
• Bias and data assimilation

  2005cited by this paper
• Reconstruction of an atmospheric tracer source using the principle of maximum entropy. I: Theory

  2005cited by this paper
• Ensemble‐derived stationary and flow‐dependent background‐error covariances: Evaluation in a quasi‐operational NWP setting

  2005cited by this paper
• Diagnosis of observation, background and analysis‐error statistics in observation space

  2005cited by this paper
• Why does 4D‐Var beat 3D‐Var?

  2005cited by this paper
• Use of discrete Fourier transforms in the 1D‐Var retrieval problem

  2005cited by this paper
• An investigation of incremental 4D‐Var using non‐tangent linear models

  2005cited by this paper
• Model Reduction of Time-Varying Systems

  2005cited by this paper
• A singular vector perspective of 4D‐Var: Filtering and interpolation

  2005cited by this paper
• Reconstruction of an atmospheric tracer source using the principle of maximum entropy. II: Applications

  2005cited by this paper
• Approximate iterative methods for variational data assimilation

  2005cited by this paper
• Influence‐matrix diagnostic of a data assimilation system

  2004cited by this paper
• Issues in high resolution limited area data assimilation for quantitative precipitation forecasting

  2004cited by this paper
• An introduction to dynamic meteorology

  2004cited by this paper
• Numerical optimization

  2004cited by this paper
• The Spatial Structure of Observation Errors in Atmospheric Motion Vectors from Geostationary Satellite Data

  2003cited by this paper
• Four-dimensional variational data assimilation for mesoscale and storm-scale applications

  2003cited by this paper
• Background Error Covariance Modelling

  2003influential reference
• Three- and Four-Dimensional Variational Assimilation with a General Circulation Model of the Tropical Pacific Ocean. Part II: Physical Validation

  2003cited by this paper
• A comparison of two methods for developing the linearization of a shallow‐water model

  2003cited by this paper
• Four‐dimensional variational data assimilation: A new formulation of the background‐error covariance matrix based on a potential‐vorticity representation

  2003cited by this paper
• Three- and Four-Dimensional Variational Assimilation with a General Circulation Model of the Tropical Pacific Ocean. Part I: Formulation, Internal Diagnostics, and Consistency Checks

  2003cited by this paper
• Three-dimensional variational data assimilation for a limited area model : Part I: General formulation and the background error constraint

  2001cited by this paper
• Correlation modelling on the sphere using a generalized diffusion equation

  2001cited by this paper
• A satellite radiance‐bias correction scheme for data assimilation

  2001cited by this paper
• Four-dimensional variational data assimilation for a limited area model

  2001cited by this paper
• The statistical structure of forecast errors and its representation in The Met. Office Global 3‐D Variational Data Assimilation Scheme

  2001cited by this paper
• The Met. Office global three‐dimensional variational data assimilation scheme

  2000cited by this paper
• Adjoint Methods in Data Assimilation for Estimating Model Error

  2000cited by this paper
• Variational quality control

  1999cited by this paper
• Simplified and Regular Physical Parameterizations for Incremental Four-Dimensional Variational Assimilation

  1999cited by this paper
• Implementation of a 3D variational data assimilation system at the Canadian Meteorological Centre. Part I: The global analysis

  1999influential reference
• Singular vectors, metrics, and adaptive observations

  1998cited by this paper
• A validation of the incremental formulation of 4D variational data assimilation in a nonlinear barotropic flow

  1998cited by this paper
• Recipes for adjoint code construction

  1998cited by this paper
• Development of an Operational Variational Assimilation Scheme (gtSpecial IssueltData Assimilation in Meteology and Oceanography: Theory and Practice)

  1997cited by this paper
• A General Weak Constraint Applicable to Operational 4DVAR Data Assimilation Systems

  1997cited by this paper
• Aerodynamic design optimization on unstructured grids with a continuous adjoint formulation

  1997cited by this paper
• Generalized Adjoint for Physical Processes with Parameterized Discontinuities. Part I: Basic Issues and Heuristic Examples

  1996cited by this paper
• Lagrangian four‐dimensional variational data assimilation of chemical species

  1995cited by this paper
• A strategy for operational implementation of 4D‐Var, using an incremental approach

  1994cited by this paper
• Four-Dimensional Variational Data Assimilation Experiments with a Multilevel Semi-Lagrangian Semi-Implicit General Circulation Model

  1994cited by this paper
• Automatic differentiation in Odyssée

  1993cited by this paper
• Bayesian quality control using multivariate normal distributions

  1993cited by this paper

• The impact of hybrid oceanic data assimilation in a coupled model: A case study of a tropical cyclone

  2022cites this paper
• On preconditioning the state formulation of incremental weak constraint 4D-Var

  2021cites this paper
• On time‐parallel preconditioning for the state formulation of incremental weak constraint 4D‐Var

  2021cites this paper
• Randomised preconditioning for the forcing formulation of weak‐constraint 4D‐Var

  2021cites this paper
• Single-Precision in the Tangent-Linear and Adjoint Models of Incremental 4D-Var

  2020cites this paper
• Data assimilation in surface water quality modeling: A review.

  2020cites this paper
• Spectral estimates for saddle point matrices arising in weak constraint four‐dimensional variational data assimilation

  2019influential citation
• Numerical linear algebra in data assimilation

  2019cites this paper
• Parameter estimation for a morphochemical reaction-diffusion model of electrochemical pattern formation

  2018cites this paper
• Evaluation of iterative Kalman smoother schemes for multi-decadal past climate analysis with comprehensive Earth system models

  2018cites this paper
• Parameter identification in ODE models with oscillatory dynamics: a Fourier regularization approach

  2017cites this paper
• A low-rank approach to the solution of weak constraint variational data assimilation problems

  2017cites this paper
• Adjoint free four-dimensional variational data assimilation for a storm surge model of the German North Sea

  2016cites this paper
• Investigating the role of prior and observation error correlations in improving a model forecast of forest carbon balance using Four-dimensional Variational data assimilation

  2016cites this paper
• Assessing and optimising the performance of data assimilation algorithms

  2016cites this paper
• An Idealized Study of Coupled Atmosphere–Ocean 4D-Var in the Presence of Model Error

  2016cites this paper
• Exploring strategies for coupled 4D-Var data assimilation using an idealised atmosphere–ocean model

  2015cites this paper
• The effect of numerical model error on data assimilation

  2015cites this paper
• Estimating Forecast Error Covariance Matrices with Ensembles by Emine Akkuş August 2014

  2014cites this paper
• Numerical Model Error in Data Assimilation

  2014influential citation