Regime‐dependent statistical post‐processing of ensemble forecasts

A number of realizations of one or more numerical weather prediction (NWP) models, initialised at a variety of initial conditions, compose an ensemble forecast. These forecasts exhibit systematic errors and biases that can be corrected by statistical post‐processing. Post‐processing yields calibrated forecasts by analysing the statistical relationship between historical forecasts and their corresponding observations. This article aims to extend post‐processing methodology to incorporate atmospheric circulation. The circulation, or flow, is largely responsible for the weather that we experience and it is hypothesized here that relationships between the NWP model and the atmosphere depend upon the prevailing flow. Numerous studies have focussed on the tendency of this flow to reduce to a set of recognisable arrangements, known as regimes, which recur and persist at fixed geographical locations. This dynamical phenomenon allows the circulation to be categorized into a small number of regime states. In a highly idealized model of the atmosphere, the Lorenz ‘96 system, ensemble forecasts are subjected to well‐known post‐processing techniques conditional on the system's underlying regime. Two different variables, one of the state variables and one related to the energy of the system, are forecasted and considerable improvements in forecast skill upon standard post‐processing are seen when the distribution of the predictand varies depending on the regime. Advantages of this approach and its inherent challenges are discussed, along with potential extensions for operational forecasters.

• Publication year

  2019

• Venue

  Quarterly Journal of the Royal Meteorological Society

• Publication date

  2019-10-01

• Fields of study

  Mathematics, Physics, Environmental Science

• Identifiers
  DOI 10.1002/qj.3638
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Regime-dependent statistical post-processing of ensemble forecasts

  2020cited by this paper
• The U.S. National Blend of Models for Statistical Postprocessing of Probability of Precipitation and Deterministic Precipitation Amount

  2017cited by this paper
• Non-homogeneous boosting for predictor selection in ensemble post-processing

  2017cited by this paper
• Low‐frequency nonlinearity and regime behavior in the Northern Hemisphere extratropical atmosphere

  2017cited by this paper
• A flexible approach to defining weather patterns and their application in weather forecasting over Europe

  2016cited by this paper
• Flow‐dependent verification of the ECMWF ensemble over the Euro‐Atlantic sector

  2015cited by this paper
• Ensemble post‐processing using member‐by‐member approaches: theoretical aspects

  2015cited by this paper
• Parameter uncertainty in forecast recalibration

  2015cited by this paper
• Mixture EMOS model for calibrating ensemble forecasts of wind speed

  2015cited by this paper
• Simulating weather regimes: impact of stochastic and perturbed parameter schemes in a simple atmospheric model

  2015cited by this paper
• Log‐normal distribution based Ensemble Model Output Statistics models for probabilistic wind‐speed forecasting

  2014cited by this paper
• A comparison of ensemble post‐processing methods for extreme events

  2014cited by this paper
• Comparison of non-homogeneous regression models for probabilistic wind speed forecasting

  2013cited by this paper
• Data-based stochastic subgrid-scale parametrization: an approach using cluster-weighted modelling

  2012cited by this paper
• Persistent Circulation Regimes and Preferred Regime Transitions in the North Atlantic

  2011cited by this paper
• Calibrating Multimodel Forecast Ensembles with Exchangeable and Missing Members Using Bayesian Model Averaging

  2010cited by this paper
• Statistical Methods in the Atmospheric Sciences

  2007cited by this paper
• Strictly Proper Scoring Rules, Prediction, and Estimation

  2007cited by this paper
• The continuous ranked probability score for circular variables and its application to mesoscale forecast ensemble verification

  2006cited by this paper
• Calibrated Probabilistic Forecasting at the Stateline Wind Energy Center

  2006cited by this paper
• Distinct metastable atmospheric regimes despite nearly Gaussian statistics: a paradigm model.

  2006cited by this paper
• Comparison of ensemble‐MOS methods in the Lorenz '96 setting

  2006cited by this paper
• Forecast assimilation: a unified framework for the combination of multi-model weather and climate predictions

  2005cited by this paper
• California Center for Population Research On-line Working Paper Series Weather Regime Prediction Using Statistical Learning Weather Regime Prediction Using Statistical Learning

  2005cited by this paper
• Effects of stochastic parametrizations in the Lorenz '96 system

  2005cited by this paper
• Using Bayesian Model Averaging to Calibrate Forecast Ensembles

  2005cited by this paper
• Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation

  2005cited by this paper
• Ensemble Reforecasting: Improving Medium-Range Forecast Skill Using Retrospective Forecasts

  2004cited by this paper
• Combining dynamical and statistical ensembles

  2003cited by this paper
• Interpretation of Rank Histograms for Verifying Ensemble Forecasts

  2001cited by this paper
• Large-Scale Weather Regimes and Local Climate over the Western United States

  1999cited by this paper
• Multiple Regimes in Northern Hemisphere Height Fields via MixtureModel Clustering*

  1999cited by this paper
• Verification of Eta–RSM Short-Range Ensemble Forecasts

  1997cited by this paper
• A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model Integrations

  1996cited by this paper
• Multiple flow regimes in the Northern Hemisphere winter. I - Methodology and hemispheric regimes. II - Sectorial regimes and preferred transitions

  1993cited by this paper
• Cluster Analysis of the Northern Hemisphere Wintertime 500-hPa Height Field: Spatial Patterns

  1993cited by this paper
• Multiple Flow Regimes in the Northern Hemisphere Winter. Part I: Methodology and Hemispheric Regimes

  1993cited by this paper
• Persistence of the 500 mb Height Field during Northern Hemisphere Winter

  1985cited by this paper
• Persistent Anomalies of the Extratropical Northern Hemisphere Wintertime Circulation: Geographical Distribution and Regional Persistence Characteristics

  1983cited by this paper
• Teleconnections in the Geopotential Height Field during the Northern Hemisphere Winter

  1981cited by this paper
• Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper

  1977cited by this paper
• Theoretical Skill of Monte Carlo Forecasts

  1974cited by this paper
• VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY

  1950cited by this paper

• An objective Bayesian method for including parameter uncertainty in ensemble model output statistics

  2026cites this paper
• Lead‐time‐continuous statistical postprocessing of ensemble weather forecasts

  2024cites this paper
• A conditional decomposition of proper scores: quantifying the sources of information in a forecast

  2023cites this paper
• Correcting sub-seasonal forecast errors with an explainable ANN to understand misrepresented sources of predictability of European summer temperatures

  2023cites this paper
• Bimodality in Ensemble Forecasts of 2-Meter Temperature: Event Aggregation

  2022cites this paper
• Gaussian mixture models for clustering and calibration of ensemble weather forecasts

  2022cites this paper
• Bimodality in ensemble forecasts of 2 m temperature: identification

  2021cites this paper
• Accounting for skew when post-processing MOGREPS-UK temperature forecast fields

  2021cites this paper
• Incorporating the North Atlantic Oscillation into the post‐processing of MOGREPS‐G wind speed forecasts

  2021influential citation
• Machine learning methods for postprocessing ensemble forecasts of wind gusts: A systematic comparison

  2021cites this paper
• Bimodality in Ensemble Forecasts of 2-Meter Temperature: Identification

  2021cites this paper
• Beyond probabilities: A possibilistic framework to interpret ensemble predictions and fuse imperfect sources of information

  2021cites this paper
• Addressing up-scaling methodologies for convection-permitting EPSs using statistical and machine learning tools

  2021cites this paper
• Simulation-based comparison of multivariate ensemble post-processing methods

  2020cites this paper
• A possibilistic interpretation of ensemble forecasts: experiments on the imperfect Lorenz 96 system

  2020cites this paper
• Recalibrating wind‐speed forecasts using regime‐dependent ensemble model output statistics

  2020influential citation
• Statistical Postprocessing for Weather Forecasts: Review, Challenges, and Avenues in a Big Data World

  2020cites this paper
• Manuscript NPG-2019-62 Simulation-based comparison of multivariate ensemble post-processing methods Response to Reviewer Comments

  year unknowncites this paper