Balancing Accuracy, Efficiency, and Flexibility in Radiation Calculations for Dynamical Models

This paper describes the initial implementation of a new toolbox that seeks to balance accuracy, efficiency, and flexibility in radiation calculations for dynamical models. The toolbox consists of two related code bases: Radiative Transfer for Energetics (RTE), which computes fluxes given a radiative transfer problem defined in terms of optical properties, boundary conditions, and source functions; and RRTM for General circulation model applications—Parallel (RRTMGP), which combines data and algorithms to map a physical description of the gaseous atmosphere into such a radiative transfer problem. The toolbox is an implementation of well‐established ideas, including the use of a k‐distribution to represent the spectral variation of absorption by gases and the use of two‐stream, plane‐parallel methods for solving the radiative transfer equation. The focus is instead on accuracy, by basing the k‐distribution on state‐of‐the‐art spectroscopy and on the sometimes‐conflicting goals of flexibility and efficiency. Flexibility is facilitated by making extensive use of computational objects encompassing code and data, the latter provisioned at runtime and potentially tailored to specific problems. The computational objects provide robust access to a set of high‐efficiency computational kernels that can be adapted to new computational environments. Accuracy is obtained by careful choice of algorithms and through tuning and validation of the k‐distribution against benchmark calculations. Flexibility with respect to the host model implies user responsibility for maps between clouds and aerosols and the radiative transfer problem, although comprehensive examples are provided for clouds.

• Publication year

  2019

• Venue

  Journal of Advances in Modeling Earth Systems

• Publication date

  2019-05-12

• Fields of study

  Medicine, Physics, Computer Science, Environmental Science

• Identifiers
  DOI 10.1029/2019MS001621PMID 31867089PMCID 6900118
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• The Sensitivity of the Jet Stream Response to Climate Change to Radiative Assumptions

  2019cited by this paper
• Balancing Accuracy, Efficiency, and Flexibility in Radiation Calculations for Dynamical Models

  2019cited by this paper
• A Flexible and Efficient Radiation Scheme for the ECMWF Model

  2018influential reference
• The MERRA-2 Aerosol Reanalysis, 1980 - onward, Part I: System Description and Data Assimilation Evaluation.

  2017cited by this paper
• Isca, v1.0: a framework for the global modelling of the atmospheres of Earth and other planets at varying levels of complexity

  2017cited by this paper
• Impact of Multiple Scattering on Longwave Radiative Transfer Involving Clouds

  2017cited by this paper
• Representing 3‐D cloud radiation effects in two‐stream schemes: 1. Longwave considerations and effective cloud edge length

  2016cited by this paper
• DIFFERENCES IN WATER VAPOR RADIATIVE TRANSFER AMONG 1D MODELS CAN SIGNIFICANTLY AFFECT THE INNER EDGE OF THE HABITABLE ZONE

  2016cited by this paper
• Coarse-grained component concurrency in Earth system modeling: parallelizing atmospheric radiative transfer in the GFDL AM3 model using the Flexible Modeling System coupling framework

  2016cited by this paper
• Representing 3‐D cloud radiation effects in two‐stream schemes: 2. Matrix formulation and broadband evaluation

  2016cited by this paper
• The Radiative Forcing Model Intercomparison Project (RFMIP): Experimental Protocol for CMIP6 (in open review: 10.5194/gmd-2016-88)

  2016cited by this paper
• Origins of climate model discrepancies in atmospheric shortwave absorption and global precipitation changes

  2015cited by this paper
• Radiative flux and forcing parameterization error in aerosol‐free clear skies

  2015cited by this paper
• An observational radiative constraint on hydrologic cycle intensification

  2015cited by this paper
• Large‐eddy simulation of the transient and near‐equilibrium behavior of precipitating shallow convection

  2015cited by this paper
• Performance of the Line-By-Line Radiative Transfer Model (LBLRTM) for temperature, water vapor, and trace gas retrievals: recent updates evaluated with IASI case studies

  2013cited by this paper
• Paths to accuracy for radiation parameterizations in atmospheric models

  2013cited by this paper
• The HITRAN2012 molecular spectroscopic database

  2013cited by this paper
• How Does the Sun’s Spectrum Vary?

  2012cited by this paper
• Development and recent evaluation of the MT_CKD model of continuum absorption

  2012cited by this paper
• The Continual Intercomparison of Radiation Codes: Results from Phase I

  2012cited by this paper
• The full-spectrum correlated-k method for longwave atmospheric radiative transfer using an effective Planck function

  2010cited by this paper
• A k-distribution-based radiation code and its computational optimization for an atmospheric general circulation model

  2008cited by this paper
• Tripleclouds: An Efficient Method for Representing Horizontal Cloud Inhomogeneity in 1D Radiation Schemes by Using Three Regions at Each Height

  2008cited by this paper
• Monte Carlo Spectral Integration: a Consistent Approximation for Radiative Transfer in Large Eddy Simulations

  2008cited by this paper
• An estimate of the global impact of multiple scattering by clouds on outgoing long‐wave radiation

  2006cited by this paper
• Atmospheric radiative transfer modeling: a summary of the AER codes

  2005influential reference
• The HITRAN 2008 molecular spectroscopic database

  2005cited by this paper
• A new method for diagnosing radiative forcing and climate sensitivity

  2004cited by this paper
• The QME AERI LBLRTM: A Closure Experiment for Downwelling High Spectral Resolution Infrared Radiance

  2004cited by this paper
• A fast, flexible, approximate technique for computing radiative transfer in inhomogeneous cloud fields

  2003cited by this paper
• Radiance and Jacobian Intercomparison of Radiative Transfer Models Applied to HIRS and AMSU Channels

  2001influential reference
• Parameterization of Generalized Cloud Overlap for Radiative Calculations in General Circulation Models

  2001cited by this paper
• Impact of an improved longwave radiation model, RRTM, on the energy budget and thermodynamic properties of the NCAR community climate model, CCM3

  2000cited by this paper
• Comparison of spectral direct and diffuse solar irradiance measurements and calculations for cloud‐free conditions

  2000cited by this paper
• Multiple Scattering Parameterization in Thermal Infrared Radiative Transfer

  1997cited by this paper
• Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave

  1997influential reference
• Studies with a flexible new radiation code. I: Choosing a configuration for a large-scale model

  1996influential reference
• Line-by-Line Calculations of Atmospheric Fluxes and Cooling Rates: Application to Water Vapor

  1992cited by this paper
• On the correlated k-distribution method for radiative transfer in nonhomogeneous atmospheres

  1992cited by this paper
• A description of the correlated k distribution method for modeling nongray gaseous absorption, thermal emission, and multiple scattering in vertically inhomogeneous atmospheres

  1991cited by this paper
• The intercomparison of radiation codes used in climate models: Long wave results

  1991cited by this paper
• THE CORRELATED-k METHOD FOR RADIATION CALCULATIONS IN NONHOMOGENEOUS ATMOSPHERES

  1989cited by this paper
• Two-Stream Approximations to Radiative Transfer in Planetary Atmospheres: A Unified Description of Existing Methods and a New Improvement

  1980cited by this paper
• Exponential-sum fitting of radiative transmission functions

  1977cited by this paper
• The delta-Eddington approximation for radiative flux transfer

  1976cited by this paper
• The Delta Function Approximation in Radiative Transfer Theory

  1970cited by this paper

• Examining Fast Radiative Feedbacks Using Machine-Learning Weather Emulators

  2026cites this paper
• Zooming in: SCREAM at 100 m using regional refinement over the San Francisco Bay Area

  2026cites this paper
• Spectral Homogenization of the Radiative Transfer Equation via Low-Rank Tensor Train Decomposition

  2026cites this paper
• Rapid Radiative Transfer Neural Network for Weather Forecasting Acceleration

  2026cites this paper
• Impact of Future Methane Emission Trajectories on Atmospheric Composition and Climate in a Future Hydrogen Economy

  2025cites this paper
• Cold Pools Reduce the Impacts of Deforestation on Convection Initiation

  2025cites this paper
• Where numerical weather prediction meets large‐eddy simulations in a convective boundary layer during the FESSTVaL field experiment

  2025cites this paper
• Beyond the Training Data: Confidence-Guided Mixing of Parameterizations in a Hybrid AI-Climate Model

  2025cites this paper
• Representing Subgrid-Scale Cloud Effects in a Radiation Parameterization using Machine Learning: MLe-radiation v1.0

  2025influential citation
• Angular-spatial hp-adaptivity for radiative transfer with discontinuous Galerkin spectral element methods

  2025cites this paper
• Bridging Clarity and Accuracy: A Simple Spectral Longwave Radiation Scheme for Idealized Climate Modeling

  2025influential citation
• A global dust emission dataset for estimating dust radiative forcings in climate models

  2025cites this paper
• Numerical Assessment of Advective and Diffusive Dynamics of Interacting and Isolated Prototypical Convectively Initiated Circulations

  2025influential citation
• Machine Learning‐Based Parametrization of Gaseous Optical Properties and VANET Anomaly Detection for Accelerated Climate and Cyber‐Physical Simulations

  2025cites this paper
• A data-driven approach for fast atmospheric radiative transfer inversion

  2025cites this paper
• Regional variability of aerosol impacts on clouds and radiation in global kilometer-scale simulations

  2025cites this paper
• Resolving Low Cloud Feedbacks Globally With E3SM High‐Res MMF: Agreement With LES but Stronger Shortwave Effects

  2025cites this paper
• An Accurate Shortwave Gaseous Transmittance Scheme Using Modified Alternate Mapping Correlated K‐Distribution Method

  2025influential citation
• Prescribing the aerosol effective radiative forcing in the Simple Cloud-Resolving E3SM Atmosphere Model v1

  2025cites this paper
• ICON-HAM-lite 1.0: simulating the Earth system with interactive aerosols at kilometer scales

  2025cites this paper
• nextGEMS: entering the era of kilometer-scale Earth system modeling

  2025influential citation
• Toward Transparency and Consistency: An Open‐Source Optics Parameterization for Clouds and Precipitation

  2025influential citation
• Accelerating the Dutch Atmospheric Large-Eddy Simulation (DALES) Model with OpenACC

  2025cites this paper
• Mechanisms of surface solar irradiance variability under broken clouds

  2025cites this paper
• Vertically resolved minimal-set k-distribution for thermal infrared absorption: an application to the atmosphere of Venus

  2025cites this paper
• The k-bin tool: Fast and flexible k-distribution algorithms written in Python

  2024cites this paper
• Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization

  2024influential citation
• Two‐Streams Revisited: General Equations, Exact Coefficients, and Optimized Closures

  2024cites this paper
• The ARP-GEM1 Global Atmosphere Model. Part I: Description and Speed-up Analysis

  2024cites this paper
• Common Community Physics Package: Fostering Collaborative Development in Physical Parameterizations and Suites

  2024cites this paper
• Evaluating NOx stack plume emissions using a high-resolution atmospheric chemistry model and satellite-derived NO2 columns

  2024cites this paper
• Atmospheric-river-induced precipitation in California as simulated by the regionally refined Simple Convective Resolving E3SM Atmosphere Model (SCREAM) Version 0

  2024cites this paper
• Investigating the sign of stratocumulus adjustments to aerosols in the ICON global storm-resolving model

  2024cites this paper
• Intensification of daily tropical precipitation extremes from more organized convection

  2024cites this paper
• The Impact of Radiative Transfer at Reduced Spectral Resolution in Large‐Eddy Simulations of Convective Clouds

  2024influential citation
• The impact of coupled 3D shortwave radiative transfer on surface radiation and cumulus clouds over land

  2024cites this paper
• Polar Lows and Their Effects on Sea Ice and the Upper Ocean in the Iceland, Greenland, and Labrador Seas

  2024cites this paper
• Effects of vertical grid spacing on the climate simulated in the ICON-Sapphire global storm-resolving model

  2024cites this paper
• Machine Learning‐Based Denoising of Surface Solar Irradiance Simulated With Monte Carlo Ray Tracing

  2024cites this paper
• Effects of complex terrain on the shortwave radiative balance: a sub-grid-scale parameterization for the GFDL Earth System Model version 4.1

  2023cites this paper
• Forecasting day-ahead 1-minute irradiance variability from numerical weather predictions

  2023cites this paper
• Optimized Alternate Mapping Correlated K‐Distribution Method for Atmospheric Longwave Radiative Transfer

  2023cites this paper
• How Moisture Shapes Low‐Level Radiative Cooling in Subsidence Regimes

  2023cites this paper
• Impact of Horizontal Resolution on the Robustness of Radiation Emulators in a Numerical Weather Prediction Model

  2023cites this paper
• Sources of Uncertainty in Mid‐Tropospheric Tropical Humidity in Global Storm‐Resolving Simulations

  2023cites this paper
• Horizontal Resolution Sensitivity of the Simple Convection‐Permitting E3SM Atmosphere Model in a Doubly‐Periodic Configuration

  2023cites this paper
• Fast computation of cloud 3D radiative effects in dynamical models by optimizing the ecRad scheme

  2023cites this paper
• Representation of atmosphere-induced heterogeneity in land–atmosphere interactions in E3SM–MMFv2

  2023cites this paper
• Machine learning for numerical weather and climate modelling: a review

  2023cites this paper
• Changes of tropical gravity waves and the quasi‐biennial oscillation in storm‐resolving simulations of idealized global warming

  2023cites this paper
• How atmospheric humidity drives the outgoing longwave radiation–surface temperature relationship and inter-model spread

  2023influential citation
• The Simple Cloud-Resolving E3SM Atmosphere Model Running on the Frontier Exascale System

  2023cites this paper
• A radiative transfer deep learning model coupled into WRF with a generic fortran torch adaptor

  2023cites this paper
• ICON-Sapphire: simulating the components of the Earth system and their interactions at kilometer and subkilometer scales

  2023cites this paper
• Sparse, Empirically Optimized Quadrature for Broadband Spectral Integration

  2023influential citation
• Effects of complex terrain on the shortwave radiative balance : A sub–grid scale parameterization for the GFDL Land Model version

  2023cites this paper
• Implementation of a machine-learned gas optics parameterization in the ECMWF Integrated Forecasting System: RRTMGP-NN 2.0

  2023influential citation
• The Benefits and Challenges of Downscaling a Global Reanalysis With Doubly‐Periodic Large‐Eddy Simulations

  2023cites this paper
• Wind power input to ocean near‐inertial waves diagnosed from a 5‐km global coupled atmosphere‐ocean general circulation model

  2023cites this paper
• Fast, low-memory numerical methods for radiative transfer via hp-adaptive mesh refinement

  2023cites this paper
• Improving Stratocumulus Cloud Amounts in a 200‐m Resolution Multi‐Scale Modeling Framework Through Tuning of Its Interior Physics

  2023cites this paper
• An Efficient Parameterization for Surface 3D Radiative Effects in Large-Eddy Simulations

  2022cites this paper
• The ICON-A model for direct QBO simulations on GPUs (version icon-cscs:baf28a514)

  2022cites this paper
• A Case Study of Cumulus Convection Over Land in Cloud‐Resolving Simulations With a Coupled Ray Tracer

  2022influential citation
• Reconciling Observations of Solar Irradiance Variability With Cloud Size Distributions

  2022cites this paper
• An Efficient Parameterization for Surface Shortwave 3D Radiative Effects in Large‐Eddy Simulations of Shallow Cumulus Clouds

  2022cites this paper
• Effects of complex terrain on the shortwave radiative balance : A sub–grid scale parameterization for the GFDL Land Model version

  2022cites this paper
• A New k-Distribution Scheme for Clear-Sky Radiative Transfer Calculations in Earth’s Atmosphere. Part II: Solar (Shortwave) Heating due to H2O and CO2

  2021cites this paper
• Machine Learned Radiative Transport for Enhanced Resolution Earth System Modeling

  2021cites this paper
• The History and Practice of AI in the Environmental Sciences

  2021cites this paper
• Global Impact of Cloud Longwave Scattering in an Atmosphere‐Only General Circulation Model Simulation

  2021cites this paper
• Global modeling of hydrogen using GFDL-AM4.1: Sensitivity of soil removal and radiative forcing

  2021cites this paper
• Machine Learning Emulation of 3D Cloud Radiative Effects

  2021cites this paper
• Robustness of Neural Network Emulations of Radiative Transfer Parameterizations in a State-of-the-Art General Circulation Model

  2021cites this paper
• Record high solar irradiance in Western Europe during first COVID-19 lockdown largely due to unusual weather

  2021cites this paper
• Benefits of Stochastic Weight Averaging in Developing Neural Network Radiation Scheme for Numerical Weather Prediction

  2021influential citation
• Deep Learning Based Cloud Cover Parameterization for ICON

  2021cites this paper
• Radiation

  2021cites this paper
• Exploring Pathways to More Accurate Machine Learning Emulation of Atmospheric Radiative Transfer

  2021cites this paper
• Convection‐Permitting Simulations With the E3SM Global Atmosphere Model

  2021influential citation
• Improved Weather Forecasting Using Neural Network Emulation for Radiation Parameterization

  2021cites this paper
• Dissecting Anvil Cloud Response to Sea Surface Warming

  2021cites this paper
• Accelerating Radiation Computations for Dynamical Models With Targeted Machine Learning and Code Optimization

  2020influential citation
• Evaluating and improving the treatment of gases in radiation schemes: the Correlated K-Distribution Model Intercomparison Project (CKDMIP)

  2020cites this paper
• Predicting atmospheric optical properties for radiative transfer computations using neural networks

  2020influential citation
• The Coupled Model Intercomparison Project: History, uses, and structural effects on climate research

  2020cites this paper
• Errors in Calculating Solar Heating of the Climate System

  2020cites this paper
• Deep-learning enhancement of large scale numerical simulations

  2020cites this paper
• COVID-19 lockdown contribution to spring surface solar irradiance record in Western Europe

  2020cites this paper
• Atmospheric radiative profiles during EUREC4A

  2020cites this paper
• Assessing Uncertainties and Approximations in Solar Heating of the Climate System

  2020cites this paper
• Benchmark Calculations of Radiative Forcing by Greenhouse Gases

  2020cites this paper
• Spring surface solar irradiance record in Western Europe amid COVID-19 pandemic

  2020cites this paper
• Balancing Accuracy, Efficiency, and Flexibility in Radiation Calculations for Dynamical Models

  2019cites this paper
• A Path‐Tracing Monte Carlo Library for 3‐D Radiative Transfer in Highly Resolved Cloudy Atmospheres

  2019cites this paper
• UvA-DARE (Digital Academic Repository) Bayesian Optimization for auto-tuning GPU kernels

  year unknowncites this paper
• NO x emissions of stack plumes

  year unknowncites this paper
• Sensitivity of cloud structure and precipitation to cloud microphysics schemes in ICON and implications for global km-scale simulations

  year unknowncites this paper
• Variability of regional-scale aerosol impacts on clouds and radiation in global kilometre-scale simulations

  year unknowncites this paper
• Vertically resolved minimal-set k-distribution for thermal infrared absorption in the Venus atmosphere

  year unknowncites this paper