Unprecedented cloud resolution in a GPU-enabled full-physics atmospheric climate simulation on OLCF’s summit supercomputer

Clouds represent a key uncertainty in future climate projection. While explicit cloud resolution remains beyond our computational grasp for global climate, we can incorporate important cloud effects through a computational middle ground called the Multi-scale Modeling Framework (MMF), also known as Super Parameterization. This algorithmic approach embeds high-resolution Cloud Resolving Models (CRMs) to represent moist convective processes within each grid column in a Global Climate Model (GCM). The MMF code requires no parallel data transfers and provides a self-contained target for acceleration. This study investigates the performance of the Energy Exascale Earth System Model-MMF (E3SM-MMF) code on the OLCF Summit supercomputer at an unprecedented scale of simulation. Hundreds of kernels in the roughly 10K lines of code in the E3SM-MMF CRM were ported to GPUs with OpenACC directives. A high-resolution benchmark using 4600 nodes on Summit demonstrates the computational capability of the GPU-enabled E3SM-MMF code in a full physics climate simulation.

• Publication year

  2021

• Venue

  The international journal of high performance computing applications

• Publication date

  2021-07-16

• Fields of study

  Physics, Computer Science, Environmental Science

• Identifiers
  DOI 10.1177/10943420211027539
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A Holistic Algorithmic Approach to Improving Accuracy, Robustness, and Computational Efficiency for Atmospheric Dynamics

  2020cited by this paper
• Initial Results From the Super‐Parameterized E3SM

  2020cited by this paper
• Redesigning CAM-SE for Peta-Scale Climate Modeling Performance and Ultra-High Resolution on Sunway TaihuLight

  2017cited by this paper
• Causes of model dry and warm bias over central U.S. and impact on climate projections

  2017cited by this paper
• Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale

  2017cited by this paper
• Near-global climate simulation at 1 km resolution: establishing a performance baseline on 4888 GPUs with COSMO 5.0

  2017influential reference
• Simulation of the South American climate by a coupled model with super-parameterized convection

  2015cited by this paper
• Mean‐state acceleration of cloud‐resolving models and large eddy simulations

  2015influential reference
• The Madden-Julian Oscillation's Impacts on Worldwide Tropical Cyclone Activity

  2014cited by this paper
• A 10-Year Survey of Extreme Rainfall Events in the Central and Eastern United States Using Gridded Multisensor Precipitation Analyses

  2014cited by this paper
• Climate simulations and projections with a super-parameterized climate model

  2014cited by this paper
• The Role of Cloud Microphysics Parameterization in the Simulation of Mesoscale Convective System Clouds and Precipitation in the Tropical Western Pacific

  2013cited by this paper
• Robustness and sensitivities of central U.S. summer convection in the super‐parameterized CAM: Multi‐model intercomparison with a new regional EOF index

  2013cited by this paper
• Uncertainty quantification and parameter tuning in the CAM5 Zhang‐McFarlane convection scheme and impact of improved convection on the global circulation and climate

  2013cited by this paper
• CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model

  2012cited by this paper
• “Super‐parameterization”: A better way to simulate regional extreme precipitation?

  2011cited by this paper
• Mixed finite elements for numerical weather prediction

  2011cited by this paper
• Dreary state of precipitation in global models

  2010cited by this paper
• An ocean‐atmosphere climate simulation with an embedded cloud resolving model

  2010cited by this paper
• Structure of the Madden-Julian Oscillation in the Superparameterized CAM

  2009cited by this paper
• Computational aspects of a scalable high-order discontinuous Galerkin atmospheric dynamical core

  2009cited by this paper
• A Finite-Volume Dynamical Core on the Cubed-Sphere Grid

  2009cited by this paper
• A study of spectral element and discontinuous Galerkin methods for the Navier-Stokes equations in nonhydrostatic mesoscale atmospheric modeling: Equation sets and test cases

  2008cited by this paper
• Precipitation Characteristics in Eighteen Coupled Climate Models

  2006cited by this paper
• Storm Morphology and Rainfall Characteristics of TRMM Precipitation Features

  2005cited by this paper
• An Improved Framework for Superparameterization.

  2004cited by this paper
• The Spectral Element Atmosphere Model (SEAM): High-Resolution Parallel Computation and Localized Resolution of Regional Dynamics

  2004cited by this paper
• Breaking the Cloud Parameterization Deadlock

  2003cited by this paper
• A cloud resolving model as a cloud parameterization in the NCAR Community Climate System Model: Preliminary results

  2001influential reference
• The Accumulation of Rounding Errors and Port Validation for Global Atmospheric Models

  1997cited by this paper
• The “Cubed Sphere”

  1996cited by this paper

• A Tensor Network-Based Quantum Algorithm for the Nonlinear 1D Burgers' Equation

  2026cites this paper
• Quantum Solver Using Singular Value Decomposition for Computational Fluid Dynamics

  2026cites this paper
• Meteorological Tsunamis: From Local Hazard to Global Relevance

  2025cites this paper
• Neural emulator based on physical fields for accelerating the simulation of surface chlorophyll in an Earth System Model

  2025cites this paper
• Resolving Low Cloud Feedbacks Globally With E3SM High‐Res MMF: Agreement With LES but Stronger Shortwave Effects

  2025cites this paper
• F-DATA: A Fugaku Workload Dataset for Job-centric Predictive Modelling in HPC Systems

  2025cites this paper
• Spatially Local Surrogate Modeling of Subgrid-Scale Effects in Idealized Atmospheric Flows: A Deep Learned Approach Using High-Resolution Simulation Data

  2024cites this paper
• Investigating Mechanisms Driving Differences in the Characteristics of Precipitation in the E3SM Multiscale Modeling Framework With 2D Versus 3D Cloud Resolving Model Configurations

  2024cites this paper
• Accelerating an overhead-sensitive atmospheric model on GPUs using asynchronous execution and kernel fusion

  2024cites this paper
• Towards a Quantum Algorithm for the Incompressible Nonlinear Navier-Stokes Equations

  2024cites this paper
• Stable Machine‐Learning Parameterization of Subgrid Processes in a Comprehensive Atmospheric Model Learned From Embedded Convection‐Permitting Simulations

  2024cites this paper
• Accelerating atmospheric physics parameterizations using graphics processing units

  2024cites this paper
• Machine-learned closure of URANS for stably stratified turbulence: connecting physical timescales & data hyperparameters of deep time-series models

  2024cites this paper
• Elucidating the role of stacking faults in TlGaSe2 on its thermoelectric properties

  2024cites this paper
• Solving the Hele–Shaw flow using the Harrow–Hassidim–Lloyd algorithm on superconducting devices: A study of efficiency and challenges

  2024cites this paper
• ClimSim: A large multi-scale dataset for hybrid physics-ML climate emulation

  2023cites this paper
• Improving Stratocumulus Cloud Amounts in a 200‐m Resolution Multi‐Scale Modeling Framework Through Tuning of Its Interior Physics

  2023cites this paper
• Porting the WAVEWATCH III (v6.07) wave action source terms to GPU

  2023cites this paper