Enabling New Flexibility in the SUNDIALS Suite of Nonlinear and Differential/Algebraic Equation Solvers

In recent years, the SUite of Nonlinear and DIfferential/ALgebraic equation Solvers (SUNDIALS) has been redesigned to better enable the use of application-specific and third-party algebraic solvers and data structures. Throughout this work, we have adhered to specific guiding principles that minimized the impact to current users while providing maximum flexibility for later evolution of solvers and data structures. The redesign was done through the addition of new linear and nonlinear solvers classes, enhancements to the vector class, and the creation of modern Fortran interfaces. The vast majority of this work has been performed “behind-the-scenes,” with minimal changes to the user interface and no reduction in solver capabilities or performance. These changes allow SUNDIALS users to more easily utilize external solver libraries and create highly customized solvers, enabling greater flexibility on extreme-scale, heterogeneous computational architectures.

• Publication year

  2020

• Venue

  ACM Transactions on Mathematical Software

• Publication date

  2020-11-19

• Fields of study

  Mathematics, Computer Science, Engineering

• Identifiers
  DOI 10.1145/3539801arXiv 2011.10073
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• The revised framework makes it easier to use external solver libraries and build highly customized solvers for extreme-scale, heterogeneous computational architectures.

  Confidence 0.95

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• The redesign was implemented mostly behind the scenes, with minimal changes to the user interface and no reduction in solver capabilities or performance.

  Confidence 0.93

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• New linear solver classes, nonlinear solver classes, vector-class enhancements, and modern Fortran interfaces were added to SUNDIALS to support more flexible solver and data-structure integration.

  Confidence 0.97

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review

• customized solvers

  software system

  Solver implementations tailored to specific applications or hardware environments using the redesigned SUNDIALS abstractions.

  Aliases: highly customized solvers

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• external solver libraries

  software library

  Third-party solver packages that SUNDIALS can integrate with through its redesigned interfaces.

  Aliases: third-party solver libraries

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• extreme-scale heterogeneous computational architectures

  computing architecture

  Large-scale computing platforms with mixed hardware resources that motivate the flexibility goals of the SUNDIALS redesign.

  Aliases: extreme-scale heterogeneous architectures

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• linear solver classes

  software component

  New class-based components in the SUNDIALS redesign that represent linear solvers as modular software objects.

  Aliases: linear solvers classes

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• modern fortran interfaces

  interface

  Updated Fortran bindings for interacting with SUNDIALS from modern Fortran code.

  Aliases: Fortran interfaces

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• nonlinear solver classes

  software component

  New class-based components in the SUNDIALS redesign that represent nonlinear solvers as modular software objects.

  Aliases: nonlinear solvers classes

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• performance

  software property

  The runtime efficiency and computational overhead characteristics of the SUNDIALS solvers.

  Aliases: solver performance

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• solver capabilities

  software property

  The range of problem types and solver functions supported by SUNDIALS.

  Aliases: capabilities

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• sundials

  software suite

  A software suite for solving nonlinear and differential/algebraic equations that is the subject of the redesign described here.

  Aliases: SUite of Nonlinear and DIfferential/ALgebraic equation Solvers

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• user interface

  interface

  The user-facing API and calling structure exposed to SUNDIALS users.

  Aliases: API, application interface

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review
• vector class

  software abstraction

  The abstraction in SUNDIALS used to represent vector data structures that can be extended for different application-specific implementations.

  Aliases: vector classes

  박진우 (dztg5apj7m) extraction뀨 (7c402c1b98) reviewKiller Whale (322360f1c1) reviewjaeyoung (rb9u4m834j) review

• AMReX: Block-structured adaptive mesh refinement for multiphysics applications

  2020cited by this paper
• Enabling GPU Accelerated Computing in the SUNDIALS Time Integration Library

  2020cited by this paper
• The deal.II library, Version 9.2

  2020cited by this paper
• Automated Fortran–C++ Bindings for Large-Scale Scientific Applications

  2019influential reference
• SUNDIALS Multiphysics+MPIManyVector Performance Testing

  2019cited by this paper
• Higher-order additive Runge–Kutta schemes for ordinary differential equations

  2019cited by this paper
• Preparation and Optimization of a Diverse Workload for a Large-Scale Heterogeneous System

  2019cited by this paper
• Evaluation of Implicit‐Explicit Additive Runge‐Kutta Integrators for the HOMME‐NH Dynamical Core

  2019cited by this paper
• MFEM: a modular finite element methods library

  2019cited by this paper
• Users

  2018cited by this paper
• CasADi: a software framework for nonlinear optimization and optimal control

  2018cited by this paper
• A Class of Multirate Infinitesimal GARK Methods

  2018cited by this paper
• ODES: a high level interface to ODE and DAE solvers

  2018cited by this paper
• Implicit–explicit (IMEX) Runge–Kutta methods for non-hydrostatic atmospheric models

  2017cited by this paper
• The Exascale Computing Project

  2017cited by this paper
• DifferentialEquations.jl – A Performant and Feature-Rich Ecosystem for Solving Differential Equations in Julia

  2017cited by this paper
• Cantera: An Object-oriented Software Toolkit for Chemical Kinetics, Thermodynamics, and Transport Processes. Version 2.2.1

  2016cited by this paper
• Cantera: An Object-oriented Software Toolkit for Chemical Kinetics, Thermodynamics, and Transport Processes. Version 2.2.0

  2015cited by this paper
• Implicit integration methods for dislocation dynamics

  2015cited by this paper
• Faster solvers for large kinetic mechanisms using adaptive preconditioners

  2015cited by this paper
• Iterative Solution of Nonlinear Equations in Several Variables

  2014cited by this paper
• Geoscientific Model Development Implementation of multirate time integration methods for air pollution modelling

  2012cited by this paper
• Numerical solution of multiscale problems in atmospheric modeling

  2012cited by this paper
• Anderson Acceleration for Fixed-Point Iterations

  2011cited by this paper
• Algorithm 907: KLU, A Direct Sparse Solver for Circuit Simulation Problems

  2010cited by this paper
• Solving Ordinary Differential Equations II: Stiff and Differential-Algebraic Problems

  2010cited by this paper
• Proof of concept of regional scale hydrologic simulations at hydrologic resolution utilizing massively parallel computer resources

  2010cited by this paper
• Multirate Runge-Kutta schemes for advection equations

  2009cited by this paper
• Towards dense linear algebra for hybrid GPU accelerated manycore systems

  2009cited by this paper
• Solving Ordinary Differential Equations I: Nonstiff Problems

  2009cited by this paper
• BOUT++: A framework for parallel plasma fluid simulations

  2008cited by this paper
• A numerical algorithm for the solution of a phase-field model of polycrystalline materials

  2008cited by this paper
• SBaddon: high performance simulation for the Systems Biology Toolbox for MATLAB

  2007cited by this paper
• The NEURON Book: Index

  2006cited by this paper
• CVODES: The Sensitivity-Enabled ODE Solver in SUNDIALS

  2005influential reference
• Numerical solution of initial value problems in differential - algebraic equations

  2005cited by this paper
• SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers

  2005cited by this paper
• SuperLU_DIST: A scalable distributed-memory sparse direct solver for unsymmetric linear systems

  2003cited by this paper
• Additive Runge-Kutta Schemes for Convection-Diffusion-Reaction Equations

  2003influential reference
• Adjoint Sensitivity Analysis for Differential-Algebraic Equations: The Adjoint DAE System and Its Numerical Solution

  2002cited by this paper
• Adjoint sensitivity analysis for differential-algebraic equations: algorithms and software☆

  2002cited by this paper
• Software and algorithms for sensitivity analysis of large-scale differential algebraic systems

  2000cited by this paper
• Multigrid on massively parallel architectures

  2000cited by this paper
• LAPACK Users' Guide, Third Edition

  1999cited by this paper
• Conservation laws and the numerical solution of ODEs, II

  1999cited by this paper
• LAPACK Users' guide (third ed.)

  1999cited by this paper
• NITSOL: A Newton Iterative Solver for Nonlinear Systems

  1998cited by this paper
• Consistent Initial Condition Calculation for Differential-Algebraic Systems

  1998influential reference
• An Asynchronous Parallel Supernodal Algorithm for Sparse Gaussian Elimination

  1997cited by this paper
• Efficient sensitivity analysis of large-scale differential-algebraic systems

  1997cited by this paper
• Implicit-explicit Runge-Kutta methods for time-dependent partial differential equations

  1997cited by this paper
• A parallel multigrid preconditioned conjugate gradient algorithm for groundwater flow simulations

  1996cited by this paper
• Numerical solution of initial-value problems in differential-algebraic equations

  1996cited by this paper
• Algorithms and software for ordinary differential equations and differential-algebraic equations, part I: Euler methods and error estimation

  1995cited by this paper
• Implicit-explicit methods for time-dependent partial differential equations

  1995cited by this paper
• Algorithms and software for ordinary differential equations and differential-algebraic equations, part II: higher-order methods and software packages

  1995cited by this paper
• Using Krylov Methods in the Solution of Large-Scale Differential-Algebraic Systems

  1994cited by this paper
• Solving ordinary differential equations h nonstiff problems

  1993cited by this paper
• Convergence results for a coordinate projection method applied to mechanical systems with algebraic constraints

  1993cited by this paper
• Hybrid Krylov Methods for Nonlinear Systems of Equations

  1990cited by this paper
• Reduced storage matrix methods in stiff ODE systems

  1989cited by this paper
• VODE: a variable-coefficient ODE solver

  1989cited by this paper
• KRYSI, an ODE solver combining a semi-implicit Runge-Kutta method and a preconditioned Krylov method

  1988cited by this paper
• Stiff ode slovers: a review of current and coming attractions

  1987cited by this paper
• Matrix-free methods for stiff systems of ODE's

  1986cited by this paper
• Numerical methods and software for sensitivity analysis of differential-algebraic systems

  1986cited by this paper
• Numerical methods for unconstrained optimization and nonlinear equations

  1983cited by this paper
• Scientific computing : applications of mathematics and computing to the physical sciences

  1983cited by this paper
• INEXACT NEWTON METHODS

  1982cited by this paper
• A description of dassl: a differential/algebraic system solver

  1982cited by this paper
• LSODE and LSODI, two new initial value ordinary differential equation solvers

  1980cited by this paper
• An Alternative Implementation of Variable Step-Size Multistep Formulas for Stiff ODEs

  1980influential reference
• A Polyalgorithm for the Numerical Solution of Ordinary Differential Equations

  1975influential reference
• Iterative Procedures for Nonlinear Integral Equations

  1965cited by this paper
• COMPUTING Applications of Mathematics and Computing to the Physical Sciences

  year unknowncited by this paper

• diffsol: Rust crate for solving differential equations

  2026cites this paper
• Simulation of Voltage and Current Waveforms During Nanosecond Pulsed Capacitive Discharges via Electrically Coupled Plasma Fluid Model and Lossless Transmission Line

  2026cites this paper
• Economic model predictive moisture control of a horizontal fluidized bed dryer for continuous pharmaceutical manufacturing

  2026cites this paper
• Ozone-affected auto-ignitive hydrogen-air flames: Transitions near critical temperatures

  2026cites this paper
• MagneX: A High-Performance, GPU-Enabled, Data-Driven Micromagnetics Solver for Spintronics

  2026cites this paper
• Virtual Cell and Metabolic Control Analysis: Control Coefficients for Glycolytic Flux Are Highly Dependent on the Subsystem Selected for Analysis

  2026cites this paper
• Super Time Stepping Methods for Diffusion using Discontinuous-Galerkin Spatial Discretizations

  2026influential citation
• Sensitivity and Parameter Analysis of a Population Balance Model Applied to Non-Reactive Gas–Liquid Semi-Batch Perfectly Stirred Tank Reactors

  2026cites this paper
• TChem-atm (v2.0.0): scalable performance-portable multiphase atmospheric chemistry

  2026cites this paper
• Reynolds number effects in turbulent premixed precracked ammonia-hydrogen flames

  2026cites this paper
• Numerical investigation of synergistic effects of nanopulsed plasma and water addition on hydrogen combustion and NO emissions

  2026cites this paper
• Assessment of conditional source-term estimation (CSE) with direct chemistry integration including detailed and reduced kinetics for the simulation of a turbulent DME flame

  2026cites this paper
• Achieving high rate performance in hybrid pristine-recycled cathodes using model-informed electrode designs

  2026cites this paper
• Scalable Preconditioners for the Pseudo-4D DFN Lithium-ion Battery Model

  2026cites this paper
• Gradient-Based MDAO Framework for Advanced Aircraft Concepts

  2026cites this paper
• Electromagnetic Transient Simulation of Photovoltaic Inverter Using Implicit-Explicit Solver

  2025cites this paper
• RE-INTEGRATE EMT Simulation Software: DAE Solvers and Automation

  2025cites this paper
• Relaxation Runge-Kutta Methods with First-Same-as-Last Structure

  2025cites this paper
• PCMS: Parallel Coupler For Multimodel Simulations

  2025cites this paper
• Numerically discovered inherent states are always protocol dependent in jammed packings

  2025cites this paper
• 13CFLUX - third-generation high-performance engine for isotopically (non)stationary 13C metabolic flux analysis

  2025cites this paper
• Computing nuclear response functions with time-dependent coupled-cluster theory

  2025cites this paper
• Adjoint-based A Posteriori Error Analysis for Semi-explicit Index-1 and Hessenberg Index-2 Differential-Algebraic Equations

  2025cites this paper
• A dynamic model for Waddington's landscape accounting for cell-to-cell communication.

  2025cites this paper
• Adaptive nonlinear model predictive control of monoclonal antibody glycosylation in CHO cell culture

  2025cites this paper
• Towards Seamless Interoperability of MPI-OpenMP Applications

  2025cites this paper
• Modiator - A Web App for Modelica Simulation

  2025cites this paper
• Parameter estimation in dynamic multiphase liquid-liquid equilibrium systems

  2025cites this paper
• Transient Microkinetic Modeling of Electrochemical Reactions: Capturing Unsteady Dynamics of CO Reduction and Oxygen Evolution

  2025cites this paper
• An efficient GPU-accelerated adaptive mesh refinement framework for high-fidelity compressible reactive flows modeling

  2025cites this paper
• Mechanism of tulip flame formation in highly reactive and low reactive gas mixtures

  2025cites this paper
• Fine tuning the morphology of peptide amphiphile nanostructures via co-assembly

  2025cites this paper
• Cluster dynamics simulations using stochastic algorithms with logarithmic complexity in number of reactions

  2025cites this paper
• Development of an Open-Source Package (ePowerSim.jl) for Static, Quasi-Static, and Dynamic Simulation of Electric Power Systems

  2025cites this paper
• Interfacial Energy Gradients Drive Coalescence of Supported Nanoparticles.

  2025cites this paper
• Gpu-accelerated JEMRIS for extensive MRI simulations

  2025cites this paper
• Investigation and simulation of droplet breakup and iron oxide nanoparticle formation in spray-flame synthesis

  2025cites this paper
• IonBench: A benchmark of optimisation strategies for mathematical models of ion channel currents

  2025cites this paper
• Accelerating high-fidelity simulations of chemically reacting flows using reduced-order modeling with time-dependent bases

  2025cites this paper
• A unified fluid model for nonthermal plasmas and reacting flows

  2025cites this paper
• Sensitivity Analysis on the DYNASTY Facility 1D Modelica Models with the DAKOTA-FMU Approach

  2025cites this paper
• A COGENT case study: Supporting Applications with Chombo

  2025cites this paper
• High-Performance C++ and Julia solvers in CADET for weakly and strongly coupled continuous chromatography problems

  2025cites this paper
• Plato: A High-Fidelity Library for Multicomponent Gases and Plasmas

  2025cites this paper
• Improving Interoperability in Scientific Computing via MaRDI Open Interfaces

  2025cites this paper
• Multi timescale battery modeling: Integrating physics insights to data-driven model

  2025cites this paper
• Methodological and computational framework for model-based design of parallel experiment campaigns under uncertainty

  2025cites this paper
• Computational Study on the Kinetics and Mechanism of Mn‐PNP Pincer Complex Catalyzed Addition Reaction Between Benzyl Cyanide and Cinnamonitrile

  2025cites this paper
• Two-dimensional general rate model with particle size distribution in CADET calibrated with high-definition CFD simulated intra-column data

  2025cites this paper
• Modelling of formic acid production using solventless trialkylamine reduction strategies.

  2025cites this paper
• The deal.II library, version 9.7

  2025cites this paper
• Degradation-Aware Model Predictive Control for Battery Swapping Stations under Energy Arbitrage

  2025influential citation
• Ultra long-term release of oligomeric surfactants from mesoporous silica nanoparticles into organic solvents

  2025cites this paper
• Efficient and Flexible Multirate Temporal Adaptivity

  2025cites this paper
• New Time Integrators and Capabilities in SUNDIALS Versions 6.2.0-7.4.0

  2025cites this paper
• On the choice of optimization norm for Anderson acceleration of the Picard iteration for Navier-Stokes equations

  2025cites this paper
• Multi-omics-driven kinetic modeling reveals metabolic adaptations and vulnerabilities in BRCA1-deficient ovarian cancer

  2025cites this paper
• Influence of Chemical Kinetics on Tulip Flame Formation in Highly Reactive (H2/Air) and Low Reactive (CH4/Air) Mixtures

  2025cites this paper
• Mixed-precision numerics in scientific applications: survey and perspectives

  2024cites this paper
• Revisiting Computation for Research: Practices and Trends

  2024cites this paper
• Negative feedback equalizes polarity sites in a multi-budding yeast

  2024cites this paper
• Diffusion-driven growth of calcium carbonate polymorphs in microchannels

  2024cites this paper
• Flame-wall interaction of thermodiffusively unstable hydrogen/air flames, Part I: Characterization of governing physical phenomena

  2024cites this paper
• Advancing simulations of coupled electron and phonon nonequilibrium dynamics using adaptive and multirate time integration

  2024cites this paper
• CADET-Julia: Efficient and versatile, open-source simulator for batch chromatography in Julia

  2024cites this paper
• Instability of Metals with Respect to Strong Electron-Phonon Interaction.

  2024cites this paper
• Multiscale homogenized constrained mixture model of the bio-chemo-mechanics of soft tissue growth and remodeling

  2024cites this paper
• PROKhOZhDENIE GAMMA-VSPLESKA ChEREZ MOLEKULYaRNOE OBLAKO: POGLOShchENIE POSLESVEChENIYa V RENTGENOVSKOM DIAPAZONE DLIN VOLN

  2024cites this paper
• A Fully Adaptive Radau Method for the Efficient Solution of Stiff Ordinary Differential Equations at Low Tolerances

  2024cites this paper
• Integrated scheduling and control with closed-loop prediction

  2024cites this paper
• COBRAPRO: An Open-Source Software for the Doyle-Fuller-Newman Model with Co-Simulation Parameter Optimization Framework

  2024influential citation
• Population Balance Model-based Dynamic Multiobjective Optimization of Yeast Cell Manufacturing

  2024cites this paper
• Analyzing JWST/NIRSpec Hydrogen Line Detections at TWA 27B: Constraining Accretion Properties and Geometry

  2024cites this paper
• Physics-informed genetic programming for discovery of partial differential equations from scarce and noisy data

  2024cites this paper
• A simple and fast robust nonlinear model predictive control heuristic using n-steps-ahead uncertainty predictions for back-off calculations

  2024cites this paper
• Artificial intelligence as a catalyst for combustion science and engineering

  2024cites this paper
• Enhanced Porous Electrode Theory Based Electrochemical Model for Higher Fidelity Modelling and Deciphering of the EIS Spectra

  2024cites this paper
• Validation of a predictive model of a premixed, lean hydrogen combustion for internal combustion engines

  2024cites this paper
• Towards the Use of Anderson Acceleration in Coupled Transport-Gyrokinetic Turbulence Simulations

  2024cites this paper
• Прохождение гамма-всплеска через молекулярное облако: ионизационная структура облака

  2024cites this paper
• Cluster-Based Semi-Empirical Model for Dopant Activation in Silicon Carbide

  2024cites this paper
• Ignis: A one-dimensional laminar flame code

  2024cites this paper
• Expanding the Reaction Network of Ethylene Epoxidation on Partially Oxidized Silver Catalysts

  2024cites this paper
• Setting the standard for machine learning in phase field prediction: a benchmark dataset and baseline metrics

  2024cites this paper
• Comparison between Compartment and Computational Fluid Dynamics Models for Simulating Reactive Crystallization Processes

  2024cites this paper
• Passage of a Gamma-Ray Burst through a Molecular Cloud: The Absorption of Its Afterglow in the X-ray Wavelength Range

  2024influential citation
• Bottom-up reconstruction of minimal pyrenoids provides insights into the evolution and mechanisms of carbon concentration by EPYC1 proteins

  2024influential citation
• A discrete sarcomere model reveals internal unbinding dynamics and conditions for regularity of spontaneous oscillatory contractions

  2024cites this paper
• Advanced Mathematical Model for the Transport of Aggregating Nanoparticles in Water Saturated Porous Media: Nonlinear Attachment and Particle Size‐Dependent Dispersion

  2024cites this paper
• Aggregating nanoparticle transport with nonlinear attachment: Modeling and experimental validation

  2024cites this paper
• Adaptive time stepping for the two-time integro-differential Kadanoff-Baym equations 

  2024cites this paper
• Symbolic construction of the chemical Jacobian of quasi-steady state (QSS) chemistries for Exascale computing platforms

  2024cites this paper
• Passage of a Gamma-Ray Burst through a Molecular Cloud: Cloud Ionization Structure

  2024influential citation
• SUNDIALS time integrators for exascale applications with many independent systems of ordinary differential equations

  2024cites this paper
• Predicting effective quenching of stable pulses in slow-fast excitable media.

  2024cites this paper
• ChemPlasKin: A general-purpose program for unified gas and plasma kinetics simulations

  2024cites this paper
• The optimal experiment? Influence of solution strategies on model-based optimal experimental design

  2024cites this paper
• ANN-Based Adaptive NMPC for Uranium Extraction-Scrubbing Operation in Spent Nuclear Fuel Treatment Process*

  2024cites this paper
• NonlinearSolve.jl: High-Performance and Robust Solvers for Systems of Nonlinear Equations in Julia

  2024cites this paper
• Quantifying the efficacy of voltage protocols in characterising ion channel kinetics: A novel information‐theoretic approach

  2024influential citation