Parallel netCDF: A High-Performance Scientific I/O Interface

No abstract is available for this paper.

• Publication year

  2003

• Venue

  International Conference on Software Composition

• Publication date

  2003-11-15

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/1048935.1050189
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• I/O analysis and optimization for an AMR cosmology application

  2002cited by this paper
• A Case Study in Application I/O on Linux Clusters

  2001cited by this paper
• FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes

  2000cited by this paper
• Using MPI-2: Advanced Features of the Message Passing Interface

  1999cited by this paper
• On implementing MPI-IO portably and with high performance

  1999cited by this paper
• Data sieving and collective I/O in ROMIO

  1998influential reference
• NetCDF User''s Guide for C

  1997cited by this paper
• Mpi-2: extensions to the message-passing interface

  1997cited by this paper
• Users guide for ROMIO: A high-performance, portable MPI-IO implementation

  1997cited by this paper
• An abstract-device interface for implementing portable parallel-I/O interfaces

  1996cited by this paper
• An Extended Two-Phase Method for Accessing Sections of Out-of-Core Arrays

  1996cited by this paper
• A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard

  1996cited by this paper
• PASSION Runtime Library for parallel I/O

  1994cited by this paper
• Improved parallel I/O via a two-phase run-time access strategy

  1993cited by this paper
• Proceedings of the Fast 2002 Conference on File and Storage Technologies Gpfs: a Shared-disk File System for Large Computing Clusters

  1992cited by this paper
• Science At the National Center for Supercomputing Applications

  1988cited by this paper

• Toward a persistent event-streaming system for high-performance computing applications

  2025cites this paper
• Parallel optimization techniques for ultra-large scale refined numerical simulations on Chinese supercomputers

  2025cites this paper
• Parallel Data Object Creation: Scalable Metadata Management in Parallel I/O Library

  2025cites this paper
• IOAgent: Democratizing Trustworthy HPC I/O Performance Diagnosis Capability via LLMs

  2025cites this paper
• CASSE: Targeted Threat Modeling for Data Management Libraries

  2025cites this paper
• Data Management in the Continuum: Cross-facility Object-based Data Transfers

  2025cites this paper
• A Scalable System for Visual Analysis of Ocean Data

  2025cites this paper
• Patient-specific lattice-Boltzmann simulations with inflow conditions from magnetic resonance velocimetry measurements for analyzing cerebral aneurysms

  2025cites this paper
• Dynamic transparent streaming in file-based workflows with CAPIO

  2025cites this paper
• HPC I/O innovations in the exascale era

  2025influential citation
• Comparative Analysis of the Flow in a Realistic Human Airway

  2025cites this paper
• SCORPIO: A Parallel I/O library for Exascale Earth System Models

  2025cites this paper
• LegoIndex: A Scalable and Modular Indexing Framework for Efficient Analysis of Extreme-Scale Particle Data

  2025cites this paper
• BBView: A View-Aware Burst-Buffer Mechanism for MPI-IO

  2025cites this paper
• Scaling Ultrahigh-Resolution E3SM Land Model for Leadership-Class Supercomputers

  2025cites this paper
• Parallel Data Object Creation: Towards Scalable Metadata Management in High-Performance I/O Library

  2025cites this paper
• Parallel Writing of Nested Data in Columnar Formats

  2024cites this paper
• To Derive or Not to Derive: I/O Libraries Take Charge of Derived Quantities Computation

  2024cites this paper
• Dynamical reconstruction of the upper-ocean state in the central Arctic during the winter period of the MOSAiC expedition

  2024cites this paper
• AIO: Automating I/O Optimization Pipeline for Data-Intensive Applications in HPC

  2024influential citation
• Auto-tuning for HPC storage stack: an optimization perspective

  2024cites this paper
• Concealing Compression-accelerated I/O for HPC Applications through In Situ Task Scheduling

  2024cites this paper
• Improving Performance of SLAV Model for Medium Range Weather Prediction

  2024cites this paper
• Parallel I/O Characterization and Optimization on Large-Scale HPC Systems: A 360-Degree Survey

  2024cites this paper
• A Data Optimizer for Region-Aware Self-describing Files in Scientific Computing

  2024cites this paper
• h5bench: A unified benchmark suite for evaluating HDF5 I/O performance on pre‐exascale platforms

  2024cites this paper
• HDF5 in the exascale era: Delivering efficient and scalable parallel I/O for exascale applications

  2024cites this paper
• Inspection of I/O Operations from System Call Traces using Directly-Follows-Graph

  2024cites this paper
• ParaLog: Consistent Host-side Logging for Parallel Checkpoints

  2024cites this paper
• Drilling Down I/O Bottlenecks with Cross-layer I/O Profile Exploration

  2024cites this paper
• Automated surgery planning for an obstructed nose by combining computational fluid dynamics with reinforcement learning

  2024cites this paper
• Accelerating Scientific Application through Transparent I/O Interposition

  2024cites this paper
• ION: Navigating the HPC I/O Optimization Journey using Large Language Models

  2024cites this paper
• A parallel implementation of the confined–unconfined aquifer system model for subglacial hydrology: design, verification, and performance analysis (CUAS-MPI v0.1.0)

  2023cites this paper
• Accelerating In Situ Analysis using Non-volatile Memory

  2023cites this paper
• I/O Access Patterns in HPC Applications: A 360-Degree Survey

  2023cites this paper
• The Simple Cloud-Resolving E3SM Atmosphere Model Running on the Frontier Exascale System

  2023cites this paper
• Unlocking massively parallel spectral proper orthogonal decompositions in the PySPOD package

  2023cites this paper
• Programming Abstractions for Data Locality

  2023cites this paper
• Optimizing Write Performance for Checkpointing to Parallel File Systems Using LSM-Trees

  2023cites this paper
• An Empirical Roofline Model for Extreme-Scale I/O Workload Analysis

  2023cites this paper
• A Numerical Model Oriented Large-scale Parallel I/O Optimization Method

  2023cites this paper
• CIOFC1.0: a common parallel input/output framework based on C-Coupler2.0

  2023cites this paper
• Universal Data Junction: A Transport Layer for Data Driven Workflows

  2023cites this paper
• scda: A Minimal, Serial-Equivalent Format for Parallel I/O

  2023cites this paper
• I/O in WRF: A Case Study in Modern Parallel I/O Techniques

  2023cites this paper
• An Asynchronous Parallel I/O Framework for Mass Conservation Ocean Model

  2023cites this paper
• Characterization of Large-scale HPC Workloads with non-naïve I/O Roofline Modeling and Scoring

  2023cites this paper
• Conflux: Exploiting Persistent Memory and RDMA Bandwidth via Adaptive I/O Mode Selection

  2023cites this paper
• Optimizing HPC I/O Performance with Regression Analysis and Ensemble Learning

  2023cites this paper
• swMPAS-A: Scaling MPAS-A to 39 Million Heterogeneous Cores on the New Generation Sunway Supercomputer

  2023cites this paper
• EMPRESS: Accelerating Scientific Discovery through Descriptive Metadata Management

  2022cites this paper
• A Comprehensive I/O Knowledge Cycle for Modular and Automated HPC Workload Analysis

  2022cites this paper
• CLAIRE—Parallelized Diffeomorphic Image Registration for Large-Scale Biomedical Imaging Applications

  2022cites this paper
• Accelerating Parallel Write via Deeply Integrating Predictive Lossy Compression with HDF5

  2022cites this paper
• Extracting and characterizing I/O behavior of HPC workloads

  2022cites this paper
• Access Patterns and Performance Behaviors of Multi-layer Supercomputer I/O Subsystems under Production Load

  2022cites this paper
• A machine-learning-based method for automatizing lattice-Boltzmann simulations of respiratory flows

  2022cites this paper
• Data Storage for HEP Experiments in the Era of High-Performance Computing

  2022cites this paper
• A model of checkpoint behavior for applications that have I/O

  2022cites this paper
• Drishti: Guiding End-Users in the I/O Optimization Journey

  2022cites this paper
• SnuQS: scaling quantum circuit simulation using storage devices

  2022cites this paper
• File System Semantics Requirements of HPC Applications

  2021cites this paper
• Improving the I/O of large geophysical models using PnetCDF and BeeGFS

  2021cites this paper
• Exploring MPI Collective I/O and File-per-process I/O for Checkpointing a Logical Inference Task

  2021cites this paper
• A Twenty-Year Analysis of Winds in California for Offshore Wind Energy Production Using WRF v4.1.2

  2021cites this paper
• Clairvoyant Prefetching for Distributed Machine Learning I/O

  2021cites this paper
• Concurrent file metadata structure using readers-writer lock

  2021cites this paper
• Supporting Data Compression in PnetCDF

  2021cites this paper
• Tuning Parallel Data Compression and I/O for Large-scale Earthquake Simulation

  2021cites this paper
• SCTuner: An Autotuner Addressing Dynamic I/O Needs on Supercomputer I/O Subsystems

  2021cites this paper
• Big Data over Cloud: Enabling Drug Design Under Cellular Environment

  2021cites this paper
• End-to-end online performance data capture and analysis for scientific workflows

  2021cites this paper
• FasTensor Programming Model

  2021cites this paper
• Big Data Approach to Large Scale Molecular Dynamics Simulations: Necessity and Inevitability for Drug Design

  2021cites this paper
• A Middleware Supporting Data Movement in Complex and Software-Defined Storage and Memory Architectures

  2021cites this paper
• Convection‐Permitting Simulations With the E3SM Global Atmosphere Model

  2021cites this paper
• Evaluation and optimisation of the I/O scalability for the next generation of Earth system models: IFS CY43R3 and XIOS 2.0 integration as a case study

  2021cites this paper
• Optimizing data query performance of Bi-cluster for large-scale scientific data in supercomputers

  2021cites this paper
• pMEMCPY: a simple, lightweight, and portable I/O library for storing data in persistent memory

  2021cites this paper
• Adaptive Spatially Aware I/O for Multiresolution Particle Data Layouts

  2021cites this paper
• Practice Guideline for Heavy I/O Workloads with Lustre File Systems on TACC Supercomputers

  2021cites this paper
• Best practice of IO workload management in containerized environments on supercomputers

  2021cites this paper
• Improving Prediction-Based Lossy Compression Dramatically via Ratio-Quality Modeling

  2021cites this paper
• Battle of the Defaults: Extracting Performance Characteristics of HDF5 under Production Load

  2021cites this paper
• Parallel I∕O in Flexible Modelling System (FMS) and Modular Ocean Model 5 (MOM5)

  2020cites this paper
• Zonal Flow Solver (ZFS): a highly efficient multi-physics simulation framework

  2020cites this paper
• High-Performance Techniques for Big Data Processing

  2020cites this paper
• Computer Architecture II

  2020cites this paper
• GPU Direct I/O with HDF5

  2020cites this paper
• UniIndex: An index and query middleware for parallel file systems

  2020cites this paper
• Ad hoc file systems for HPC

  2020cites this paper
• Parallelization and I/O Performance Optimization of a Global Nonhydrostatic Dynamical Core using MPI

  2020cites this paper
• Design and Study of Elastic Recovery in HPC Applications

  2020cites this paper
• Design and Implementation of the Tianhe-2 Data Storage and Management System

  2020cites this paper
• ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management

  2020cites this paper
• Ad Hoc File Systems for High-Performance Computing

  2020cites this paper
• High-Performance Computing for Earth System Modeling

  2020cites this paper
• ExaHDF5: Delivering Efficient Parallel I/O on Exascale Computing Systems

  2020cites this paper
• Bridging Storage Semantics Using Data Labels and Asynchronous I/O

  2020cites this paper