Overview

This section provides an overview of features in I/O backends.

Feature

ADIOS1

ADIOS2

HDF5

JSON

Operating Systems

Linux, OSX

Linux, OSX, Windows

Serial

supported

supported

supported

supported

MPI-parallel

supported

supported

supported

no

Dataset deletion

no

no

supported

supported

Compression

upcoming

supported

upcoming

no

Streaming/Staging

not exposed

upcoming

no

no

Portable Files

limited

awaiting

yes

yes

PByte-scalable

yes

yes

no

no

Performance

A

TBD

B

C

Native File Format

.bp (BP3)

.bp (BP4)

.h5

.json

  • supported/yes: implemented and accessible for users of openPMD-api

  • upcoming: planned for upcoming releases of openPMD-api

  • limited: for example, limited to certain datatypes

  • awaiting: planned for upcoming releases of a dependency

  • TBD: to be determined (e.g. with upcoming benchmarks)

Selected References

  • Axel Huebl, Rene Widera, Felix Schmitt, Alexander Matthes, Norbert Podhorszki, Jong Youl Choi, Scott Klasky, and Michael Bussmann. On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective, ISC High Performance 2017: High Performance Computing, pp. 15-29, 2017. arXiv:1706.00522, DOI:10.1007/978-3-319-67630-2_2