The focus of this course is on the concept of performing I/O operations (reading/writing from/to file) in parallel, as well as demonstrating the usage of common libraries to perform such parallel I/O tasks. This course will start with an introduction of different parallel I/O strategies. It will then cover the NetCDF-4 and HDF5 libraries. Lastly, optimisation potential and best practices for parallel I/O are discussed.
The three half-day course consist of lectures as well as practical exercises on implementing the techniques presented in the course.
Note: This is an introductory course into an advanced topic. Familiarity with HPC and parallel programming are prerequisite.
This course is followed by a half-day course on I/O guidelines for Machine/Deep Learning with PyTorch on the 30th of October 2025. Link is coming soon - stay tuned.
Prerequisites: knowledge about Linux shell (usage of terminal commands), experience in one of the following programming languages C/C++/Fortran/Python, knowledge in MPI parallelisation
Target audience: supercomputer users, developers of parallel applications
Language: This course is given in English.
Register here: https://go.fzj.de/2025-parallel-io