An introduction to the parallel programming of supercomputers is given. The focus is on the usage of the Message Passing Interface (MPI), the most often used programming model for systems with distributed memory. Furthermore, OpenMP will be presented, which is often used on shared-memory architectures.

The three day course consist of lectures as well as practical tutorials on implementing the techniques presented in the course.

Topics covered:

• Fundamentals of Parallel Computing (incl. HPC system architectures, shared and distributed memory concepts)
• MPI (basics, point-to-point communication, collective communication, blocking and non-blocking)
• OpenMP (basics, parallel construct, data sharing, loop work sharing, task work sharing)