Parallel Programing with MPI


The course gives basic knowledge in programming distributed memory machines using the Message Passing Interface (MPI) industry standard.
After a short introduction to the foundations of HPC and the areas of their application the MPI standard is introduced and some techniques for profiling and debugging of parallel applications are discussed. After thar a detailed presentation of the MPI standard is given, focusing on its implementation for the development of parallel programs. Some specific profiling and fine tuning techniques are introduced.