AI Training Series - Introduction to the LRZ AI Systems

Contents

The aim of this course is to give an overview of the LRZ AI Systems, and provide participants with the knowledge and skills necessary to efficiently utilise them. The course consists of mini lectures, demos and hands on sessions (breaks included).

By participating in this lecture, you will be able to:

  • Understand the resources that the LRZ AI System provides
  • How to allocate resources on the LRZ AI System and provision them with the needed software stack
  • How to interactively work with the LRZ AI Systems via the terminal (also Jupyter Notebooks for single GPU workload)

Upon completion, you will be able to effectively use the LRZ AI Systems to run Deep Learning workflows.

Blocks of content:

  • Overview of LRZ AI Systems (1h)
    • Hardware overview
    • Access mode for the different resources 
    • Execution Mode (software stack
  • Fundamentals of Deep Learning (1.5h)
    • Introduction to Neural Network
    • Training Neural Network
    • Exercises: Training Convolutional Neural Networks on GPUs
    • Exercises: Training Transformers on GPUs
  • Distributed Deep Learning Training Part I (1.5h)
    • Motivation for Distributed Deep Learning Training
    • Overview of Techniques for Distributed Deep Learning Trainin
  • Distributed Deep Learning Training Part II (1.5h)
    • Data Parallelism
    • Exercise: Multi-GPU Data Parallelism
    • Exercise: Multi-Node Data Parallelism

Prerequisites

  • AI Training Series: Orientation Session (or comparable previous knowledge)
  • AI Training Series: Introduction to Container Technology & Application to AI at LRZ (or comparable previous knowledge)
  • Good understanding of Deep Learning and Classical Machine Learning (courses such as Introduction to Deep Learning (I2DL) (IN2346) are provided by TUM - material also available for non-TUM students)

Hands-On

During the course a live demo on how to access and operate the LRZ AI system will be showcased. Exercises will be conducted on the LRZ AI Systems. In addition, the parallelisation of the training of a ML model will be also demonstrated. 

Content Level

The content level of the course is broken down as:

Beginner's content:

100%

Intermediate content:

0%

Advanced content:

0%

Community-targeted content:

0%

Language

English

Lecturers

Benjamin Geißler and Dr. Mares Barekzai (both LRZ)

Prices and Eligibility

The course is open and free of charge for people from academia and industry affiliated with an institution in the Member States of the European Union or Associated/Other Countries to the Horizon 2020 programme.

Registration

Please apply with your official email address to prove your affiliation. The final participants will be selected and informed after the registration deadline has passed. Priority will be given to users of the LRZ AI systems, who are kindly requested to provide their Project ID associated with the LRZ AI Systems in the registration form.

 

Fees

Free of charge