NCC Spain offers the Supercomputing for Artificial Intelligence: An Introduction for SMEs course. It is a self-paced online module designed for professionals, companies (especially SMEs), researchers, and technical staff interested in understanding how High-Performance Computing (HPC) Systems affect the execution and performance of Artificial Intelligence (AI) applications, and how to exploit HPC to achieve the best performance.
Through video lessons and self-assessment quizzes, participants will learn about the impact of supercomputing techniques, heterogeneous computing, and parallel programming on large-scale data processing, and will be introduced to the fundamentals of Deep Learning and neural networks. In addition, they will gain an understanding of how to train real-world models using PyTorch, exploring complete workflows—from data preparation to evaluation—and learning how to apply parallelism techniques and tools such as Distributed Data Parallel to accelerate and optimize the training of AI models.
Syllabus
-
What is Supercomputing?: Motivation for using supercomputing; definition and characteristics; advantages and challenges; use cases (simulations, scientific and healthcare calculations, services, artificial intelligence).
-
Parallel Programming Paradigms: Shared-memory architecture (multi-core nodes); distributed-memory architecture (clusters); heterogeneous systems (GPUs).
- GPU Architecture and Inner Workings: heterogeneous systems, host-device model and Simultaneous Multi-Threading (SMT).
- Introduction to Deep Learning: current state of the art of AI and fundamentals of neural networks.
- Deep Learning Workflow: from data preparation to model evaluation.
- Practical Training with PyTorch: practical programming examples with one of the most used AI frameworks in the industry.
- AI Parallelism: how to distribute the training phase and accelerate processes.
- Introduction to PyTorch Distributed Data Parallel (DDP): an introduction for beginners of the DDP module and optimization strategies.
Fees
Free of charge