WORKSHOP || Multi-GPU AI_Train the Trainer. Day 3: Mastering LLMs: Fine-Tuning, DeepSpeed, and PyTorch Lightning

Speakers: Francesco Fiusco (NCC Sweden), Geert Jan Bex (NCC Belgium) & Riccardo Scheda (NCC Italy)

This comprehensive session focuses on the tools and techniques required to manage Large Language Models (LLMs) and complex workflows. Francesco Fiusco from NCC Sweden introduces PyTorch Lightning as a high-level framework to automate and organise research code. Geert Jan Bex from NCC Belgium then provides a deep dive into the world of LLMs and specific fine-tuning methodologies. Finally, Riccardo Scheda from NCC Italy demonstrates how to leverage HuggingFace Accelerate and DeepSpeed to achieve extreme memory efficiency and training speed.