Course/Event Essentials
Training Content and Scope
Other Information
The National Competence Centers in HPC of Turkey and the Czech Republic are inviting you to the jointly developed training: Mastering Transformers: From Building Blocks to Real-World Applications.
For the past five years, the amount of transformer-based architectures has grown significantly and continues to dominate the deep learning domain. They can be considered another leap innovation that further pushes the boundaries in deep neural network performance and scalability. They have been demonstrated with the most significant models using over half a trillion parameters and scaled up to thousands of GPUs.
In this course, participants learn the building blocks of transformer architectures to apply them to their projects. These novel methods will be differentiated against existing methods, showing their advantages and disadvantages. Different hands-on exercises give the participants room to explore how the transformers work in various fields of application.