Mastering Transformers: From Building Blocks to Real-World Applications

Course/Event Essentials

Event/Course Start
Event/Course End
Event/Course Format
Online

Venue Information

Country: Czech Republic
Venue Details: Click here

Training Content and Scope

Level of Instruction
Intermediate
Sector of the Target Audience
Research and Academia
Industry
Public Sector
Language of Instruction

Other Information

Organiser
Supporting Project(s)
EuroCC2/CASTIEL2
Event/Course Description

The National Competence Centers in HPC of Turkey and the Czech Republic are inviting you to the jointly developed training: Mastering Transformers: From Building Blocks to Real-World Applications. 

For the past five years, the amount of transformer-based architectures has grown significantly and continues to dominate the deep learning domain. They can be considered another leap innovation that further pushes the boundaries in deep neural network performance and scalability. They have been demonstrated with the most significant models using over half a trillion parameters and scaled up to thousands of GPUs.

In this course, participants learn the building blocks of transformer architectures to apply them to their projects. These novel methods will be differentiated against existing methods, showing their advantages and disadvantages. Different hands-on exercises give the participants room to explore how the transformers work in various fields of application.