The computational requirements of deep neural networks used to enable AI applications like self-driving cars are enormous. A single training cycle can take weeks on a single GPU or even years for larger datasets like those used in self-driving car research. Using multiple GPUs for deep learning can significantly shorten the time required to train lots of data, making solving complex problems with deep learning feasible.

We will teach you how to use multiple GPUs to train neural networks. You'll learn:

• Approaches to multi-GPUs training

• Algorithmic and engineering challenges to large-scale training

• Key techniques used to overcome the challenges mentioned above

This course is only offered to academia.