The training course covers the theoretical and practical principles of massively parallel GPU computing with CUDA technology based on hands-on exercises, highlighting the capabilities of the parallel computing on the way with increasing complexity. The course will discuss the CUDA hardware and software architecture, memory management, parallel computing with C/C++ and Python, common application libraries and tools. An additional attention is paid to the possibilities and advantages of using CUDA in machine learning solutions.