Introduction to CUDA will be offered from March 25

In collaboration with NCC Poland and RTU HPC Center, we offer a two-day introductory course in CUDA – Introduction to Massively Parallel GPU Computing with CUDA on March 25 and April 1, 15:00-18:00 CET.

The course covers the theoretical and practical principles of a massively parallel approach to high-performance computing using multiprocessing systems and/or a combination of GPU hardware and specialized software environment. The course gives an overview of the types of high-performance computing hardware and software architecture, computing algorithms, application libraries, and tools. More attention is paid to the applied interdisciplinary use of GPU-based parallel computing platform CUDA, e.g., analysis of large data amounts, image processing, and machine learning tasks. More information about the course is available here.

Please register here.

AGENDA

Day I

  1. Overview of CUDA architecture and programming model:
    • GPU evolution
    • CUDA GPU architecture
  2. Basic CUDA programming:
    • Brief revise of CUDA programming model
    • Key principles
    • Introduction to the concept of threads & blocks
    • Host-device data transfer
  3. Hands-on exercises on writing simple CUDA programs:
    • Using CUDA on HPC cluster
    • Simple programs with C/C++

Day II

  1. Overview of CUDA memory hierarchy:
    • An overview of memory levels
    • Global memory
    • Registers, constant memory, texture memory
    • Shared memory and synchronization
  2. Introduction to CUDA Deep Neural Network library (cuDNN):
    • Using cuDNN for deep neural networks
    • Convolutional neural networks in cuDNN
    • Integration with other CUDA libraries (cuBLAS, cuSOLVER, cuRAND, cuTENSOR, TensorRT)
  3. Exercises on CUDA techniques: image processing and neural networks
    • Image convolution filtering
    • Implementation of neural network from scratch with C/C++
    • Implementation of neural network using cuDNN

The training is organized by HPC Competence Center in Latvia “SuperS” and HPC Competence Center in Poland in collaboration with RTU HPC Center and University of Warsaw.

Register