BEST PRACTICE GUIDE || Multi-GPU AI Train the Trainer Workshop

Read full text Summarise with VIRAT
Authors: WP3 CASTIEL2
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

The Multi‑GPU AI Train‑the‑Trainer Workshop is a fully online, five‑day programme designed to equip instructors with both the technical expertise and pedagogical strategies needed to teach modern multi‑GPU and distributed AI workflows. Developed collaboratively within CASTIEL2 WP3 together with NCCs from Finland, Hungary, the Netherlands, Belgium, Romania, Italy, and Sweden, the workshop builds on the CASTIEL2 Multi‑GPU AI curriculum and provides hands‑on training using CINECA's Leonardo supercomputer. Participants explore a broad range of topics—including GPU architectures, deep learning fundamentals, distributed training with PyTorch DDP, model and pipeline parallelism, PyTorch Lightning, LLM fine‑tuning with HuggingFace Accelerate and DeepSpeed, computer vision, MLOps on HPC, Ray for distributed AI, RAG workflows, and hyperparameter optimisation—while also gaining practical guidance and reusable materials to confidently deliver these trainings within their own national programmes.

Fields of Study & Subjects

Parallel Computing and Optimization Techniques Teaching and Learning Programming Genetics Bioinformatics and Biomedical Research

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
30 March 2026
Language
EN