The Engine and the Forge: Building a Custom PyTorch Framework on a Supercomputer

Location: Venue 4 - 338

This is a deep-dive for the builders, architects, and infrastructure experts. We will take the audience on a technical journey into the heart of the Bielik.AI project. We start with the "engine": our custom PyTorch framework built specifically for supercomputer environments. This presentation explores the architectural decisions, optimization strategies, and engineering challenges involved in adapting PyTorch for large-scale distributed training on supercomputing infrastructure. We examine performance bottlenecks, memory management strategies, and the practical considerations of scaling deep learning workloads to thousands of compute nodes.