Single-source cross-platform GPU LLM inference with Slang and Rust

Location: Venue 6 - B01

Leveraging Rust and Khronos' emerging Slang initiative, we introduce our initial efforts toward a cross-platform GPU LLM inference ecosystem. With a single-source approach we aim to minimize backend-specific code and foster community participation.