NVIDIA launches CUDA Rust: two paths to write GPU kernels natively in Rust
blelbach · x · 2026-09-17
NVIDIA introduced CUDA Rust, enabling developers to write GPU kernels natively in Rust rather than just launching them from it, via two tracks:
- cuda-oxide: a custom rustc codegen backend compiling SIMT-style kernels directly to PTX through the Pliron IR framework and LLVM; early alpha, requires a pinned nightly toolchain and custom LLVM.
- cutile-rs: Tile-based programming on stable Rust (1.89+ with CUDA 13.3), where the compiler manages thread mapping and memory layout via CUDA Tile IR JIT compilation; published on crates.io and already used in HuggingFace's Grout inference engine and mistral.rs.
Both enforce compile-time memory safety — cuda-oxide uses DisjointSlice and launch contracts to prevent aliasing, while cutile-rs relies on tensor partitioning and ownership. NVIDIA also plans inter-language interoperability between CUDA Rust, CUDA C++, and CUDA Python.
Related event: NVIDIA Launches CUDA Rust for Native GPU Kernels in Rust(2 posts)→
More from Infra
- OpenRouter crosses 10 quadrillion annualized token run rate, doubling every 10.5 weeks — deedydas · 2026-11-02
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02
- Intel plunges 29%, worst day since the 1970s, wiping $12B off US government stake — emmanuelvivier · 2026-11-02
- Researcher hoards nearly 1TB of DRAM, refuses to sell a stick to data centers — kevinnbass · 2026-11-02