Eric Hartford's fork unlocks P2P for RTX 3090/4090/5090 on NVIDIA's open kernel driver

QuixiAI · x · 2026-09-06

QuixiAI / Eric Hartford released a fork of NVIDIA's open-gpu-kernel-modules (driver 610.57.04) enabling PCIe peer-to-peer between consumer GeForce GPUs — RTX 3090, 4090 and 5090 — derived from George Hotz / tinygrad's P2P patch and ported to the 610 series. It also includes two DGX Spark fixes: freed GPU memory now returns to the OS (previously 64 GB went 'missing', breaking vLLM), and GPU page faults use huge pages, lifting first-touch bandwidth from 0.4 to 19.6 GiB/s.

Related event: Eric Hartford unlocks consumer GPU P2P, open-sources SlimServe for 262K-context inference(10 posts)→

Original post →

More from Infra

Infra channel →