Rust+Vulkan Backend Cross-Vendor Fix: Select Kernels by CPU ISA, Not GPU Vendor
PhysicsDisastrous462 · reddit · 2026-10-08
(Duplicate of an earlier post with the same content.) The author fixed a portability bug in their Rust + Vulkan Transformer backend: reduction shapes tuned for Intel Gen9 were one ulp off on AMD hardware, amplified through the gradient path and failing six PEFT fixtures. Root cause: ATen dispatches vectorized kernels by host ISA; the fix selects those reductions by host CPU capability, with both machines now passing 32/32 under the unchanged 2e-7 gate. See the earlier identical post for the full writeup.
Related event: Rust+Vulkan Inference Backend Fixes Cross-Vendor Portability Bug(2 posts)→
More from Infra
- StackOverflow 2026 Survey: Postgres Stays #1 at 58%, Supabase Climbs to 8% — dshukertjr · 2026-10-08
- Dev runs 456GB DeepSeek v4.1 on dual GPUs with 192GB VRAM, offloading experts to SSD — HankYeomans · 2026-10-08
- GB300 compute capacity bought with opencode credits in all-token deal — const_reborn · 2026-10-08
- Building an ultra-high throughput AI-SQL engine: cutting LLM call costs with query plans — HamelHusain · 2026-10-08
- Together is now the #1 provider by token volume on OpenRouter — NVIDIAAI · 2026-10-08
- umbrelOS 2.0 makes local AI a two-install setup: Ollama + Open WebUI with auto GPU detection — JosephJacks_ · 2026-10-08