Model Running Recipes Organized by Hardware
totosse17 · reddit · 2026-07-12
The author created a recipes page for running models on popular hardware. The page filters available solutions based on your hardware and displays running recipes for different models and devices. If your configuration is missing, you can submit a new recipe. The author also added an "I'm running this" button so the community can see which setups are actually being used.
More from Infra
- oMLX 0.5.2 adds Mac menu-bar stats, low-bit decode kernels, and faster downloads — awnihannun · 2026-07-22
- Strangeworks launches Aura to turn enterprise ops into production optimization systems — whurley · 2026-07-22
- Graph workload 854.graph500 enters SPEC CPU 2026 as a new CPU benchmark — Prof_DavidBader · 2026-07-22
- HilbertRaum open-sources a fully local AI chat and document analysis app for private use — Vladowski · 2026-07-22
- Hybrid and local inference are emerging as a response to AI energy and token costs — dmitry140 · 2026-07-22
- NVIDIA details Vera CPU with 2x performance claims and a 22,000-core rack — ryanshrout · 2026-07-22