ninfer-ext: a community fork adding faster inference and Qwen3.8-Flash support
giveen · reddit · 2026-09-27
The poster built ninfer-ext on top of ninfer, bringing faster inference and Qwen3.8-Flash support. They candidly note it isn't faster everywhere, but there's room for improvement. Open-sourced on GitHub.
More from Infra
- Interactive Architecture Atlas Maps DeepSeek V4, GLM 5.3 and Kimi K3 Down to Kernel Tensor Shapes — zhyncs42 · 2026-09-27
- Running NixOS on DGX Spark: open-source project ships USB images and Nix module — _nateraw · 2026-09-27
- Nature paper demos integrated photonic neural network trained end-to-end with on-chip backprop — jwt0625 · 2026-09-27
- MiniMax H3 runs locally on an RTX 3060: 20-second 540p clip took 15 minutes — Adventurous-Rich-965 · 2026-09-27
- RAM prices up 500%: buy local AI hardware now, says analyst roundup — julianharris · 2026-09-27
- UK grid power shortfall could delay a major AI project by years — rvp · 2026-09-27