Developer complains about Ox Alpha's slow inference: 127 mins for 10 min task
altryne · x · 2026-08-25
Developers reported poor inference performance for the Ox Alpha model, noting frequent interruptions and extreme slowness. A task estimated at 10 minutes took 127 minutes. While the model's capabilities are decent, concerns were raised about the infrastructure stability and the lab's ability to handle distribution upon general availability.
More from Models
- Unredacted Anthropic filing exposes internal data-quality debate months before Opus 3 cutoff — zacharynado · 2026-10-15
- Google says teams across the company are using Gemini 4 Argon on its hardest engineering problems — CurieuxExplorer · 2026-10-15
- Perplexity's new embedding models: index with a 9B model, search with 0.6B — antoine_chaffin · 2026-10-15
- 797GB of n-gram counts in CPU RAM let 1B models match 57% more compute — PangWeiKoh · 2026-10-15
- Leak: Moonshot's Kimi flagship 'x4' done with pre-training, K3.1 in internal testing — lyraxana · 2026-10-15
- Unsloth ships GGUF quants for Nemotron 3.5: Bolt-74B runs in 24GB RAM — danielhanchen · 2026-10-15