Ox Alpha benchmarks on LiveCodeBench_v6: 28% Pass@1
nasarulislam · reddit · 2026-08-22
A user benchmarked the Ox Alpha model on LiveCodeBenchv6 with 175 problems using greedy decoding. Without agents or tools, the model achieved an overall Pass@1 of 28.0% (Easy: 51.2%, Medium: 30.8%, Hard: 13.8%). The author found it underwhelming compared to DeepSeek V4-Flash and suggested cost will be the deciding factor.
More from Models
- Google Criticized: Gemini 3.7 Still Missing From Its Own Jules Agent a Week Later — brandon_galang · 2026-08-24
- Qwen 27B 3.8 low quantization tested: Q3 XXS works well locally — jeremyckahn · 2026-08-24
- Users notice significant quality shift in GPT-5.6 output — haider1 · 2026-08-24
- Ramp Stats: Anthropic Opus 4.8 and Sonnet 4.6 Lead Usage — vista8 · 2026-08-24
- Tencent Releases UI-Mate-27B, a Desktop GUI Agent Model — tencent · 2026-08-24
- ConvRot Quant joins llama-cpp: Q6 accuracy nears Q8 quality — giveen · 2026-08-24