Stealth Model Ox Alpha Proves Mediocre at Coding, Trails Grok 4.6
Pawel Huryn tested the stealth OpenRouter model Ox Alpha (GLM family) on Bug Hunt Bench, finding its real-repo bug-fixing mediocre and inferior to Grok 4.6. He open-sourced all scripts and raw logs in phuryn/experiments for reproducibility.
2026-08-25 ~ 2026-08-26 · 3 related posts
- Episode 1: Mystery model Ox Alpha stuns community; fingerprints point to Zhipu GLM-5.3(2026-08-21, 57 posts)
- Episode 2: OpenRouter's Mystery 'Ox Alpha' Model Identified as GLM(2026-08-21, 3 posts)
- Episode 3: Cola Launches Ox Model Claiming Terra-Level Capability at Flash Speed(2026-08-21, 2 posts)
- Episode 4: Mysterious Model Ox Alpha Gives Away 100T Tokens Daily, Sparking Power Questions(2026-08-21, 2 posts)
- Episode 5: Ox-Alpha Underperforms in Tests, Called Marketing Stunt(2026-08-22, 3 posts)
- Episode 6: Ox Alpha scores ~63% on full DeepSWE; earlier 80% was subset artifact(2026-08-22, 6 posts)
- Episode 7: Forensics Point to Zhipu's Unreleased GLM Behind Mystery Model Ox Alpha(2026-08-22, 31 posts)
- Episode 8: Ox Alpha Generates 64K-Token 3D Scene in One Prompt(2026-08-22, 2 posts)
- Episode 9: Mystery model Ox Alpha draws mixed reviews from early testers(2026-08-22, 6 posts)
- Episode 10: Mystery Model Ox Alpha Launches Free, Identity Unknown(2026-08-23, 3 posts)
- Episode 11: Mysterious Model Ox Alpha Debuts on OpenRouter, Sparking Speculation(2026-08-24, 5 posts)
- Episode 12: Leak: Ox Alpha Is GLM-5.3 Flash, 320B MoE at One-Tenth the Price(2026-08-25, 4 posts)
- Episode 13: Mystery Model Ox Alpha Revealed as Zhipu's GLM-5.3 Flash, Weights Going Open-Source Tonight(2026-08-25, 17 posts)
- Episode 14: Stealth Model Ox Alpha Proves Mediocre at Coding, Trails Grok 4.6(2026-08-25, 3 posts)
- Episode 15: Mystery Model Ox Alpha Revealed as Zhipu's GLM-5.3-Flash, Served on Domestic Chinese Chips(2026-08-26, 19 posts)
- Episode 16: Mystery Model Ox Alpha Burns 42T Tokens in Six Days(2026-08-26, 3 posts)
- Ox Alpha coding performance underwhelms, lags behind Grok 4.6 in bug fixing — PawelHuryn · 2026-08-25
- Ox Alpha unmasked: reproducible fingerprint experiments and full logs open-sourced — PawelHuryn · 2026-08-25
1 near-duplicate retellings: PawelHuryn