Rails benchmark: Grok 4.6 hits 84% accuracy near Opus at 60% lower cost
AccBalanced · x · 2026-08-19
dhh shared the Rails coding benchmark results, marveling at how fast Grok is closing on the frontier and asking "what happened to Google?"
Of the 4 new models benchmarked, Grok 4.6 performed best: 4th in accuracy at 84% (vs. current best Claude Opus 5 at 92%) while costing 60% less; it also scored 33.3% recall on Rails APIs, third on the leaderboard. Claude Opus 4.8 ranked second for speed at 3m36s, just 7 seconds behind the fastest (Luna). Gemini Flash 3.7 performed mid-to-low across the board but remains one of the cheaper options.
More from Models
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- Americans get their Claude accounts banned while on business trips in China — dotey · 2026-10-16
- I priced every Grok Bot call: $20 to $200 plan in 5 days, long jobs eat 52% — jonathanmalkin · 2026-10-16
- NVIDIA releases Nemotron-3.5-Embed-1B, a multimodal embedding model covering 34 languages — jacek2023 · 2026-10-16
- EpochAI pegs GPT-6 training at up to 1.8e27 FLOP; scaling01 calls param estimates way too high — scaling01 · 2026-10-16