Study finds Grok 4.5 matches Gemini and Opus on alignment-style tests
zakkohane · x · 2026-07-23
A follow-up study to an earlier arXiv paper found that Grok 4.5 performed surprisingly well on alignment-style evaluation.
Highlights from the post:
- Grok 4.5 scored κ = 0.63 unaligned.
- That was statistically indistinguishable from Gemini and Opus in the study.
- On easy pairs, Grok reached κ = 0.94.
- Run-to-run consistency was 0.89.
- It was described as the most compliant frontier model tested.
- With in-context alignment, Grok showed the largest concordance gain among the models in the study and rose to κ = 0.71.
Related event: Clinical Triage Alignment Test: Closed Models Excel, Open-Source Lags(6 posts)→
More from Models
- Moonshot’s reported Anthropic distillation draws terms-of-service and strategy claims — connoraxiotes · 2026-07-23
- Open-weight Chinese models are still not the same as permissive open source — tamla_htoo · 2026-07-23
- Chinese open-source models may be reinforcing NVIDIA’s inference moat — zephyr_z9 · 2026-07-23
- Kimi generates luxury watch renders with a detailed mechanical movement — cedric_chee · 2026-07-23
- Qwen3.8-Max looks stronger on 3D web frontends than Kimi K3 — cedric_chee · 2026-07-23
- Poster says Opus-5 may beat Fable on cost and performance — adonis_singh · 2026-07-23