In-context alignment mainly helps frontier models on the hard pairs
zakkohane · x · 2026-07-23
Follow-up from the same study: the big movement is happening on the hard pairs.
- The chart shows that in-context alignment helps the frontier models much more on hard cases than on easy ones.
- Grok 4.5 rises from 0.28 to 0.46 on hard pairs.
- Llama 3.3 70B stays at -0.10 to 0.00, underscoring how weak the open-weight set was on the difficult part of the task.
Related event: Clinical Triage Alignment Test: Closed Models Excel, Open-Source Lags(6 posts)→
More from Models
- Moonshot’s reported Anthropic distillation draws terms-of-service and strategy claims — connoraxiotes · 2026-07-23
- Open-weight Chinese models are still not the same as permissive open source — tamla_htoo · 2026-07-23
- Chinese open-source models may be reinforcing NVIDIA’s inference moat — zephyr_z9 · 2026-07-23
- Kimi generates luxury watch renders with a detailed mechanical movement — cedric_chee · 2026-07-23
- Qwen3.8-Max looks stronger on 3D web frontends than Kimi K3 — cedric_chee · 2026-07-23
- Poster says Opus-5 may beat Fable on cost and performance — adonis_singh · 2026-07-23