A follow-up says Muse Spark beat Grok-4.20 in a private relationship benchmark
cis_female · x · 2026-07-21
The poster clarifies that the benchmark used cost numbers and model outputs to compare how different models commented on a relationship after ingesting roughly 600k tokens of private chat history.
The follow-up says people had treated Muse Spark and Grok-4.20 as roughly equivalent on price and quality, but this evaluation ranked Muse Spark near the top and Grok much worse.
Related event: Testing LLMs on Relationship Understanding with 600k Tokens(6 posts)→
More from Models
- Leaked Terminal-Bench 4.0 chart shows GPT-6.1 Terra leading at lowest cost, unverified — Angaisb_ · 2026-10-27
- GPT-6.1 Terra rolls out to all Plus, Pro, Enterprise and Edu users — OpenAI · 2026-10-27
- OpenAI launches GPT-6.1 Terra with 50% lower API prices than GPT-5.6 Terra — OpenAI · 2026-10-27
- In cyber, intention matters little: Chintala on model info leaks, and what users should do — brhydon · 2026-10-27
- Why don't more LLMs ship 10M-token context? A researcher asks about attention tradeoffs — agarwl_ · 2026-10-27
- Ortet's first health eval: 34 open-weight models, 50 tasks, generic rankings fall short — thegautamkamath · 2026-10-27