A 600k-token relationship test compares how models comment on personal context
cis_female · x · 2026-07-21
A user shared evaluation results for a relationship-understanding prompt, graded by Fable 5.
The post says the test used about 600k tokens of messages with a friend over the past year, then asked multiple models to comment on the relationship with a few specific prompts.
The actual score table is shown in the attached image, but the post itself is mainly a pointer to the eval setup and results.
Related event: Testing LLMs on Relationship Understanding with 600k Tokens(6 posts)→
More from Models
- Leaked Terminal-Bench 4.0 chart shows GPT-6.1 Terra leading at lowest cost, unverified — Angaisb_ · 2026-10-27
- GPT-6.1 Terra rolls out to all Plus, Pro, Enterprise and Edu users — OpenAI · 2026-10-27
- OpenAI launches GPT-6.1 Terra with 50% lower API prices than GPT-5.6 Terra — OpenAI · 2026-10-27
- In cyber, intention matters little: Chintala on model info leaks, and what users should do — brhydon · 2026-10-27
- Why don't more LLMs ship 10M-token context? A researcher asks about attention tradeoffs — agarwl_ · 2026-10-27
- Ortet's first health eval: 34 open-weight models, 50 tasks, generic rankings fall short — thegautamkamath · 2026-10-27