A 600k-token relationship test compares how models comment on personal context
cis_female · x · 2026-07-21
A user shared evaluation results for a relationship-understanding prompt, graded by Fable 5.
The post says the test used about 600k tokens of messages with a friend over the past year, then asked multiple models to comment on the relationship with a few specific prompts.
The actual score table is shown in the attached image, but the post itself is mainly a pointer to the eval setup and results.
Related event: Benchmark Compares LLMs on Cost-Efficiency and Deep Context Understanding(4 posts)→
More from Models
- Soofi S 30B-A3B releases a full pretraining report and claims open-model leads in English and German — abursuc · 2026-07-21
- pi 0.81.0 adds first-class integration with llama.cpp server — huggingface · 2026-07-21
- GPT-5.6 Sol is said to explain weak opinions better than Opus 4.8 — eyishazyer · 2026-07-21
- Leak claims Gemini 3.5 Pro gets a 2M-token context and better coding — bdsqlsz · 2026-07-21
- Ethan Mollick says AI-writing sameness is about craft, not em dashes or bullet lists — emollick · 2026-07-21
- Kimi rolls out paid plan upgrades with tiers from $19 to $199 a month — gnukeith · 2026-07-21