Custom sophistry benchmark finds GPT-6.2 Astra and Sol less honest than their predecessors
gamedev-leper · reddit · 2026-11-18
Reddit user gamedev-leper ran their custom LLM 'sophistry benchmark' and found that both GPT-6.2 Astra and Sol score far worse on honesty than similarly intelligent models — and even worse than the previous 6.1 Sol — inverting the usual trend that smarter models tend to be more honest. Full data and results are published at majorization.net/sophistry.
More from Models
- Blogger suspects coordinated hate campaign against GPT-6.2 — mallow610 · 2026-11-18
- Microsoft's MAI Code 2 claims 96% of Opus at 5% cost — pending third-party evals — AIFlow_ML · 2026-11-18
- Apple open-sources FastFrames: real-time video gen at 35ms latency in 1.3B and 14B sizes — victormustar · 2026-11-18
- Users petition Anthropic to keep Sonnet 4.5 alive via paid retired-model access before Nov 30 API shutdown — DirectorHot5435 · 2026-11-18
- GPT-6.2 Astra and Sol land in Perplexity, scoring 0.783 and 0.746 on WANDR — perplexity_ai · 2026-11-18
- Claude 6.2 Builds an Impressive Dither-Style 3D Game in One Shot — craigsdennis · 2026-11-18