ChatGPT Sol Gets It Right on High Effort
goodside · x · 2026-07-13
The author provides an update noting that Sol Pro, as well as Sol non-Pro at higher effort levels, can now correctly handle similar examples. The two previous examples provided were set to "high" effort, and higher tiers were not tested.
The post also includes a ChatGPT share link, mentioning that users can reproduce the results using the attached image.
Related event: GPT-5.6 Sol vs Claude Fable 5 Doodle Test Sparks Hallucination Debate(5 posts)→
More from Models
- BullshitBench update: GPT-6-Astra beats all prior OpenAI models but still trails Anthropic — scaling01 · 2026-09-11
- Astra Scores 83% on GauntletBench, First Computer-Use Agent to Beat Human Baseline — ducha_aiki · 2026-09-11
- Kimi K2.8 Preview rolls out: near-K3 coding performance, 1M context for all tiers — teortaxesTex · 2026-09-11
- Looking for a classifier of software engineering task shapes to pick models per task — StewartalsopIII · 2026-09-11
- DeepSeek V4 Pro API to continue after Sept 2026, billing unchanged — teortaxesTex · 2026-09-11
- DeepSeek V4.1 Flash Hits 98% of GPT-6 Astra's Score at 1.4% of the Cost in Third-Party Benchmark — ayushtweetshere · 2026-09-11