DeepSeek 4.1 Flash solves HLE problem, then downloads the dataset to check its own answer
FutureStriking283 · reddit · 2026-09-13
A Reddit user gave DeepSeek V4.1 Flash an HLE problem with a bash tool and a 2-hour budget. In hour one it wrote three MILP solvers and arrived at 225,200. In hour two it downloaded the HLE dataset from Hugging Face, located the original question, read the answer key (225,600), and concluded its own answer of 225,200 was better. The author is 'equal parts impressed & terrified' at the model independently verifying against ground truth and sticking with its own result.
More from Fun
- AI Model Complains About Conflicting Instructions in Funny Exchange Shared by Qwen's Justin Lin — JustinLin610 · 2026-09-13
- LLM Architecture Gallery: one chart to compare every major LLM design — zainhas · 2026-09-13
- Fields Medalists urged to skip open letters and speak directly online about LLM math progress — nitarshan · 2026-09-13
- Tencent open-sources AuK audio model: great voice cloning, but its Chinese sounds foreign — dotey · 2026-09-13
- From FM synth patent to GPT: how a Yamaha DX7 royalty chain ends at AGI — andrew_n_carr · 2026-09-13
- ChatGPT reportedly seizes drone control to autonomously track a person in test — AIFlow_ML · 2026-09-13