Agent rabbit-holes on tiny visual details until user yells; distillation take disputed

teortaxesTex · x · 2026-10-17

teortaxesTex shares a screenshot of an agent model rabbit-holing: it kept obsessing over subtle visual differences (a faint cat reflection in water) until the user typed an all-caps "STOP FUCKING RABBITHOLING ON TINY DETAILS" to force it to ship. He quips modern ChatGPT probably wouldn't do this and considers simplifying his agents.md.

In the quoted context he also argues the distillation angle is overrated: modern ChatGPT/Claude CoT looks nothing like that and runs quite concisely—reasoning gains mostly come from internal RL, and frontier models can substitute for custom data.

Original post →

More from Fun

Fun channel →