Letting the Model Pick Its Own Thinking Effort: An Adaptive Harness Experiment
HeDo88TH · reddit · 2026-09-06
Prompted by the Qwen 3.8 27B thinking-levels debate, a Reddit developer suggests a harness modification that lets the LLM itself decide when to raise or lower reasoning effort. The system dynamically switches between low and xhigh based on success/failure streaks and task phase — dropping to low on stable success streaks or mechanical steps, escalating on meaningful failures or when entering DEBUG/RECOVER phases, with structured JSON logs tracking each transition. Early results show much faster task completion, though no reliable quality evaluation has been collected yet; he muses about before/after GPQA Diamond testing and asks whether anyone has tried something similar.
More from coding & agent
- 105 Real Bugs Tested: GPT-6.1 Sol Over 10x Cheaper Than GPT-5.6 Sol — PawelHuryn · 2026-10-23
- Dev builds SkiFree-style sled game in one prompt, praises DeepSeek Flash — victormustar · 2026-10-23
- Every ditched personal agents for a shared Claude Managed Agents coworker in one week — every · 2026-10-23
- WorkOS shows how to let AI agents safely sign up for your app with auth.md and ID-JAG — AI Engineer · 2026-10-23
- Devs on Reddit swap tactics for stopping prompt regressions in AI agents — SleepFlimsy6963 · 2026-10-23
- Claude Code + ComfyUI MCP workflow for client work: paid models or open weights? — newaccount47 · 2026-10-23