Agent Harness Lessons: Every Fix for GPT-3.5 Turbo Was Code, Not a Prompt
tejaskumarlol · reddit · 2026-09-14
After a talk at AI Engineer Europe, the author recounts building an agent harness where GPT-3.5 Turbo drives a real browser via Playwright to upvote the top Hacker News story — with the prompt never changing across versions:
- v0 bare loop: hits the login wall yet reports success, because the loop trusts the model's "done".
- v1 guardrails: code-enforced iteration/message limits and naive context trimming — bounds damage but fixes nothing.
- v2 deterministic verify: plain code reads the tool call trace to check the upvote actually happened, up to 3 retries — still fails, but stops lying.
- v3 harness-side login: the harness detects the login page from the URL and logs in with credentials from env vars the model never sees; success in 6 iterations.
Takeaways: a model claiming completion is a claim, not evidence — verify in code; put secrets and fragile deterministic steps in the harness, not the prompt; the harness is everything around the agent loop, sometimes a loop around the loop.
More from coding & agent
- Think locally, tool-call globally: a pithy take on agent architecture — charles_irl · 2026-09-14
- Codex Remote blurred bar on iOS to be fixed with iOS 27 SDK — Dimillian · 2026-09-14
- Tip: Claude skills can also bundle runnable scripts — JeremyNguyenPhD · 2026-09-14
- Companies Built an Expensive Amnesia Machine: Re-explaining Business to AI Every Chat — mhdfaran · 2026-09-14
- JS engineer to Lead AI Engineer: Omio's production agentic stack, from MCP rebuild to token costs — js_craft_hq · 2026-09-14
- oh-my-hermes adds long-term memory and workflow skills to Claude Code agents — rlaope · 2026-09-14