Agent retried for 16 hours silently? Author introspects durable runtime with Postgres persistence
slateraligator · reddit · 2026-09-02
An author shared a production incident where an agent silently retried 1,200 times over 16 hours due to a misconfiguration. In response, they open-sourced 'Toren', a durable agent runtime (Apache 2.0). Key features include:
- State Persistence: Every step is written to Postgres before execution, allowing recovery from crashes/OOM without re-paying for API calls.
- Retry Logic: Exponential backoff and hard caps on attempts.
- External Cancellation: Ability to kill runs from outside.
- Cost Tracking: CI pipeline kills the worker at every step to verify billing.
The author argues that long-running agents must be durable to survive deploys and API changes.
More from coding & agent
- Agentic engineering irony: engineers must think like GPUs — charles_irl · 2026-09-02
- MapQuest launches MCP server to power AI agents with location and routing data — deliprao · 2026-09-02
- Ethan Mollick Proposes 'Facilitator Agents' to Decide Human Intervention — rseroter · 2026-09-02
- User frustration with Google Antigravity: weak Gemini behavior, one PowerShell command burned 50% of Claude quota — DigSudden6867 · 2026-09-02
- Agent 自动纠错案例:发邮件修正公共数据集错误 — JanJanJaJa · 2026-09-02
- User Spent $2,760 on Tokens Despite Rate Limit Complaints — oyacaro · 2026-09-02