Why AI agents need a two-tier architecture for tool execution and secret isolation
badhiyahai · reddit · 2026-07-24
The author argues that public-facing tool-using agents should use a two-tier design: one persistent server that only handles prompts and tool planning, and a separate ephemeral machine that actually executes code. This isolates malicious prompts so a bad command only affects one user’s sandbox instead of the shared server.
The post also notes a related secret-management pattern: never store OpenAI or other API keys on the persistent server. Instead, inject them on the fly through a proxy backed by a separate vault. The author says Anthropic’s managed agents follow a similar idea, even if they don’t call it that.
More from coding & agent
- A developer burned 2 billion tokens porting a Mac app to iPhone — nicolascraske · 2026-07-25
- Elicit will demo research agents with API search, reports, and MCP at 10am PT — elicitorg · 2026-07-25
- Testing MCP servers still feels painfully slow for ChatGPT connector builders — Think-Ad986 · 2026-07-25
- A year of subagent practice gets distilled into one Swarm Coding skill — rseroter · 2026-07-25
- A simple sidebar shortcut lets you open AI coding sessions in a grid — PaulShellDev · 2026-07-25
- HappenstanceAI found an Arsenal data scientist by searching a Premier League network — alex_teichman · 2026-07-25