Solo dev argues LLMs shouldn't be the default center of an agent runtime
HmmmThisIsOdd · reddit · 2026-09-15
A developer building an agent runtime called Nova challenges the mainstream 'LLM-centric' design with two architectural principles:
1. Route requests instead of always going through the model. The typical user → model → tools → result pipeline routes everything through probabilistic inference. Instead, split at the entry point: deterministic operations take a deterministic path; only requests needing semantic interpretation, disambiguation or reasoning hit the LLM.
2. Separate reasoning from authority. A model can suggest what should happen, but shouldn't automatically be the component that decides whether an action is permitted, executes it, and declares success — splitting the pipeline into reason → authorize → execute → verify.
The author candidly asks whether this genuinely reduces model dependence or just moves the hard problem into routing, and invites feedback from others building runtimes where the model isn't the first hop for everything.
More from AGI Musings
- Developers Arguing Over Coding Skills Is Like Taxi Drivers Vs. Waymo, Says Dev — CtrlAltDwayne · 2026-09-15
- Jensen Huang at All-In Summit: AI Doomer Hoax, Open Source, and the China Race — sudoraohacker · 2026-09-15
- Sincere or self-serving? Debunking the 'AI doom is regulatory capture' theory — jungofthewon · 2026-09-15
- Not an EA coup: Scholars' Stage argues AI unease is a broad, slow shift in public awareness — michael_nielsen · 2026-09-15
- Kelsey Piper: Calling Myself 'EA-Adjacent' Would Be Lying — I'm an Effective Altruist — NathanpmYoung · 2026-09-15
- Kelsey Piper: No Community Matches EA's Density of Important Ideas and Personal Sacrifice — NathanpmYoung · 2026-09-15