Paper Questions True Autonomy of Current AI Agents
i_dg23 · x · 2026-07-16
This paper categorizes most current "AI agents" as merely agentic (appearing to act), rather than truly agentive (possessing autonomy).
The author argues that the "smartness" of systems like Claude Code, Cursor, and AutoGen primarily stems from peripheral software design, not the model itself. The paper critiques five specific gaps:
- Goal: Task objectives are reset by humans each time, lacking the ability to maintain long-term goals.
- Identity: System prompts are merely external settings, not true self-awareness.
- Decision-Making: Longer chains of thought do not equate to stronger real-world simulation.
- Self-Regulation: Adaptive reasoning and plan modes still rely on humans to switch them externally.
- Learning: Models are essentially frozen post-deployment; when and what to learn is dictated by humans.
The paper proposes the GIC (Goal-Identity-Configurator) architecture, aiming to embed these capabilities deeper into the model. It uses the example of "breaking the rule to run in an emergency to fetch an EpiPen" to illustrate the complex internal decision-making and rule-trading the author seeks to address.
Related event: ICML Keynote: Moving from Guardrails to Principled AI Agency(3 posts)→
More from Research
- LoMa Paper Ships REALLY HardPairs Dataset, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11
- A 3D Pose Dataset for Dogs Released — ducha_aiki · 2026-09-11
- Five tells that still make AI video read as AI, from physics glitches to missing operators — NewPhoneWhotiz · 2026-09-11
- AnyMatch accepted to ECCV 2026 with a NoPresenter design — ducha_aiki · 2026-09-11