We need an L0.5 for continual learning: agent state stacks up in 4 layers

willcb · x · 2026-10-22

Seth Karten argues the current agent stack needs "an L0.5 for continual learning." The accompanying diagram lays out a four-layer state abstraction: L0 model weights (fine-tuning), L1 active context (compaction), L2 REPL & subagents with recursive session state (agentic garbage collection), and L3 disk-backed state holding history, artifacts, memories, skills, prompts, and subagent specs (refinement) — separated by a model-context boundary.

The point: between weights (L0) and context (L1) there's a missing layer that could carry genuine continual learning — an open zone for agent memory and self-improvement research.

Original post →

More from coding & agent

coding & agent channel →