Reef: open-source infra that lets agents keep evolving weights and harness after deployment
Scobleizer · x · 2026-09-03
The Human-Agent-Society team open-sourced Reef, infrastructure tackling a key question: can agents keep improving after deployment?
- Echoing Ilya Sutskever's argument that future systems should learn from deployment, Reef turns the serving stack itself into a learning layer: collecting live experience, converting it into updates, and safely feeding them back into serving.
- It claims to be the first open-source infrastructure to evolve both model weights and the agent harness (prompts, memory, skills, tools, orchestration) from deployment experience.
- Usage resembles codex/opencode: download agents via standard HTTP endpoints and route model requests to Reef's inference endpoint instead of the provider; Reef continuously evaluates agent behavior and improves harness and weights in the background.
- Available on GitHub (Human-Agent-Society/reef), supporting model evolution methods like SAO and TTT-Discover, with 150 stars so far.
More from coding & agent
- LLM one-shots a Minecraft 3x3 piston door by building its own Linux test infra — Vjeux · 2026-10-18
- Dev builds Mumbai-inspired 3D manga background generator from OpenStreetMap data — CurieuxExplorer · 2026-10-18
- Solo founder builds a money-printing data service on Claude's Pi Durable harness — MicahBerkley · 2026-10-18
- Dev builds Arch-based OS with custom desktop and browser using Claude Code — Snoo-10493 · 2026-10-18
- Pi Durable went through 7 rewrites yet agent session files still lack a standard — ricklamers · 2026-10-18
- Five SaaS agent workflows fail the same way — and it's never model intelligence — usehive · 2026-10-18