Reef open-sourced: continual learning infra that turns agent serving into a self-improvement loop

qinzytech · x · 2026-09-02

The Human-Agent-Society team (Ao Qu, Han Zheng et al.) has open-sourced Reef, continual learning infrastructure for agents that improve from their own experience.

The idea: instead of treating inference as the end of the pipeline, Reef turns live agent interactions into a continuous learning loop — serving real applications, capturing trajectories and feedback as structured experience, and letting different learning recipes use that experience.

Notably, what evolves is the whole agent — model weights plus the harness — with updates evaluated, versioned, and safely deployed back into serving. The repo ships standardized HTTP endpoints (agents downloadable like codex/opencode), Docker deployment, tutorials, and multiple recipes.

Related event: CMU Researchers Open-Source Reef for Continuously Self-Improving Agents(3 posts)→

Original post →

More from coding & agent

coding & agent channel →