Fractale-350M: Open-Sourcing Memory as a Training Behavior

KKuettes · reddit · 2026-07-20

Independent researchers have released the Fractale-350M-base model, exploring a novel long-term memory mechanism by treating memory as a training behavior instead of relying on long contexts.

Core Design

Experimental Data

Open Source & Limitations

The author plans to use instruction tuning and reinforcement learning in the second phase to teach the model to use these memories actively and deliberately.

Original post →

More from Models

Models channel →