KDA memory decay uses radioactive-style half-life math, with 69-token lifetime at α=0.99
CatAstro_Piyush · x · 2026-07-29
KDA’s memory decay follows the same half-life math as radioactive decay: if a channel evolves as Sn = α^n S0, then its half-life is n½ = ln(0.5) / ln(α). The post notes that α = 0.99 gives a half-life of about 69 tokens.
The attached formula image shows KDA learning different decay parameters across memory channels, so each channel can operate on its own timescale. In other words, the model is not using one universal memory horizon, but a set of learned ones.
More from Research
- Transforming quadruped robot runs on real hardware: per-pose RL policies in Isaac switched on morph — _Stocko_ · 2026-10-16
- KinoGen synthesizes robot loco-manipulation reference motions directly via kinematically grounded video generation — ChongZzZhang · 2026-10-16
- Science Robotics paper introduces F³, predictive event-based vision beyond optical flow — CSProfKGD · 2026-10-16
- VideoGen-Agent: An 8B Multimodal Agent Turns Video Generation Into a Tool-Use Loop — jiqizhixin · 2026-10-16
- Comprehension Audits: New Paper Proposes a Gate for AI-Written Code at Frontier Labs — ronbodkin · 2026-10-16
- Not Boring #215: Cammarata's Clean Networks Claim, Tesla's Flying Roadster, Tau Cut 73% — Not Boring (Packy McCormick) · 2026-10-16