Indie researcher stores documents as SSD "memory cartridges" for a frozen Qwen2.5-72B, claims byte-identical replay
Nearby_Indication474 · reddit · 2026-10-20
An independent researcher posted a self-published technical record (TEST730, "AKBASCORE Silicon Hippocampus") describing an unusual external-memory scheme for frozen LLMs:
- Mechanism: On a frozen Qwen2.5-72B-Instruct (A100 80GB), a CUT3 engine captures layer-3 hidden states plus K/V tensors of layers 0–3 and stores them as SHA-256-verified "memory cartridges" on an SSD. On reload, H3 is injected at the layer-3 boundary and the frozen model recomputes layers 4–79, so the source document never needs to be pasted back into the prompt.
- Cross-document synthesis: Three 2026 academic papers were encoded as cartridges P01–P03; the model's reflections on each were synthesized and encoded into a fourth MASTER cartridge (94.3 MB on disk, 943.4 MB reconstructed K/V), which alone answered six academic questions on causal modeling and experiment design.
- Verification: The author reports a live session re-forged all four cartridges with byte-identical SHA-256 hashes, 80/80 layer parity, and two sealed answers reproduced byte-for-byte.
Caveat: this is a non-peer-reviewed personal record on Zenodo/GitHub with self-defined verification; treat it as an extreme demo of hidden-state reuse rather than an established method.
More from Research
- Causal inference tutorial series covers DAG engines for separating correlation from causation — Nasereliver · 2026-10-20
- Google's FireSat constellation uses AI to spot wildfires as small as 5x5 meters from space — GoogleAI · 2026-10-20
- CyberArena benchmarks AI agents in live attack-and-defense combat — 2077AIDataFoundation · 2026-10-20
- Training MOSS-Image LoRAs locally on 8GB VRAM: 500 steps beats 8000, full settings inside — AcademiaSD · 2026-10-20
- PNAS study: brief AI chats drive 17,950 people to sign petitions and donate, attitudes don't predict behavior — _FelixSimon_ · 2026-10-20
- Citrini Used Anthropic's Internal Model to Design Scorpion Antivenom Proteins Overnight — citrini · 2026-10-20