neural-pairing: open-source linking Qwen3-4B and AFM-4.5B via hidden states, no tokens
Sauers_ · x · 2026-10-29
The open-source neural-pairing repo links Qwen3-4B (Quill) and AFM-4.5B (Ember) — two models from different families — through their hidden states. From layer 8 onward, every few layers each twin attends over the partner's hidden states (RMS-normalized, gated keys/values) and adds the result to its own residual stream; no tokens are exchanged. In a demo, Quill reads out the city hidden in Ember's private prompt. Code and models are public.
More from coding & agent
- orbench launches on Product Hunt: benchmark LLMs on your own tasks before switching — IgorCarron · 2026-10-29
- GET requests can carry body payloads — an overlooked AI agent tool-use exploit — bigorangemachine · 2026-10-29
- MulticaAI 1.0 screenshots show AI agents taking real tickets inside an issue tracker — jiayuan_jy · 2026-10-29
- Exploring the shape of AI-generated upstream PRs maintainers will accept — lucasmeijer · 2026-10-29
- Reddit user shares a claim-by-claim workflow for verifying AI stock research — Low_Teach_2252 · 2026-10-29
- Builder says 30+ AI agents running a video studio hint AGI may arrive as an organization — r0ck3t23 · 2026-10-29