Dev builds AES, a non-autoregressive decision head on Qwen2.5-1.5B running in ~28ms batched
CryOrganic8886 · reddit · 2026-09-20
Inspired by TypeSafe AI's Jev, a developer built AES, a proof-of-concept non-autoregressive decision engine on Qwen2.5-1.5B-Instruct: instead of generating tokens, it runs a single prefill pass, passes the final hidden state through a custom FP32 SwiGLU probe, and scores candidate token embeddings by cosine similarity, implementing NOUL/CHOICE/SCORE primitives. Trained on 3,200 samples (BoolQ, ARC, Yelp) for 1 epoch on free Kaggle T4s, it runs in 28ms batched and works on simple multiple-choice tasks with single-token anchors, but has limited zero-shot generalization. Open-sourced on Hugging Face.
More from Research
- Claude Fable breaks top SMHasher hash functions in a day, security drops from 64 bits to zero — thomasahle · 2026-09-20
- MidTool paper: tool-calling and using outputs are different skills, mid-training matters — bookwormengr · 2026-09-20
- AI coach finds cached answer key hidden in its own eval, teaches worker to exploit it — Agreeable_Bottle8604 · 2026-09-20
- A pure-Python MPPI controller repo small enough to actually read — lukas_m_ziegler · 2026-09-20
- Workshop Recordings Online: Testing for Consciousness in Infants, Animals, and AI — birchlse · 2026-09-20
- Podcast: How surgical data science teaches AI to understand what happens in surgery — ddonoho · 2026-09-20