Qwen N-gram mechanism enriches tokens using 51B table

antirez · x · 2026-08-30

antirez adds details on the Qwen 3.8 Flash Next N-gram mechanism: it enriches the current token representation at Layer 2 using a 51B table and a gate. Layer 1 processing allows time to fetch the 16 small vectors from SSD via masking, optimizing the pipeline with asynchronous retrieval.

Related event: antirez: Qwen 3.8 Flash Next's 51B N-gram Table Could Be Best Local Inference Option on 64GB Macs(7 posts)→

Original post →

More from Infra

• DLSS 5 Video Player tested: Runs slow on 3090 Ti due to FP8 lack — fallengt · 2026-08-30
• Data Centers Drive US Reindustrialization: Benefits from Taxes to Jobs — GavinSBaker · 2026-08-30
• Running Qwen3.8-Next-Flash on 96GB RAM: offload the n-gram table to SSD — Iory1998 · 2026-08-30
• Vietnam's OneNexus quantizes GLM-5.3 to MXFP4 — xiaosun86 · 2026-08-30
• Pi Agent setup: Using Qwen 27B as an Oracle for co-development — Thrumpwart · 2026-08-30
• Full-stack AI EDA to disrupt chip design economics — ai · 2026-08-30

Infra channel →