New Gyro quant format accused of being a closed-source EXL3 clone with no proven gains
nasone32 · reddit · 2026-10-24
- A Reddit user dug into Gyro, a new quant format rapidly spreading across inference engines (notably Strata), and concluded it's essentially another flavor of EXL3: both belong to the QTIP/Trellis-coded quantization family and use Hadamard rotations.
- Key differences: Gyro uses a 15-bit Trellis state (vs 16), 128-weight encoding blocks (vs 256-weight tiles), an explicit LUT codebook with 2,048 2D points plus state hashing for reconstruction, and incompatible packing formats.
- The author found no published evidence Gyro beats EXL3 on decode speed or perplexity/KLD/top-1%, criticizing its aggressive branding and closed-source recipe for fragmenting the local quantization community without clear benefit.
More from Infra
- antirez makes the case for local AI as hacker's Samsung TV snooping saga hits HN — antirez · 2026-10-24
- PNG is slow because of deflate, not libpng — zlib-ng's SIMD wins — ssh4net · 2026-10-24
- Micron roadmap: HBM4 at 2.8 TB/s per stack, vertical HBM on GPUs by 2028 — rohanpaul_ai · 2026-10-24
- Hunyuan 3D 2.1 nearly unusable on Mac: errors above 512 resolution — idmimagineering · 2026-10-24
- GPU programming day 293: diving into SGLang via mini-sglang and MIT's EfficientML lecture 12 — NandoDF · 2026-10-24
- China's Jiuzhang 4.0 claims 10^42-year speedup in 25 microseconds — but the task has no practical use — AryHHAry · 2026-10-24