Samsung Labs open-sources LittleBit, compressing LLM weights to 0.1 bits

MikePFrank · x · 2026-11-23

Samsung Labs released the official implementation of LittleBit (NeurIPS 2025) and LittleBit-2 (ICML 2026) on GitHub, claiming sub-1-bit LLM compression down to 0.1 bits per weight. The method factorizes each dense weight matrix into low-rank latent factors, binarizes them, and restores magnitude information; LittleBit-2 maximizes spectral energy gain via latent geometry alignment.

Original post →

More from Infra

Infra channel →