LZ4 v1.11.0 ships multithreaded compression, hits 7,550 MB/s with 16 workers
jedisct1 · x · 2026-11-05
LZ4 v1.11.0 is a major release integrating 850+ commits, headlined by multithreading now built into the liblz4 library itself.
- Multithreaded compression via the lz4frame API: set LZ4Fpreferencest.nbWorkers and go, in one-shot or streaming mode
- Near-linear scaling: compressing silesia.tar (202 MB) at level 1 goes from 522 MB/s single-threaded to 7,550 MB/s with 16 workers on an EPYC Genoa
- Substantial speed gains on small data, especially with dictionaries
- Tons of corner-case fixes after a large influx of contributions
- Binary compatible with previous versions; upgrade recommended
More from Infra
- Goldman restricts traders' AI tools while Apple cuts internal AI budgets in same week — GaryMarcus · 2026-11-05
- Polymarket puts 29% odds a state enacts data center moratorium by year-end — Polymarket · 2026-11-05
- Running Qwen 27B Q4 at 0.7 tok/s on a 4GB-VRAM laptop as a main coding model — Felix_455-788 · 2026-11-05
- Stanford's Joules-to-GDP framework measures how much economic value AI produces per joule of energy — HazyResearch · 2026-11-05
- Beff backs space data centers: policy will only accelerate the Dyson swarm — beffjezos · 2026-11-05
- Texas datacenter moratorium sparks backlash over trillions in lost investment — beffjezos · 2026-11-05