chapter-tgz adds chapter boundaries to tar.gz for O(1) skipping and parallel reads
charliermarsh · x · 2026-08-04
chapter-tgz is a Rust library for creating and reading specially crafted .tar.gz files with embedded chapter boundaries.
Its two main benefits are:
- O(1) skipping over predefined sections without decompressing the intervening data
- Parallel extraction, so different parts of the same archive can be read by different threads at the same time
It remains compatible with normal tar.gz readers that ignore the chapter metadata.
More from Infra
- Nuclear Startup Valar Raises $1B Led by Sequoia to Scale Reactors — kleffew94 · 2026-08-04
- AI API revenue still trails hyperscaler capex by a wide margin in 2025 chart — SurpriseDog9000 · 2026-08-04
- U.S. heartland backlash grows as AI data centers reshape local communities — altryne · 2026-08-04
- Semiconductors and data centers are being built far slower than AI demand — robleclerc · 2026-08-04
- Gemma 4 31B can use over 13× more KV-cache memory than DeepSeek V4 Flash — teortaxesTex · 2026-08-04
- MCP server brings structured compile, flash and stateful GDB to embedded boards — Historical_Court795 · 2026-08-04