Colibri Migrates to Hy3, Runs on 10GB
yang_yuzhe · x · 2026-07-13
This is a project porting Colibri to Hy3, aiming to enable it to run on smaller hardware.
The author notes that the original Colibri requires GLM 5.2 and about 25GB of memory/VRAM. This modified version reduces the requirement to around 10GB or even less. The project recommends prioritizing RAM over VRAM when possible, as larger memory leads to faster speeds.
Related event: Colibri Ported to Hy3: Runs Large Models on Just 10GB VRAM(4 posts)→
More from Infra
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11
- Can a 7900 XTX 24GB run Qwen locally? Reddit seeks ROCm tok/s benchmarks — thenomadexplorerlife · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11