hostely open-sourced: C++20 Apple-native CLI with honest unified-memory reporting
ayo_ham · x · 2026-09-06
The hostely repo is now public: written in C++20, MIT-licensed, built with CMake, with a quickstart and smoke tests in the README. The author especially wants feedback from M1/M2 users with less RAM.
The GitHub page showcases the core selling point — honest unified-memory reporting: hostely status shows total memory (32GB on the demo M4), current usage, and computes "model headroom" (e.g. 11.7GB = free + inactive − 2GiB safety margin) plus a Metal recommended max (21.3GB), refusing to load models that won't fit. The tool bundles Apple's container runtime for OCI containers and a Metal-accelerated llama.cpp server for GGUF models, plus HTTPS, DNS and tunnels — no Docker, no ngrok. A 1.1B TinyLlama Q4KM peaks at just 980MB in the example.
Related event: hostely: Open-Source CLI Brings Containers and Local LLMs to Mac mini(3 posts)→
More from coding & agent
- Spec-to-APK entirely on an Android phone via Termux CLI and AI — Digital_Otorongo · 2026-09-06
- Astra review: executes hour-long agentic tasks while iterating on the plan without losing the thread — ivan_bezdomny · 2026-09-06
- Stop picking coding models on vibes: run your own A/B/C refactor tests — robleclerc · 2026-09-06
- Orca, the 62k-star ADE for running parallel coding agents, recommended for Mac Mini dev setups — kieranklaassen · 2026-09-06
- Dev Abandons LLM Agent Harness After 883 Commits and 8 Months, Open-Sources the Wreckage — dancingwithlies · 2026-09-06
- Dev one-shots a UEVR fork with GPT 6 Astra for true stereoscopic VR windows — pvncher · 2026-09-06