Stratoscope: monitor local LLM token speed and cache hits live in your menu bar
LisaMarieJosefine · reddit · 2026-11-10
Stratoscope is a small MIT-licensed open-source tool for monitoring local LLM inference without opening another window. It sits in the Mac menu bar or Windows taskbar and shows live prefill/decode tok/s, prompt cache hits, context fill, and RAM/GPU/CPU usage.
It currently works with Strata, but each inference engine is just a small adapter, so supporting others should be easy — contributions welcome. Project: GitHub.
More from Infra
- Nvidia investors publicly defend Jensen Huang despite private disappointment over timing — GaryMarcus · 2026-11-10
- Low-precision is the future: training may soon move to 8-bit and 4-bit — udmrzn · 2026-11-10
- OpenRSI scales recursive self-improvement to SGLang-Omni, +7.6%–344% throughput via 14 merged PRs — ChengleiSi · 2026-11-10
- OpenCode cuts memory 41% and OpenClaw starts 3.1x faster with Bun AoT — steipete · 2026-11-10
- Epoch AI to spend more on compute than wages this year, researcher says — Jsevillamol · 2026-11-10
- Melbourne lab i14labs launches Sugar Glider: O(1) inference architectures tested up to ~1T params — kimmonismus · 2026-11-10