RustingStrata 1.2.3 ships a built-in local chat page in a single Rust binary
Serious_Scarcity7818 · reddit · 2026-11-15
RustingStrata is a single Rust binary: rustingstrata serve provides an OpenAI-compatible server and a chat page at / on the same port — no Node, no Docker, no extra install.
Features: model loading from the page with options (context, MTP drafts, KV cache format, VRAM margin, prefill chunk), chats kept in browser localStorage with search/import/export, message editing, regenerate/continue, image attachments for vision models, folded thinking toggle, sampler presets, per-reply tok/s, calibration prompts, and accent colors that follow model families.
It's explicitly not a coding agent — point OpenCode/Claude Code at the same server for that. The author is soliciting feedback on what's missing before iterating further.
More from Infra
- Running Qwen3.8-27B on a 12GB RTX 3060 with 65K context: full recipe inside — WiseVanilla2743 · 2026-11-15
- Pruned-vocab Qwen3.8-27B fits 75K context on 16GB at ~60 tok/s, IFEval unchanged — fakezeta · 2026-11-15
- Cisco hits $9B AI revenue, beats and raises, yet shares fall 6% anyway — pdamodaran · 2026-11-15
- AWS investigates connectivity issues affecting multiple services in us-east-1 — kingslyj · 2026-11-15
- Congress reportedly prepping tighter AI chip export controls with bipartisan support — Polymarket · 2026-11-15
- ggml tensor library trends on GitHub with 15.8k stars, up 154 in a day — ggml-org · 2026-11-15