Athanor Lite: Open Source App to Run Local Models Easily
BBASecure · reddit · 2026-07-06
An indie developer released Athanor Lite, a free, open-source desktop app designed to make running local models simple. Features include scanning hardware to identify runnable models, a model directory filterable by size/quantization, local model management (with existing Ollama installation detection), inference with a real-time HUD (showing tok/s, GPU usage, VRAM, and temperature), and multiple workspaces to isolate different models/contexts, alongside engine start/stop controls. Built on Tauri 2 (Rust backend + React frontend) and wrapping llama.cpp, it is completely cloud-free, telemetry-free, and requires no account. Currently at v0.1.1 and signed for Windows, future updates will add Mac support, a model comparison view, and fine-tuning capabilities.
More from Infra
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27
- Selling a 5090 to scale local inference: one business weighs 5 hardware paths — Anarchaotic · 2026-10-27
- AWS tutorial: fleet-wide edge CV model lifecycle with SageMaker SDK v3, ~$0.07 per run — AWS ML Blog · 2026-10-27
- Qwen3.8-27B hits 40 tok/s on Jetson Thor with INT4 + MTP, accuracy beats FP16 — No-Dragonfly6246 · 2026-10-27
- Celesto launches CI runners nearly 90% cheaper than GitHub Actions, with agent sandboxes — aniketmaurya · 2026-10-27
- Supabase founders on rebuilding the backend for a billion AI-built apps — Latent Space · 2026-10-27