ODS turns any PC into a local AI server: inference, RAG, voice, agents
Osmantic · github · 2026-08-30
Osmantic/ODS turns a PC, Mac, or Linux box into a local AI server, bundling LLM inference, chat UI, voice (STT/TTS), agents, workflow automation, RAG, and image generation. It integrates ComfyUI, Open WebUI, n8n, and llama.cpp, supports NVIDIA/AMD hardware (including Strix Halo) and Docker, with 4,832 stars so far.
More from Infra
- Elon Musk to Build Gas Turbine Components for Data Centers — teortaxesTex · 2026-08-30
- CNN: How data centers transformed a small town's economy — krishnan · 2026-08-30
- Data center boom drives massive demand for blue-collar jobs and freight — surmenok · 2026-08-30
- workweave/router: open-source model router cuts agentic costs 40-70% in <50ms — workweave · 2026-08-30
- Local LTX 2.5 Generation: 12 Minutes for 20 Seconds of Video? — huynguyend · 2026-08-30
- Tenstorrent benchmarks for Qwen3.7-27B reveal performance on dual p300c setup — DustNearby2848 · 2026-08-30