Otaku: open-source LLM frontend for creative writing with smart context compression

Fickle_Tradition4491 · reddit · 2026-10-17

Otaku is a free, open-source LLM frontend for creative writing and roleplay, positioned as a SillyTavern alternative, with web and terminal UIs. Key ideas: maintain writing quality as stories grow, keep context small via mid-story summarization caps, and polished interfaces. New features include a two-way character card library (auto-extraction from stories), NovelAI-style story mode (write directly in the transcript), images that stay in context, web search, model-question tools, Author's-Note-style injections, mobile-optimized web UI with HTTPS and password protection. Install with uv tool install otaku; auto-detects llama.cpp, KoboldCpp, oMLX, LM Studio; supports OpenRouter cloud providers. A context-design engineering doc is included.

Original post →

More from coding & agent

coding & agent channel →