Seeking Persistent Chat Solutions for Local LLMs
whatyathinkk · reddit · 2026-07-16
The author is looking for a persistent chat and project management solution tailored for local models, wanting features typical of big-tech products like a sidebar, multi-session, and project organization that runs directly on llama.cpp.
Currently using llama.cpp, oh-my-pi, and Hermes, they find these tools lacking in persistent experiences. They recently discovered jan.ai as a promising open-source alternative that layers well on llama.cpp, but note it sacrifices the agentic capabilities of omp/hermes. They are asking if there's a way to integrate both or if similar alternatives to jan.ai exist.
More from coding & agent
- Travel MCP Server adds flight, hotel, weather and budget tools for agents — modelcontextprotocol · 2026-07-21
- OpenAI hackathon project stalls as Codex struggles on voice, while Claude spots the issue — ColleenMBrady · 2026-07-21
- Douyin Video Analysis MCP turns share links into structured video summaries — modelcontextprotocol · 2026-07-21
- An indie builder open-sourced 50+ AI apps and says users should only pay for tokens — matchaman11 · 2026-07-21
- Shared agent workspaces fail in a fixed order, from stale reads to zombie writes — mrvladp · 2026-07-21
- pi 0.81.0 adds first-class integration with llama.cpp server — huggingface · 2026-07-21