Open-source LokalBot: local autocomplete with Gemma 4 E2B at ~50ms, aware of your meeting notes
stevyhacker · reddit · 2026-10-13
A developer open-sourced LokalBot, a Cotypist/Granola hybrid desktop app that autocompletes typing with local Gemma 4 E2B base (Q6K, in-process llama.cpp) at 50ms per suggestion on M4 Max, and can use your own meeting notes and screen text as context.
- Vs Cotypist (proprietary, 100 free words/day) and Cotabby (AGPL): LokalBot is GPLv3, free, and uniquely meeting-note-aware — pulling up to two facts from private notes when your draft names something distinctive, never reading private windows
- Head-to-head on 782 next-word checkpoints with the same Gemma weights: LokalBot 32.7% vs Cotabby 30.7% exact next word (+2.0 pts, 95% CI 0.0–4.0)
- Author found Gemma 4 E2B 6bit the best quality/latency balance and asks for smaller models that beat it at 50ms
More from Apps
- Pulse brings a WhatsApp-native finance agent for SMBs, chasing payments via Zoho Books and Tally — Scobleizer · 2026-10-13
- Ithaca announces agreement to acquire Bumble, betting relationships grow precious as AI advances — GuptaRK22 · 2026-10-13
- Fintech Ramp launches Glass, an internal AI platform built to compound employee AI work — Scobleizer · 2026-10-13
- Lowvyn MCP Connector Brings Canadian Retail Price Comparison to AI Assistants — modelcontextprotocol · 2026-10-13
- Dev Hooks ChatGPT Realtime Voice Model Into an Apple Watch — halo-w3fsd32 · 2026-10-13
- Lessons in Electric Circuits: 6-volume, 7,389-illustration electronics curriculum gets an AI tutor — burkov · 2026-10-13