Evoke open-sourced: 30M-param model in Postgres matches 0.6B embedding model on recall
bdsqlsz · x · 2026-10-09
Evoke is open-sourced today: a 30M-parameter model that runs on CPUs inside Postgres. It matches a 0.6B dense embedding model on top-100 recall to within 0.004 and finds more results in the top 1,000, demonstrating an ultra-lightweight approach to semantic retrieval.
More from Infra
- Nunchux inference engine joins AMD's AI Inference Engines & Services ecosystem — junyanz89 · 2026-10-09
- tinygrad runs its GitHub Actions CI on 4 new tinybox machines — AIFlow_ML · 2026-10-09
- OpenAI's 10,000-agent, 130B-token run pushed slime v0.4.0 to rethink RL infrastructure scale — teortaxesTex · 2026-10-09
- TokenRouter Serving System Boosts Token-Level LLM Routing Throughput up to 64x — nics-efc · 2026-10-09
- SparseDecoding: Decoding-Aware Pruning Yields up to 1.48x Faster LLM Inference — encodelab · 2026-10-09
- x86_64 Edge runs with GPU acceleration on Arduino VENTUNO Q via FEX — unixterminal · 2026-10-09