QuixiAI Open-Sources embeddinggemma.c: A Blazing Fast Cross-Platform Embedding Inference Engine
QuixiAI · x · 2026-07-21
QuixiAI has released `embeddinggemma.c`, a cross-platform embedding inference engine written in pure C, emphasizing extreme speed and the ability to run anywhere. **Key Features:** - **Hardware Acceleration**: Provides optimized kernels for CPU, Metal, CUDA, ROCm, and SYCL. - **Model Support**: Currently supports the `embeddinggemma-300M-qat-q4_0-GGUF` model (2k context). - **Flexible Dimensions**: Supports Matryoshka embeddings at 768, 512, 256, and 128 dims. - **Usability**: Offers a standard HTTP API.
Related event: QuixiAI Open-Sources Cross-Platform C Language Embedding Engine(2 posts)→
More from Infra
- Fluidstack raises $830M at $7.5B valuation as Anthropic backs a $50B compute buildout — rohanpaul_ai · 2026-07-21
- Early Krea2 Gradio WebUI targets 6GB low-VRAM local runs — Fluid_Kaleidoscope17 · 2026-07-21
- Z.AI starts running a 1GW AI data center built entirely on domestic chips — Polymarket · 2026-07-21
- Local models feel far more capable once paired with the right harness — Soft-Barracuda8655 · 2026-07-21
- Voice-agent teams should use platforms first, then own STT events when failures get weird — FollowingSuitable941 · 2026-07-21
- Alibaba open-sources T-Head SAIL, the software stack behind its AI chips — 量子位 · 2026-07-21