QuixiAI Open-Sources embeddinggemma.c: A Blazing Fast Cross-Platform Embedding Inference Engine
QuixiAI · x · 2026-07-21
QuixiAI has released embeddinggemma.c, a cross-platform embedding inference engine written in pure C, emphasizing extreme speed and the ability to run anywhere.
Key Features:
- Hardware Acceleration: Provides optimized kernels for CPU, Metal, CUDA, ROCm, and SYCL.
- Model Support: Currently supports the embeddinggemma-300M-qat-q40-GGUF model (2k context).
- Flexible Dimensions: Supports Matryoshka embeddings at 768, 512, 256, and 128 dims.
- Usability: Offers a standard HTTP API.
Related event: QuixiAI Open-Sources Cross-Platform C Language Embedding Engine(2 posts)→
More from Infra
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11
- Can a 7900 XTX 24GB run Qwen locally? Reddit seeks ROCm tok/s benchmarks — thenomadexplorerlife · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11
- PyTorch Day Korea 2026 launches first offline conf, CFP closes Sept 13 — PyTorch · 2026-09-11