Running a 2M-param embedding model on an ESP32 with no_std Rust at 830 embeddings/s

qdrant_engine · x · 2026-11-17

Qdrant engineer Clelia ported Minish Lab's potion-base-2M embedding model to an ESP32 microcontroller with only 16MB of memory.

Original post →

More from Infra

Infra channel →