Semantic emoji search with on-device bge-small beats LLM at $0 per search

maxleiter · x · 2026-09-27

Responding to the buzz around Linear adding an LLM ("Jev") to its emoji picker, Max Leiter argues developers are treating LLMs as a hammer for every classification task. Two years ago he built semantic emoji search with no LLM: bge-small-en-v1.5 (37MB) runs on-device in the browser, downloads once, and every search costs $0 — faster, cheaper, and occasionally better than the LLM route. His takeaway: use LLMs only when you actually need reasoning behind the decision; embeddings (plus pgvector for the API variant) suffice for tasks like emoji search. The post includes a live demo comparing on-device, Embeddings API, and Jev costs.

Related event: Developer Shows Embeddings Beat LLMs for Emoji Search at Near-Zero Cost(2 posts)→

Original post →

More from coding & agent

coding & agent channel →