36M-param open-source MCP server lets LLMs watch videos locally on a laptop CPU

Safe-Escape197 · reddit · 2026-11-21

A Reddit developer released v1.0 of tiny-vision (Apache-2.0), an open-source tool that lets LLMs process video entirely locally via an MCP server with summarizevideo, describevideo, and captionimage tools — tested in Claude Desktop and Claude Code, fully offline with LM Studio.

How it works

Numbers (Apple M5, COCO test): caption quality 89% of florence-2-base (CIDEr 1.196 vs 1.348) while being 6x smaller, 8x faster on GPU and 75x faster on CPU (54ms vs 4s per image). A CLI mode pipes plain text into any LLM. Limitations: no audio, no motion understanding, no OCR/counting.

Original post →

More from coding & agent

coding & agent channel →