Training-free 20B model Viveki generates real-time video heatmaps under 150ms

not-ekalabya · reddit · 2026-10-22

A Reddit user released the inference method for Viveki, a 20B multimodal decision model (HF: not-ekalabya/viveki-0.1-20B), which generates heatmaps for arbitrary objects or events with <150ms latency on a single A100-80GB, enabling real-time video processing.

The author claims Viveki was built without any training or fine-tuning, based on a mechanistic insight that predicts the model's answers to objective questions in its context before any tokens are generated. Details are intentionally withheld pending a paper. The demo image shows real-time factory CCTV monitoring, answering "is a forklift carrying a tall stack of crates" with 86.9% confidence plus visualized heatmaps.

Original post →

More from Multimodal

Multimodal channel →