v6.0's Interpretability Module Renders Exact ColPali-Style Heatmaps From MaxSim
tomaarsen · x · 2026-08-18
Because MaxSim is a sum of per-query-token maxima, a ranking decomposes exactly — every score point belongs to one query token and one document token. The new interpretability module in Sentence Transformers v6.0 renders that as the standard ColPali heatmap, aggregated or one map per query token. Page images aren't the only non-text modality either: ColQwen-Omni takes text, images, audio & video — retrieving a recorded conversation is the same two calls, zero-shot with no transcription anywhere; a query saying "nausea" matches audio saying "carsickness".
More from coding & agent
- Agents turn conservative as context grows: edits shrink from 150 to 30 lines — dbreunig · 2026-10-16
- ai& becomes an official built-in Cline provider with 13 open-weight models — DavidBennett__ · 2026-10-16
- Open-source rizin-mcp lets LLMs run local binary and malware analysis via Rizin — Pure_Emergency1424 · 2026-10-16
- x402 as a free GTM channel: agents discover 100+ tools, no API keys needed — 0xJeff · 2026-10-16
- Sam Altman: stop getting better at prompts, build loops and graphs that prompt for you — goyalshaliniuk · 2026-10-16
- POV ski game on real Matterhorn elevation data, built with Claude Opus 5.5 — techartist_ · 2026-10-16