TensorSharp open-source engine adds mixed document/image/video/audio inputs per request
fuzhongkai · reddit · 2026-09-27
The author extended the open-source inference framework TensorSharp: its Jev-compatible /v1/systemone endpoint now accepts multiple evidence types in a single decision request — e.g., an incident triage call with a written report, dashboard screenshot, screen recording, and caller audio.
A full Python example is included. Key implementation details: the files array classifies attachments by extension (dedicated documents/videos/audios arrays also exist); video is sampled into frames for the vision tower; audio is transcribed by a separately configured speech service (TSJEVTRANSCRIPTIONURL) rather than processed as waveforms; inline Base64 counts toward the 8 MiB default body limit, so use the upload API for larger media.
More from Infra
- Three myths of hosted LLM inference: sticker prices, interchangeable endpoints, and self-hosting — TangeloOk9486 · 2026-09-27
- Random Attention: Salesforce and UIUC find random KV cache eviction rivals handcrafted signals — jiqizhixin · 2026-09-27
- Laptop engine streams a 35B model from SSD at 9.4 tok/s, beating GPT-OSS 20B — ImBadGuyInEveryStory · 2026-09-27
- World's fastest panel QR factorization on B200: how a GPU MODE contestant cracked chained dependencies — A_K_Nain · 2026-09-27
- Pro-data center rally clashes with protesters as scholar defends AI infrastructure — neil_chilson · 2026-09-27
- Kafka in production: partition skew and rebalancing pauses bite hard — goyalshaliniuk · 2026-09-27