PhD student seeks cheap API routing to run 20 video benchmarks, $2,000 per model
Alternative_Art2984 · reddit · 2026-11-20
A PhD student wants to benchmark video understanding (LVBench etc.) across LLM APIs but faces $2,000 cost for Astra alone due to large video sizes, and asks whether aggregator services like FreeLLMAPI or OmniRoute could cut costs across 20+ benchmarks.
More from Models
- Insider claims OpenAI is pushing hard for cost efficiency, citing GPT-6.2 — VraserX · 2026-11-20
- Users slam OpenAI: zero usage resets on new model release, worse quality — XFactorMan50 · 2026-11-20
- Nathan Lambert tries Gemini Neon in Antigravity: feels in distribution of Claude Code and Codex — natolambert · 2026-11-20
- Ulms ERT training makes vision nets far easier for LLMs to edit in weight space — Timo Ropinski · 2026-11-20
- Polymarket odds say Gemini will top Artificial Analysis leaderboard by end of November — LeviTurk · 2026-11-20
- Vercel: decision models hit 26% of gateway requests; Anthropic wins new teams 2:1 — airesearch12 · 2026-11-20