HF's merve shares eval tip: 9B bf16 needs 17.9GB VRAM, use Gemma on screenshots
mervenoyann · x · 2026-09-07
Hugging Face's mervenoyann answered a question about eval compute requirements: it depends on Qwen3.5's size — a 9B model in bf16 needs 17.9GB VRAM.
Her shared trick: instead of evaluating glb files directly, pass screenshots of the renders as images to a similar or smaller model (like Gemma) to judge generation quality, lowering the compute barrier.
Related event: Hugging Face staff share low-compute tips for model evaluation(2 posts)→
More from Models
- ChatGPT monthly active users top 1.06 billion in August, fourth straight record month — FinanceYF5 · 2026-09-11
- PuzzleMask: Plain-Prose Attack Bypasses All 4 Tested LLM Gatekeepers at 100% — TechNadu · 2026-09-11
- OpenAI Codex may issue another usage reset this weekend, says Codex lead resets happen — umesh_ai · 2026-09-11
- OpenAI Reportedly Pointing Its Navier–Stokes Model at Riemann and P vs NP — 141_1337 · 2026-09-11
- Benchmark author says OpenRouter unreliably honors Meta Muse effort levels, EU payments broken — PawelHuryn · 2026-09-11
- User burns $200 of Codex credits in one agent turn — 4,700 of 5,000 credits, task unfinished — RileyRalmuto · 2026-09-11