Reproducible perf benchmarks made easy with the hf CLI skill and HF Jobs
victormustar · x · 2026-10-28
- Simon Brandeis demonstrates running reproducible performance benchmarks with Hugging Face's hf CLI skill: screenshots show 8 Rust tokenizer benchmark jobs (addtok-matchers, addtok-corpora, addtok-census, etc.) submitted to HF Jobs in rust:1.93.0-bookworm containers, split across cpu-performance/cpu-upgrade configs with Running/Completed/Error states.
- The workflow pairs the hf CLI (login, repo management, uploads, cache) with Jobs scheduling and label-based organization (app=measure, bench=…, name=…) to make perf comparisons traceable and auditable. victormustar amplified it as "so easy."
More from coding & agent
- Matt Pocock mulls banning useState outright in his React apps to steer AI coding agents — mattpocockuk · 2026-10-28
- Microsoft demos building agents in Copilot App, deploying via Foundry into Teams as Autopilot — marlene_zw · 2026-10-28
- Developer: tickets, code, tests and PRs should all be generated by agents — intellectronica · 2026-10-28
- Avalon-M1 trains LLM agent organisations via collective-reward RL, lifting avg score 33.5% to 45.7% — RobertTLange · 2026-10-28
- Creator chains Halo and Runway via MCP connectors in GPT for a music video workflow — aziz4ai · 2026-10-28
- Dev uses Qwen in an opencode harness to root an LG TV and strip out spyware — Switchboy1 · 2026-10-28