Hugging Face Runs an Overnight Agent to Rescue Open-Source Models Buried on arXiv

NielsRogge · x · 2026-08-24

Hugging Face ML engineer Niels Rogge built an overnight agent (on HF Jobs) that scans new arXiv papers, finds open-source models/datasets buried in GitHub repos or Drive links, and helps authors publish them to the Hub — a task he previously did by hand until it outgrew him.

Using Langfuse traces grouped by arXiv ID, he could inspect every prompt, output, and extraction step in one place. The visibility exposed an unreliable classifier and missing GitHub README context; after two rounds of error analysis and fixes, the agent drew only two negative comments across thousands of issues and PRs.

Original post →

More from coding & agent

coding & agent channel →