Dev pays $249/month to host arXiv dataset mirror, opens donations to cover costs
secemp9 · x · 2026-09-20
Developer secemp revealed the real costs of mirroring the arXiv dataset: $249/month on Hugging Face hosting plus $626 in AWS egress fees. arXiv's official S3 buckets turned out to be incomplete, so he had to fill gaps using GCS and web scraping. He has opened a donation page accepting Stripe payments and crypto across multiple chains to cover the costs.
Related event: Complete arXiv Mirror Lands on Hugging Face: 3.14M Papers, 16TB(9 posts)→
More from Venture
- Mistral's valuation soared from $2.2B to $24B in under three years, and one observer now calls it underpriced — smlpth · 2026-11-04
- Gary Marcus: AI data center demand has already passed its peak as projects get killed — GaryMarcus · 2026-11-04
- AI stocks slide as Texas governor result raises data center risks — 1659447091 · 2026-11-04
- Gary Marcus: 'fleecing the public with AI fantasies just got harder' as AI stocks drop — GaryMarcus · 2026-11-04
- Dev's AI agents auto-submit his product to directories, 4 confirmed in 16hrs — pramodk73 · 2026-11-04
- Reddit case study: agent discovery optimization brought $14k MRR in a month — tomarv99 · 2026-11-04