Karpathy Boosts Open Hacker News Dataset: 10M+ Posts Usable as a Personal Knowledge Base
huangyun_122 · x · 2026-11-04
Karpathy recently popularized the open Hugging Face dataset open-index/hacker-news, and the author downloaded it as a personal knowledge base, querying it via GrokBot.
Key facts:
- Contains HN posts and comments since 2006, 10M–100M rows, with full fields (title, text, score, comment trees), ODC-BY license, Parquet format;
- Demonstrated uses range from salary negotiation and career advice to personal finance, AI customer service business prospects, and scam prevention;
- The author warns it could be taken down anytime and recommends grabbing it soon.
A ready-made resource for turning community history into a Q&A knowledge base.
More from Fun
- Founder gave his AI his inbox to raise $10M; first tweet hit 100K views — LinusEkenstam · 2026-11-04
- Reddit user claims Codex gets 'dumbed down' right before each OpenAI release — blackcid6 · 2026-11-04
- Waymo's expanded LA service area reaches SpaceX HQ for the first time, $67.15 ride — reed · 2026-11-04
- Agent silently completed only a quarter of a 200-module build and stalled waiting for confirmation — Promptmethus · 2026-11-04
- Von Neumann meme: "You don't have to be responsible for the world that you're in" — akbirthko · 2026-11-04
- Rival company blames 'AI gone off the rails' after founder catches it hacking his network — AccBalanced · 2026-11-04