Scry: a 500TB SQL-queryable internet index with congestion-based pricing
Xyra · hn · 2026-09-18
- Show HN project Scry: a 500TB NVMe internet index built on ClickHouse, supporting arbitrary readonly SQL and some Datalog.
- Resource contention is handled via congestion-based micro-auction pricing; non-commercial use is free when capacity is available.
- The author criticizes search APIs (Google, Tavily, Exa) as opaque black boxes with no user control, and argues many information products can be built from giant realtime OLAP databases plus frontier LLMs writing SQL/Datalog/vector queries; plans to scale on differentiated hardware.
More from Infra
- Google engineers: LLM benchmark harnesses silently drop requests — 200 QPS in, 38 out — AI Engineer · 2026-09-20
- The rig built to run Emacs and doomscroll X is now worth more than its owner's car — tetsuoai · 2026-09-19
- Apple M4 sustains 10 instructions per cycle, beating most rivals; M5 speedup explained — lemire · 2026-09-19
- Apple M6 bumps cores to 12 with two super cores; CPUs keep improving fast — lemire · 2026-09-19
- Apple M-series chips gained ~50% Geekbench 6 performance over three years — lemire · 2026-09-19
- Inside OpenAI's inference routing: why the proportional controller had to go — AI Engineer · 2026-09-19