Scry offers programmable internet search with congestion-based pricing on a 500 TB ClickHouse index
A new service called Scry provides a 500 TB NVMe internet index in ClickHouse, allowing users to run arbitrary read-only SQL and Datalog queries, with congestion-based micro-auction pricing to manage resource contention.
Briefing
- Hacker News: A new service called Scry provides a 500 TB NVMe internet index in ClickHouse, allowing users to run arbitrary read-only SQL and Datalog queries, with congestion-based micro-auction pricing to manage resource contention.
Why it matters
Scry introduces a novel economic model for web data access, using congestion pricing to allocate query resources dynamically, which could make large-scale internet indexing more sustainable and accessible. For practitioners in extraction and parsing, this offers a programmable alternative to traditional search APIs, potentially reducing the need for custom scraping pipelines. The use of ClickHouse and Datalog also signals a shift toward more analytical and flexible query interfaces for web data.
Sources
- Reported · Hacker News · 2026-09-17 — Show HN: Scry, programmable internet search w/ congestion pricing
Watch next
Will Scry's congestion pricing model prove viable at scale, and how will it compare to existing web data APIs in terms of cost and query flexibility?