Collections
Curated crawls
Each with a written scope, a cadence and a curator who will answer questions about it.
| Collection | Scope | Cadence | Captures | Size |
|---|---|---|---|---|
| National government | All .gov domains in four countries | weekly | 1.4 B | 2.9 PB |
| Regional news | 412 local outlets | hourly | 8.9 B | 6.1 PB |
| At-risk sites | Announced shutdowns and expiring domains | on notice | 204 M | 410 TB |
| Scholarly web | Journal landing pages and preprint servers | daily | 2.1 B | 1.8 PB |
| Open source projects | Release pages and documentation | daily | 3.4 B | 2.2 PB |
| Elections | Party, candidate and commission sites | hourly during campaigns | 612 M | 780 TB |
| Municipal records | Planning, licensing and consultation | weekly | 1.1 B | 1.4 PB |
| Cultural institutions | Museums, libraries, archives | monthly | 388 M | 620 TB |