Crawl budget

Crawl budget is the number of pages a search engine will crawl on your site in a given period.

Why it matters

On large sites, wasted crawling on low-value pages can delay the discovery of important ones.