Faceted navigation and crawl budget, in plain English

How the explosion happens

Every filter combination can produce a distinct URL. Colour, size, price band, brand, sort order. Five filters with a few options each multiply into tens of thousands of addresses, most of them showing nearly the same products.

Crawlers follow them. Time spent on filter permutations is time not spent on your category and product pages.

Why it matters more than it used to

A crawler working through filter noise finds your real pages more slowly, and updates take longer to register. For a catalogue that changes often, that lag is the whole problem.

It also dilutes signals across near-duplicates rather than consolidating them onto the page you want ranked.

The usual fixes, in order

Decide which facets deserve indexable pages. A small number usually do, where people search that way. The rest should not exist as crawlable URLs.

Canonical the rest to the clean category URL.

Block the parameters you never want crawled. Sort order and pagination-only parameters are the obvious candidates.

Keep internal links pointing at clean URLs so you are not advertising the noise yourself.

What to check on your own site

Search your domain in Google and compare the indexed count to the number of pages you meant to publish. A count several times larger is the tell.

Then look at what is indexed. If filter combinations appear, they are competing with the pages you wanted.

The trade nobody mentions

Every facet you make indexable is a page you have to keep good. Making thirty filter combinations crawlable creates thirty thin pages unless someone writes for them.

The default answer for most catalogues is fewer indexable facets than the platform offers by default.

“The default answer for most catalogues is fewer indexable facets than the platform offers.”