Faceted navigation and crawl budget, in plain English

Key takeaways

• ✓ Filter combinations can multiply into tens of thousands of near-identical URLs.
• ✓ Crawler time spent on filter noise is time not spent on your real pages.
• ✓ Decide which facets deserve indexing, canonical the rest, block the parameters.
• ✓ Every indexable facet is a page someone has to keep good.

Here is the short version. A filter menu generates far more addresses than you meant to publish, and a crawler works through them.

What is AI visibility, and how is it different from SEO?

AI visibility, also called answer engine optimization or AEO, is the practice of getting a business named inside AI-generated answers. SEO earns a ranked link a buyer clicks. AEO earns a mention inside the answer itself, in Google AI Overviews, Google AI Mode, ChatGPT, Perplexity or Gemini, where no click may ever happen.

The two run on overlapping machinery. Google states that its generative features are rooted in its core Search ranking and quality systems, so a page has to be indexed and eligible before it can be quoted. Classic SEO is the floor.

Above that floor the work changes. An assistant picks which retailers to name from how clearly your company is defined as an entity, how consistently the web describes it, and whether a page answers in a passage it can lift.

Nobody can force a recommendation. We build the entity footprint, citable pages and review base assistants draw on, then score twelve frozen buying questions across three platforms each quarter, screenshots archived and dated.

How does a filter menu turn into hundreds of thousands of URLs?

Every filter combination can produce a distinct URL. Colour, size, price band, brand, sort order.

What we read from that, and this part is our judgement rather than anything the sources state: on a big catalogue the filter menu is usually the largest draw on crawler attention. No row above says that.

There is no outside statistic in that table. We could not trace the ones in circulation to a primary source with a stated publisher, year and sample, so they are absent instead of estimated.

Sources: no outside publisher is cited anywhere in this article. Every row above is a Mindflow observation. Checked 2026-08-04.

Why does this matter more than it used to?

For a catalogue that changes often, that lag is the whole problem. What a search engine shows is what its crawler last reached.

It reaches the assistants too. Google, Google AI Overviews, Google AI Mode, ChatGPT, Perplexity and Gemini each need a page they can fetch first.

What are the usual fixes, and in what order?

Decide which facets deserve indexable pages. A small number usually do, where people search that way. The rest should not exist as crawlable URLs.

Canonical the rest to the clean category URL.

Block the parameters you never want crawled. Sort order and pagination-only parameters are the obvious candidates.

Keep internal links pointing at clean URLs so you are not advertising the noise yourself.

What should you check on your own site?

Search your domain in Google and compare the indexed count to the number of pages you meant to publish. A count several times larger is the tell.

Then look at what is indexed. If filter combinations appear, they are competing with the pages you wanted.

I would write both numbers down before anyone touches robots.txt.

Get my free Visibility CheckBook a call with Youssef

What is the trade nobody mentions?

Every facet you make indexable is a page you have to keep good. Making thirty filter combinations crawlable creates thirty thin pages unless someone writes for them.

The default answer for most catalogues is fewer indexable facets than the platform offers by default.

“The default answer for most catalogues is fewer indexable facets than the platform offers.”

What does Mindflow Marketing actually do about it?

Five pillars run inside one engagement: local SEO and Google Maps, organic search, AI visibility, reputation and brand SERP, conversion tracking. Each is reported with the denominator beside the number, so a figure can be checked instead of believed.

How the first 90 days work

Every engagement opens with a diagnostic. The first 90 days set a baseline you can hold us to, and put the first measured movement on the record.

1. Free Visibility Check. Twelve real buying questions for your category, asked across Google Maps, Google and the assistants. You get the screenshots, no call required.
2. Local Visibility Audit. Crawlability and indexation, faceted URL sprawl, entity and schema state, review base, competitive gap. Delivered written, working shown.
3. Baseline measurement. Share of Answer scored before any work begins, so the starting number is in writing and cannot be revised later.
4. Foundations, weeks 1 to 6. Technical fixes, canonical and parameter rules, entity and organisation schema, and the category pages buyers search for.
5. Authority and content, weeks 4 to 12. Citable pages, review systems, and the off-site corroboration assistants use to judge whether a shop is real.
6. First remeasurement. The same twelve questions, same conditions, scored against the baseline. Movement or no movement, both go in the report.

What has Mindflow Marketing actually published?

Two clients have given written permission to publish their numbers. Precision Fenceworks is a fence company working four Georgia markets, verified live 2026-06-16. Fireside Antiques is an eCommerce antiques dealer in Baton Rouge, Louisiana, with Search Console and Ahrefs data pulled 2026-06-10.

Fireside Antiques is the eCommerce record, so it is the one this article sits beside. Precision Fenceworks is a fence company and not an online retailer. One catalogue is not a pattern.

Neither record measures crawl budget, and I am not going to offer a recovered ranking as evidence about robots.txt. What transfers is the method: the audit, the frozen questions, the stated denominators, the work ledger.

What we cannot show either: revenue, lead volume and job values. Neither client’s permission covers it. So we cannot tell you whether this visibility became money, and we would rather say that than let a chart imply it.

Two clients is not a large portfolio and we are not going to present it as one.

Read the full fencing recordRead the eCommerce record

What does this cost, and where do you start?

A Visibility Check is free. A Local Visibility Audit is $3,500 to $7,500 and credits against your first invoice if you start a monthly partnership within 30 calendar days of delivery. The monthly partnership starts at $3,500 a month on a 90-day initial term, then runs month to month. No setup fee and no annual contract.

The credit caps at that first invoice and does not carry forward. At the bottom of the range a $3,500 audit against a $3,500 first month costs you nothing if you continue. At the top, a $7,500 audit against a $3,500 first month credits $3,500 and the remainder is spent.

We would rather you ran that sum at your own desk than found it on an invoice.

The full ladder, with what sits inside each tier, is on the pricing page.

One company per metro in each service category. If an online retailer in your category signs first in your metro, we turn down every other retailer in that category there for the life of that engagement, including better-funded ones.

Start with the free checkSee the published pricing

Who is this written for, and where does Mindflow Marketing work?

Established catalogues: a few thousand SKUs and up, a platform-generated filter menu, and somebody who suspects the indexed count is wrong.

We work from Atlanta and serve clients across Georgia, Florida, Texas, Tennessee, North Carolina and South Carolina, in home services, healthcare, legal, eCommerce and B2B SaaS. A catalogue can sit anywhere; the work is served from there.

More reading: eCommerce, product pages in AI answers, semantic product architecture, and the wider industries and markets pages.

Questions owners ask

Should I let Google index filtered pages?

A small number, where buyers search that way and the page can be made worth reading. The rest should be canonicalised or blocked. Pick the facets your customers actually type, give each one a reason to exist, and treat the remainder as plumbing.

How do I know if faceted navigation is a problem?

Compare your indexed page count to the number of pages you intended to publish. Several times larger means filter URLs are being crawled. Then read a sample of what is indexed and see whether filter combinations show up. We check both on every audit.

Does this affect AI visibility too?

Yes. A crawler spending its time on filter permutations reaches your real pages more slowly, and slow retrieval affects every surface. Assistants read what has been fetched, so a page nothing reached cannot be quoted in Google AI Overviews, Google AI Mode, ChatGPT, Perplexity or Gemini.

Who does this work at Mindflow Marketing?

Youssef Hodaigui runs it. Mindflow Marketing is founder-led, twenty-five years in search, and he runs every engagement personally across local SEO and Google Maps, organic search, AI visibility, reputation and conversion. The work is served from Atlanta, the only office we hold, and Share of Answer is scored quarterly.

Will you work with my competitor?

No. One company per metro in each service category. If an online retailer in your category signs first in your metro, we turn down every other retailer in that category for the life of that engagement, including better-funded ones. It caps how large this agency can grow, and that is a trade we accept deliberately.