Crawl budget managed; no infinite scroll or session IDs in URLs

Session IDs in query strings and unbounded faceted URLs multiply your crawlable surface exponentially — Googlebot spends its allotted fetches on duplicate variants of the same listing and never reaches your actual product pages. Infinite scroll without a paginated fallback makes content past the fold effectively invisible to crawlers. The result: shallow index coverage, delayed discovery of new pages, and wasted crawl capacity.

Strip session IDs from URLs entirely and store session state in cookies. Add noindex to active filter combinations and canonical facet pages to their unfiltered base. Configure in app/products/page.tsx:

export async function generateMetadata({ searchParams }) {
  return { robots: { index: Object.keys(searchParams).length === 0 } }
}