Crawl budget is not wasted on no-index content

Googlebot allocates a fixed crawl budget per site, and every request to a noindex admin or debug route is a request it did not spend on a page you actually want ranked. Noindex URLs in the sitemap send contradictory signals — submit this URL, but do not index it — which Google's Search Console flags as a coverage error and which slows indexation of legitimate new content.

Filter noindex pages out of the sitemap generator and remove links to consistently-noindex routes from the public navigation and footer. Scope admin/dashboard links to authenticated sessions so they never appear in public HTML. Verify the result by requesting the sitemap and confirming zero noindex URLs are listed.

// app/sitemap.ts
const pages = allPages.filter(p => !p.noindex)
return pages.map(p => ({ url: p.url, lastModified: p.updatedAt }))