Google: Noindexed Pages Do Not Effect Crawl Spending Plan

Posted by

Google’s Browse Relations team confirms that noindexed pages don’t adversely affect a website’s crawl budget plan, no matter the number of a site has.

This topic is addressed not once but thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Browse Supporters John Mueller and Gary Illyes take turns responding to three similar concerns from people worried they have too many noindexed pages on their sites.

From Mueller’s and Illyes’ reactions, we discover there’s no such thing as “too many” indexed pages. Further, unless your site has more than a million pages, there’s no need to fret about crawl budget plan.

Here’s a quick recap of each question and answer.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “excessive” number of indexed pages is a concern for discovery or indexed.

Illyes says noindex is a tool to help sites keep content out of search engines. Google encourages utilizing the noindex tag when required, and for that reason, there are no adverse results connected with it.

“Noindex is an extremely powerful tool that search engines support to assist you, this site owner, keep content out of their indexes. For this factor, it does not carry any unintended effects when it concerns crawling and indexing. For instance, having many pages with noindex will not affect how Google crawls and indexes your site.”

Concern 2: Ratio Of Indexed/Noindexed Pages

The following question turns up at the 10:22 mark:

“Should we keep an eye on the ratio in between indexed and non-indexed pages in Search Console in order to much better recognize potentially wasted crawl budget on non-indexed pages?”

Mueller unmasks that websites need to attempt to stabilize their indexed and nonindexed pages.

To that end, crawl spending plan is an element that couple of sites require to think about; Mueller states:

“No, there is no magic ratio to keep an eye out for. Also, for a website that’s not massive, with less than a million pages, possibly, you really don’t require to worry about the crawl budget of your site. It’s great to remove unneeded internal links, but for little to medium-sized websites, that’s more of a site health subject than an SEO one.”

Question 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern turns up about no indexed pages that’s slightly different from the previous 2.

The question reads:

“A great deal of SEOs are complaining about having countless URLs flagged as left out by noindex in Google Browse Console. All to rubbish internal search pages connected from spammy sites. Is this a problem for crawl budget plan?”

Ilyes repeats the earlier point about noindex being a tool for websites to utilize as needed.

Presuming the pages are purposefully noindexed, there’s no requirement to fret about Browse Console flagging them. It doesn’t indicate you’re doing anything wrong.

Illyes states:

“Noindex is there to assist you keep things out of the index, and it doesn’t come with unintended negative results, as we said previously. If you want to ensure that those pages or their URLs, more particularly, don’t end up in Google’s index, continue using noindex and don’t stress over crawl budget plan.”

Source: Google