Skip to the indexed answers
Digital Marketing Index

usdigitalmarketingindex.com SEO

What are the crawl implications of placing rel=’nofollow’ on internal links?

A nofollow on an internal link asks Google not to follow that link to your own page. It does not keep the page from being crawled, since the page can be reached through other links, the sitemap, or links from other sites. It does not keep the page out of the index. And it withholds from the destination whatever that link would have contributed. Google’s documentation says links marked this way “will generally not be followed”, and adds that “the linked pages may be found through other means, such as sitemaps or links from other sites, and thus they may still be crawled” (Google’s guidance on qualifying outbound links). For links within a site, the same page points to a different tool: “For links within your own site, use the robots.txt disallow rule”.

What nofollow communicates

The attribute was designed for links to other sites. Google’s documentation describes its use: “Use the nofollow value when other values don’t apply, and you’d rather Google not associate your site with, or crawl the linked page from, your site”.

An internal link carrying it:

<a href="/account/login" rel="nofollow">Sign in</a>

What this does and does not do:

Effect Result
Following this link Generally not followed
Crawling the destination Still possible through any other link or the sitemap
Indexing the destination Unaffected; nofollow is not noindex
The link's contribution to the destination Withheld
Visitors No difference

The word generally in Google’s sentence matters. The attribute is described as a statement of how to treat the link, not as an absolute barrier.

Common misuse and legacy assumptions

Internal nofollow gets applied for several reasons, none of which it serves well.

To keep a page out of search. Nofollow on links to a page does not stop the page from being indexed. If the goal is exclusion from results, the tool is noindex on the page itself. Google’s documentation on noindex says that when Googlebot extracts the rule, the page is dropped from results regardless of whether other sites link to it.

To stop crawling of a section. Every link to the section would need the attribute, and one external link or a sitemap entry undoes it. The documented tool for links within your own site is a robots.txt disallow rule.

To concentrate link value on chosen pages. The idea was to put nofollow on links to unimportant pages, such as login or terms, so that more value would flow through the remaining links. This rests on an old assumption about how the attribute redistributes value. Nothing in the documentation cited here describes such a benefit, and the practical effect is that the site stops passing its own signals to its own pages.

By accident. A plugin setting, a template inherited from a comment system, or a rule that adds nofollow to every link in a block, internal ones included.

One more case is worth separating. Links to pages that exist in unlimited variations, such as filter combinations or calendar dates, are sometimes nofollowed to keep crawlers out. Better approaches exist: do not render those links as anchors, or disallow the pattern in robots.txt.

When to remove internal nofollow

Remove it wherever the destination is a page you want found and understood.

Internal link destination Nofollow? Use instead
Products, categories, articles, services No A normal link
Pagination No Normal links
Login, cart, account Not needed noindex on those pages if they should stay out of results; robots.txt if crawling them is wasteful
Internal search results Not the right tool robots.txt disallow, or noindex
Filter and sort variations Not the right tool Controls without href, or robots.txt disallow
Pages with user-generated links to other sites Not applicable to internal links The ugc value on the external links
Printer or alternate versions Not the right tool Canonical tag

For external links the attribute and its relatives still have their purpose. Paid and affiliate links are marked with sponsored, and links in user content with ugc.

Before removing nofollow from links to a low-value section, check what will happen when those links are followed. If the section is an unbounded URL space, put the proper control in place first.

Verification

Find every internal nofollow, decide on each, and confirm the change.

  1. Crawl the site and export all internal links whose rel attribute contains nofollow.
  2. Group them by template location and by destination.
  3. Identify the source: a theme setting, a plugin, a hard-coded attribute, a rule applied to a content block.
  4. Check for page-level nofollow as well. A robots meta tag with nofollow applies to every link on the page, internal links included. Google’s documentation on robots meta tags describes that rule as telling Google not to follow the links on the page.
  5. Apply the decision from the table above.
  6. Recrawl.
Check Pass condition
Internal links with rel nofollow None on links to pages you want indexed
Pages with a robots nofollow meta tag Only where intended
Pages meant to be excluded from results Carry noindex, and are crawlable so the rule can be read
Sections meant not to be crawled Disallowed in robots.txt, and not relied on for de-indexing
Rendered HTML The attribute is absent after scripts run, not only in the source
Formerly nofollowed destinations Return 200 and are appropriate to crawl

After the change, watch Search Console’s crawl stats and page indexing report for the affected sections. Removing nofollow from links to a large set of pages may raise crawling of those pages. That is the expected result where the pages matter, and a reason to have added controls first where they do not.

Summary of which tool does what:

Goal Tool
Keep a page out of search results noindex
Stop crawlers requesting a section of your own site robots.txt disallow
Consolidate duplicate addresses Canonical tag or redirect
Qualify a link to another site nofollow, sponsored, or ugc

How the related attributes should be applied to paid and affiliate links that leave the site is covered in the guide to marking sponsored and affiliate outgoing links in HTML.

The rule: nofollow describes a link to somewhere you do not vouch for. Your own pages are not that.

Link trail

Reader comments on this answer

Add your comment to this answer

Your email address will not be published. Required fields are marked *