Robots Meta Tag Generator: Control Indexing Per Page

The robots meta tag is a single line in a page's head that tells search engines how to treat that specific page: whether to index it, whether to follow its links, and finer controls like whether to show a cached copy or a text snippet. This robots meta tag generator lets you tick the directives you need and copies the exact tag, so you control indexing page by page without memorising the syntax.

What the robots meta tag controls

The two directives you will reach for most are noindex and nofollow. Noindex keeps a page out of search results while still letting crawlers read it. Nofollow tells crawlers not to pass signals through the links on that page. Beyond those, noarchive stops a cached copy being offered, nosnippet suppresses the text snippet, noimageindex keeps the page's images out of image search, and max-snippet and max-image-preview set limits on how much of your content can appear in the result. The default, if you add no tag at all, is index and follow, so you only need this tag when you want to change that.

Common reasons to use it

Noindex is the right tool for thank-you pages, internal search result pages, thin tag archives, staging URLs and any page you do not want appearing in Google while still wanting it crawlable. A key rule catches people out: to noindex a page, you must let Google crawl it, which means you must not also block it in robots.txt. If a page is blocked in robots.txt, Google never sees the noindex tag, so the page can still show in results as a bare URL. Use the robots meta tag for keeping pages out of the index, and robots.txt for managing crawl budget, not the other way round.

Apply it carefully

A misplaced noindex is one of the most damaging SEO mistakes there is, because it can quietly remove important pages from search. Before you roll a noindex out through a template, double-check it will not hit pages you want to rank. This tool also lets you target the directive at all crawlers with the robots name, or at Google specifically with the googlebot name, which is useful when you want different behaviour for different engines. Auditing indexing directives across a whole site, and catching the accidental noindex before it costs traffic, is exactly the kind of check that runs through technical SEO.