What Is the Meta Robots Tag?
With the meta robots tag, you control precisely which pages Google is allowed to index and which it is not. An incorrectly set noindex can remove your most important pages from the Google index — a common mistake after website relaunches. Together with robots.txt and the canonical tag, the meta robots tag forms the foundation of your indexing management.
The meta robots tag is an HTML meta element that gives search engine crawlers instructions on how to handle a page. The most important directives are “noindex” (do not index this page), “nofollow” (do not follow links on this page), “noarchive” (do not save a cached version), and “nosnippet” (do not show a text snippet). This tag gives website owners precise control over indexing management.
Technically, the meta robots tag is placed in the <head> section and is an alternative to the X-Robots HTTP header. Google prioritizes the meta tag when both are present. Common uses include blocking pages with thin content (noindex), preventing search engines from following links on pages (nofollow), or hiding pages from Google’s cache. The tag can also combine multiple directives (e.g., noindex, nofollow), where the combination automatically also prevents links from being followed.
In practice, a clear strategy is important: category pages with filters should generally be tagged with noindex to avoid duplicate content. Internal search pages, admin areas, and privacy policy pages also belong on noindex. For public content you don’t want to link to (e.g., partner links), nofollow is appropriate. Don’t forget to configure these tags in your CMS as well when pages are duplicated — a single error can easily affect several hundred pages.
Über den Autor
Christian SynoradzkiSEO-Freelancer
Mehr als 20 Jahre Erfahrung im digitalen Marketing. Fairer Stundensatz, keine Vertragsbindung, direkter Ansprechpartner.