Robots Meta HTML Tag Syntax Explained
Using robots meta html tag, you can control at page level how search engine
robots should index, follow links, or cache a specific page.
| Robots Meta Tags |
Search Engine Spider Behaviors |
|
<meta name="robots" content="noindex,follow"> |
Tells search engine spiders not to index this page but spiders are allowed to follow
links on this page to go to other pages.
|
|
<meta name="robots" content="noindex"> |
Equivalent to
<meta name="robots" content="noindex,follow"> |
|
<meta name="robots" content="index,nofollow"> |
Search engine spiders are allowed to index this page but not allowed to
follow links on this page to go to other pages.
|
|
<meta name="robots" content="nofollow"> |
Equivalent to
<meta name="robots" content="index,nofollow"> |
|
<meta name="robots" content="noindex,nofollow"> |
Search engine spiders should neither index this page nor follow links on this
page to go to other pages.
|
|
<meta name="robots" content="none"> |
Equivalent to
<meta name="robots" content="noindex,nofollow"> |
|
<meta name="robots" content="all"> |
Search engine spiders are allowed to index this page as well as follow links on this page to go to other pages.
|
|
<meta name="robots" content="index,follow"> |
Equivalent to
<meta name="robots" content="all"> |
|
<meta name="robots" content="follow"> |
Equivalent to
<meta name="robots" content="index,follow"> |
|
<meta name="robots" content="index"> |
Equivalent to
<meta name="robots" content="index,follow"> |
| Robots tag is not used in the page |
Equivalent to
<meta name="robots" content="index,follow"> |
| <meta name="robots" content="noarchive"> |
Google or Yahoo will not archive/cache the page
|
Where to put the robots meta tag
Put the robots meta tag in between the start and end of <head> tags in your HTML file.
For example,
<head><meta name="robots" content="index,nofollow"></head>
For more information, see the
robots.txt and robots meta tag governing body.
To see a practical use of robots HTML tag, read my article
I Don't Want My Pages To Be Crawled and Cached.
What If...
Robots tag is great for controlling a single page. What if you want to control all files
in a directory? The answer is to use
Robots.txt And Search Engine Robots.
Copyright© GeeksEngine.com
| Related Articles:
Other Recent Articles from the Webmaster Help category:
|
