Custom Search
 


Robots Meta HTML Tag Syntax Explained



Using robots meta html tag, you can control at page level how search engine robots should index, follow links, or cache a specific page.

Robots Meta Tags Search Engine Spider Behaviors
<meta name="robots" content="noindex,follow"> Tells search engine spiders not to index this page but spiders are allowed to follow links on this page to go to other pages.
<meta name="robots" content="noindex"> Equivalent to
<meta name="robots" content="noindex,follow">
<meta name="robots" content="index,nofollow"> Search engine spiders are allowed to index this page but not allowed to follow links on this page to go to other pages.
<meta name="robots" content="nofollow"> Equivalent to
<meta name="robots" content="index,nofollow">
<meta name="robots" content="noindex,nofollow"> Search engine spiders should neither index this page nor follow links on this page to go to other pages.
<meta name="robots" content="none"> Equivalent to
<meta name="robots" content="noindex,nofollow">
<meta name="robots" content="all"> Search engine spiders are allowed to index this page as well as follow links on this page to go to other pages.
<meta name="robots" content="index,follow"> Equivalent to
<meta name="robots" content="all">
<meta name="robots" content="follow"> Equivalent to
<meta name="robots" content="index,follow">
<meta name="robots" content="index"> Equivalent to
<meta name="robots" content="index,follow">
Robots tag is not used in the page Equivalent to
<meta name="robots" content="index,follow">
<meta name="robots" content="noarchive"> Google or Yahoo will not archive/cache the page

Where to put the robots meta tag
Put the robots meta tag in between the start and end of <head> tags in your HTML file. For example,

<head><meta name="robots" content="index,nofollow"></head>

For more information, see the robots.txt and robots meta tag governing body.

To see a practical use of robots HTML tag, read my article I Don't Want My Pages To Be Crawled and Cached.

What If...
Robots tag is great for controlling a single page. What if you want to control all files in a directory? The answer is to use Robots.txt And Search Engine Robots.


Copyright© GeeksEngine.com



Related Articles:

1.Absolute Path and Relative Path Explained
2.The Difference Between Dynamic URLs and Static URLs
3.What If You Don't Want Your Pages To Be Crawled and Cached by Search Engines
4.What Robots.txt is And Search Engine Robots Explained
5.The Right Domain Name Drives More Website Traffic


Other Recent Articles from the Webmaster Help category:

1.How to load IP addresses for countries into your MySQL database
2.How to set up your website connection details in FileZilla
3.The Difference Between Dynamic URLs and Static URLs
4.How To Find Out Everything You Want To Know About A Website
5.What If You Don't Want Your Pages To Be Crawled and Cached by Search Engines
6.What Robots.txt is And Search Engine Robots Explained
7.How to Tweak HTML Table To Speed Up Page Load Time

Copyright © 2017 GeeksEngine.com. All Rights Reserved.

This website is hosted by HostGator.

No portion may be reproduced without my written permission. Software and hardware names mentioned on this site are registered trademarks of their respective companies. Should any right be infringed, it is totally unintentional. Drop me an email and I will promptly and gladly rectify it.

 
Home | Feedback | Terms of Use | Privacy Policy