Why Can't You See Robots Tags?If you have applied custom robots flags by following the tutorial for Search Preferences, then you would have observed that you don't see any flag appearing when you view the source file of your blog. This is because that these flags can be seen only in the HTTP header fields. Google now accepts robots tags which are directly added to the Headers of the HTML Page. To keep things simple, do this:
- After applying custom robots flags and activating it, visit your blog in Chrome
- In chrome go to this path: Tools > Developer Tools > Networks (In Firefox it is : Tools > Web Developers > Web Console > Net )
- You will see several column fields as shown in the image below:
- At the top-left you will find URL of your blog. If you don't see any data then simply refresh your blog without closing the Developers Tools window, you will find information appearing.
- Click your blog URL and you will see two sections at your right. Request Headers and Response Headers.
- Under the Response Headers you will see an X-Robots-Tag header tag. This tag resembles the flags that you had set for your homepage. In my case I have set the custom robots tags for your homepage as All and noodp therefore it is appearing as X-Robots-Tag: all,noodp
Settings For Custom Robots Tags HeadersTo see header tags in post header you must first activate the custom headers. If you have not yet activated then follow these steps. Go to Settings | Search Preferences, click Edit next to "Custom robots header tags," and select Yes. Activated Successfully!
Now you must learn when should you use them. Using them correctly can help you rank better and using them at wrong scenarios can surely play the opposite.
The only tags which you should focus on are noimageindex, noindex and nofollow. Rest are just not required for a small scale blog. All of these tags are useful when you have a corporate blog or website with thousands of pages or even millions of pages. They help to control how search engines may crawl your content.
When to use noimageindex ?If you are sharing personal or family pictures on any of your posts or page then may be you would prefer not to make those pictures public and keep them limited to readers reach only. In such case you may check this option and robots will be directed not to index the pics or images used inside the post.
When to use noindex?Any page or post that you want to hide from robots and visitors can be tagged as noindex. Visitors wont be able to discover that page via search engines or may be even with the Google Custom Search Engine.
You can even noindex post or pages that you think will effect your search ranking. Google Panda Effects all those blogs which publishes low quality content. If you feel any of your post is just for entertainment purpose and does not relate to your niche then you can simply choose the noindex option from Header Tags.
When to use nofollow?If you are creating a useful directory of 100 or more links that all point to some external websites and you don't want to pass your PageRank juice to them then you can choose the nofollow header tag.
Need Help?There was too much of SEO tutorials this week and I am sure you guys would prefer a slight twist in topics. Therefore I would try to release some new plugins and widgets to make sure you enjoy different flavors of blogging.
Don't hesitate to post your queries. I am surely lazy at replying but I surely reply back. Peace and blessings buddies! :)
Note: If this Tutorial and News worked for you (and it should work), please leave a comment below. Thanks.