Diagnose crawling with Google Webmaster Tools

by webmarketingtoday

What is an robots.txt file? How to use robots.txt? How to block a part of my website from crawling? Diagnose your website problems using Google webmaster tools.