How to Check Robots.txt for your website?
Here we give clear description of how to check Robots.txt for your website/blog, Let’s find out, right now! Enter your domain and click the button to check your website robots.txt file. You can check robots.txt like, www.yourwebsite.com/robots.txt.
nice post.Robots.txt Checker is very good for looking what web pages are forbidden for Google crawling, you may find some nice hidden pages that is not visible for crawlers and search engine results.
ReplyDeleterobots txt checker