robots.txt is possibly the most miss understood file that a website can contain.
Many people think that by using a robots.txt file on their website they are protecting pages and folders from thieves and hackers. In fact it is totally the opposite! robots.txt opens up an enormous security hole that hackers and theives will use to easily gain access to the parts of your website that you don’t want them to.
What is robots.txt?
robots.txt is a file that you create and upload to your websites root directory that is used by search engine spiders to determine which parts of your website they should index and which folders/pages that you, the website owner,
don’t want listed in search engine indexes.
Why would not want pages indexed?
There are many reasons why you might not want search engines to index pages on your website, such as private membership pages or exclusive training pages and such like.
If you are an Internet Marketer selling your own ebook or other digital product, you wouldn’t want your thank you pages indexed either!
And this is where the misunderstanding comes to the fore, and robots.txt becomes...
To view and download this full PLR article, you must be logged in. Registration is completely free. Once you create your account, you will be able to browse, search & downlod from our PLR articles database of over "1,57,897+" on 1,000's of niches and 200+ categories without paying a penny. Click here to signup...
