What is a Robots.txt file?
A robot.txt file gives web-crawling robots directions for how to crawl a site. This can be used to prevent the indexing of certain parts of your site.
More About Robots.txt files
Special Offer!
Professional SEO Services
Our Pro Services team will help you rank higher and get found online. Let us take the guesswork out of growing your website traffic with SEO.
