How to block search bots from accessing your site?

In order to block all bots from accessing your site, you should create a robots.txt file with the following content:

User-agent: *
Disallow: /

To block all bots from accessing a specific folder, you should create a robots.txt file with the following content:

User-agent: *
Disallow: /folder/

Please note that blocking all bots will get your site deindexed from search engines.

  • 0 Users Found This Useful
Was this answer helpful?

Related Articles

Why shouldn't I go for that unlimited plan? Beware overselling.

If you've been searching for a web hosting provider, you have probably seen some offers that look...

What are email forwarders?

Email forwarders allow you to forward a copy of all mail from one address to another. For...

Can I host more than one site per account?

It depends on whether you want each site to have its own domain name or not. If you don't mind,...

What are PHP, Perl, Python, and Ruby on Rails?

Those are all web programming languages, also known as scripting languages. PHP is the most...

What are domain names? How do they work?

Every server in the world that has access to the Internet has at least one IP address -- to...