How to block search bots from accessing your site?

In order to block all bots from accessing your site, you should create a robots.txt file with the following content:

User-agent: *
Disallow: /

To block all bots from accessing a specific folder, you should create a robots.txt file with the following content:

User-agent: *
Disallow: /folder/

Please note that blocking all bots will get your site deindexed from search engines.

  • 0 Users Found This Useful
Was this answer helpful?

Related Articles

What do you mean when you say gigabyte, megabyte, GB, and MB?

The smallest unit of measurement on a computer is the bit. There are almost always eight bits in...

Propagation Times

Propagation is the process of updating a domain with new nameserver (DNS) information across all...

Ports Used for cPanel, Email, Web

The following is a list of commonly used ports that that we use: cPanel cPanel: 2082 (SSL...

What are email forwarders?

Email forwarders allow you to forward a copy of all mail from one address to another. For...

What is an Uptime Guarantee?

Server uptime refers to the amount of time in a given period a server stays up and running....