How to block search bots from accessing your site?

In order to block all bots from accessing your site, you should create a robots.txt file with the following content:

User-agent: *
Disallow: /

To block all bots from accessing a specific folder, you should create a robots.txt file with the following content:

User-agent: *
Disallow: /folder/

Please note that blocking all bots will get your site deindexed from search engines.

Was this answer helpful?

 Print this Article

Also Read

How many email accounts do I need?

That's really up to you; it depends on how many people you think will be using email on your...

Why does my website look different on different browsers?

Having a website look the same on different browsers has been an ongoing issue for the web...

How do I decide what to choose for a domain name?

If you're not quite sure exactly what a domain is, you should watch the previous tutorial. When...

What is Spam?

Spam refers to junk email that's sent out in mass quantities. On average, three-fourths of the...

Can I host more than one site per account?

It depends on whether you want each site to have its own domain name or not. If you don't mind,...