Stop Google and Co indexing folder on a site

Submitted by paddyman on Mon, 2008-05-19 12:33 in Price Tapestry

Hi David,

Just wondering if its possible to stop google indexing a sub folder (with full PT installation) on a site. Is this done using the htaccess file?

Thanks

Adrian

Hi Adrian, The best thing to

Submitted by support on Mon, 2008-05-19 13:06

Hi Adrian,

The best thing to do is to exclude the entire directory in your top level robots.txt using:

User-Agent: *

Disallow: /notme/

Also remember not to submit your sitemap for that installation as I'm not sure whether or not having a sitemap overrides robots.txt (although i'm pretty confident that it doesn't)...

Cheers,
David.

Thanks David

Submitted by paddyman on Mon, 2008-05-19 17:15

Thanks David

David, One more thing on

Submitted by paddyman on Mon, 2008-05-19 18:18

David,

One more thing on this.

If I wanted to disallow the categories, brands, admin.... folders/files in each directory (with its own PT installation) as you have done in your robots.txt would it look like this

Disallow: /categories.php
Disallow: /brands.php
Disallow: /admin/

Disallow: /directory1/categories.php
Disallow: /directory1/brands.php
Disallow: /directory1/admin/

Disallow: /directory2/categories.php
Disallow: /directory2/brands.php
Disallow: /directory2/admin/

Thanks

Adrian

Hi Adrian, Yes - that looks

Submitted by support on Mon, 2008-05-19 18:34

Hi Adrian,

Yes - that looks good...

Cheers,
David.