Post: #1

Is there any way to block the GoogleBot? Right now, I see listed among members viewing the forums, "Mediapartners-Google, GoogleBot", and it creeps me out. Some of the stuff I've posted or will post in the future may or may not be for public consumption, other than my phero friends.

Post: #2

Blocking Google would end up with us dropping off the Google search results pages, which is where most of our traffic comes from.

The search engines can only see what unregistered guests can see though, so anything that you don't want showing up on Google can be written in your Journal and it'll be safe from search engines and the general public.

Post: #3

Ah, okay. Good to know. Thanks, Mark!

Post: #4

I dont believe google bot can get into the journal section although I am not sure of this. Maybe Mark can elaborate on this.

Either way they can not see your personal info and they are just scanning for keywords to up the rating on goggle.

Tisha

Post: #5

You can block robots with a textfile called robots.txt and put it in the root directory on the server.

Here's an example robots.txt:



# robots.txt
# URL: http://pherotruth.com

#allow to spider the domain
User-agent: *
Disallow:

# don't spider /logs and /stats
User-agent: *
Disallow: /logs
Disallow: /stats




Maybe this helps a little bit.

cul8er.