Knights Reborn

Does anyone know how to get rid of spiders and bots from a phpBB Forum?
Getting +10 Bots each week and have been trying to find a way to ... stop them from finding my forum.


-thanks!

well u can make it so that they have to have permission to get on your forums, that would be the first step of it... let me look into it more

http://www.javascriptkit.com/howto/robots.shtml

The robots text we use here is simply:

User-agent: *
Disallow: /

It can be found here:

http://www.knights-reborn.org/robots.txt

Basically what the robots.txt file we have running on our site does is stop every search engine from accessing any part of our site. I made this decision that I didn't want any robots crawling our site because all of our website traffic comes by word of mouth and the server- incase anyone was wondering why.

Hope that helps Aki- if you have any questions don't hesitate to ask,

Pho~

Hmm, i was using

http://www.akikun.com/oldrobots.txt

-but that didn't help much. I'll try that one! Thanks!

Akimoto wrote:Hmm, i was using

http://www.akikun.com/oldrobots.txt

-but that didn't help much. I'll try that one! Thanks!

Well I can't see what you were using before you have seemed to have deleted the file. I also couldn't find a robots.txt file present on your site, make sure that it is named "robots.txt" otherwise search engines will not take any notice of it.

Phoenix wrote:

Akimoto wrote:Hmm, i was using

http://www.akikun.com/oldrobots.txt

-but that didn't help much. I'll try that one! Thanks!

Well I can't see what you were using before you have seemed to have deleted the file. I also couldn't find a robots.txt file present on your site, make sure that it is named "robots.txt" otherwise search engines will not take any notice of it.

http://www.knights-reborn.org/forum/vie ... php?t=2093

Spies & Spiders!!
They still keep comming, atleast 1 each day.
Is there anything i have to do besides putting ''robots.txt'' in the root(s)?

It has to go in the root of your website.

In your case it has to be www.akikun.com/robots.txt

It can't be www.akikun.com/phpBB2/robots.txt.

Phoenix wrote:It has to go in the root of your website.

In your case it has to be www.akikun.com/robots.txt

It can't be www.akikun.com/phpBB2/robots.txt.

If you click the first link you made..

Can't i have it in both? I mean, i almost put that in all folders i got lol

Akimoto wrote:

Phoenix wrote:It has to go in the root of your website.

In your case it has to be www.akikun.com/robots.txt

It can't be www.akikun.com/phpBB2/robots.txt.

If you click the first link you made..

Can't i have it in both? I mean, i almost put that in all folders i got lol

Do you know what bots they are? How do you even know they are bots?

Phoenix wrote:

Akimoto wrote:

Phoenix wrote:It has to go in the root of your website.

In your case it has to be www.akikun.com/robots.txt

It can't be www.akikun.com/phpBB2/robots.txt.

If you click the first link you made..

Can't i have it in both? I mean, i almost put that in all folders i got lol

Do you know what bots they are? How do you even know they are bots?

@porn.info
@asdafasfa.ru
@hotmail.org
@gaymengallery.info

Do i have to post up more @'s?


EDIT: those were just random examples i justs wrote up. I can get you the actually @'s too if you want... ._.

Akimoto wrote:

Phoenix wrote:

Akimoto wrote: If you click the first link you made..

Can't i have it in both? I mean, i almost put that in all folders i got lol

Do you know what bots they are? How do you even know they are bots?

@porn.info
@asdafasfa.ru
@hotmail.org
@gaymengallery.info

Do i have to post up more @'s?


EDIT: those were just random examples i justs wrote up. I can get you the actually @'s too if you want... ._.

Hit me up on msn.