bot questions

[shadey]

[Split from thread (http://www.ihelpyou.com/forums/showthread.php?s=&threadid=22608)]

Hi. First thank you for this great thread.

I have noticed a few bots in my last visitor logs and was wondering how I block them or find out about them.

Thanks in advance.


67.180.149.252
Referer: -
Agent: NetResearchServer/4.0(loopimprovements.com/robot.html)


139.18.13.212
findlinks/1.1.3-beta1 (+http://wortschatz.uni-leipzig.de/findlinks/)

64.5.245.26
Referer: -
Agent: genieBot ((http://64.5.245.11/faq/faq.html))


193.252.118.101
Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)


195.122.208.217
Referer: -
Agent: Jyxobot/1 Agent: NetResearchServer/4.0(loopimprovements.com/robot.html)

[Blue]

Welcome to the forums shadey! :hi:

[Connie]

Hi shadey and welcome. :hi:
Here is a great website for checking out user agents.
http://www.psychedelix.com/agents/index.shtml

There are a lot of ways to block bots, but if you know the useragent then I think the way Deb (savvy1) is about as simple as you can get.

[gio3]

Hi shadey and welcome to the forums. :hi:
According to http://www.psychedelix.com/agents/index.shtml , that's a quite comprehensive robot list, none of the robots in your logs seems to be a dangerous one.
I'm sure you will find more exhaustive replies to your post here in a short time.
Gio

[shadey]

Thanks to all!

[shadey]

Originally posted by Blue
Welcome to the forums shadey! :hi:

http://www.ihelpyou.com/forums/showthread.php?s=&threadid=22485

Has that thread gone private?

[Blue]

Yes. We've had to move it to the private forums.

[WebSavvy]

Yep, we moved it into the private forums. Members with subscriptions are able to access it there.

To block Digital Infinity (psycheclone) from your website, use the following in your .htaccess file:
SetEnvIfNoCase User-agent "psycheclone" blocked=yes
<Limit GET POST PUT>
Order allow,deny
deny from env=blocked
allow from all
</limit>
Additionally, you can also block other bots using the same format. Simply add another rule under or above the current one, which would look like the following:
SetEnvIfNoCase User-agent "psycheclone" blocked=yes
SetEnvIfNoCase User-agent "other-bot-to-block" blocked=yes
<Limit GET POST PUT>
Order allow,deny
deny from env=blocked
allow from all
</limit>

[WebSavvy]

Oops ... replied with the Digital Infinity answers (to Sharon), sorry shadey.

What specific bots do you still have questions about or need information about?