PDA

View Full Version : Googlebot

awicked
08-07-2003, 11:13/11:13AM
Hello

Can anyone tell me what i should be looking for in my logs to know if googlebot has spidered my site? i notice i have 42 hits from http://www.google.com/search would this be it?

thanks

ashley.
dragonlady7
08-07-2003, 11:28/11:28AM
Nope, google.com/search is a search that led someone to your page.
Your logs would record this:
>Googlebot/2.1 (+http://www.googlebot.com/bot.html)

(at least, that's what mine said this morning.)
Do you have a site log analysis tool? I've been experimenting with various freebies to save my eyes from poring over the raw logs... blechh... So hunting for one of those would probably be a good idea. I bet some other people in here have better ones than I do. That helps me see what's looking at my page.
Alan Perkins
08-07-2003, 11:30/11:30AM
Welcome to the forums ashley :hi:Originally posted by awicked
i notice i have 42 hits from http://www.google.com/search would this be it? No, that's people visiting your site as a result of searching on Google.

Do your server logs keep User Agent information [such as "Mozilla/4.0 (compatible; MSIE 5.5; Windows 98\)"]. If so, you should be looking for Google's robot's User Agent, which is "Googlebot/2.1 (+http://www.googlebot.com/bot.html)".
awicked
08-07-2003, 11:32/11:32AM
hello


thanks for the reponse, i use a server log which comes with the server i use. you can take a look here http://www.best-casino-ever.com/webstat
Bernard
08-07-2003, 11:32/11:32AM
Welcome to the forums Ashley! :hi:

This might help:

http://www.ihelpyouservices.com/forums/showthread.php?s=&threadid=9683
Bernard
08-07-2003, 11:34/11:34AM
Webalizer is only listing the top 15 agents. You need a stats program that will show you all of them.
awicked
08-07-2003, 11:36/11:36AM
ok thanks

could you recommend any in perticular?
Alan Perkins
08-07-2003, 11:36/11:36AM
What Bernard said.

Also, you shouldn't make your Web stats public like that. Read this thread on Referrer Spam (http://www.ihelpyouservices.com/forums/showthread.php?s=&threadid=9595) for details.
Bernard
08-07-2003, 11:37/11:37AM
One more thing.... Please read about referrer spam (http://www.ihelpyouservices.com/forums/showthread.php?s=&threadid=9595).
Alan Perkins
08-07-2003, 11:38/11:38AM
LOL

I'm stopping now Bernard. :D
Bernard
08-07-2003, 11:38/11:38AM
Alan, you are quick on the draw my friend....