PDA

View Full Version : Spider Dilemma


Matt B
10-02-2003, 10:53/10:53AM
Is there somewhere I can report "bad" spiders from Ink ?

We can track page over 10 requests per minute and 2,800 Slurp sessions over the last 72 hours. There were so many requests that one of the servers feeding live information disallowed anyone from getting any product information this weekend.

I hate to complain, as I am not paying Ink anything, but the hammering we took over the weekend prevented visitors from viewing product pages for large gaps of time.

JuniorHarris
10-02-2003, 14:48/02:48PM
Sorry I don't have any advice, but I do feel your pain.

I'm almost to the point where I want to block AV for the same reasons. The spider traffic tends to be about 10-fold compared to actual referrals!~:eek: