|
Cristiano Midnight
Evil Snapshot Baron
Join date: 17 May 2003
Posts: 8,616
|
10-10-2005 07:36
From: blaze Spinnaker They usually go like "Googlebot" as the agent. Do you have agents in your logs? I got a copy of the logs for Saturday and Sunday and the culprit definitely seems to be Googlebot. Why it went crazy, I'm not sure, but it seemed to be very aggressively indexing the pictures on the site.
_____________________
Cristiano ANOmations - huge selection of high quality, low priced animations all $100L or less. ~SLUniverse.com~ SL's oldest and largest community site, featuring Snapzilla image sharing, forums, and much more. 
|
|
Enabran Templar
Capitalist Pig
Join date: 26 Aug 2004
Posts: 4,506
|
10-10-2005 09:37
From: Cristiano Midnight I got a copy of the logs for Saturday and Sunday and the culprit definitely seems to be Googlebot. Why it went crazy, I'm not sure, but it seemed to be very aggressively indexing the pictures on the site. I hope the bandwidth wasn't an expensive issue for you. I wonder how Googlebot found you. In any case, now is the time to make some choices about your robots.txt file. You're going to be coming up in a bunch of Google Image Search SERPs pretty soon now. While the exposure for SL as a platform, as well as its residents and businesses, will be awesome, I would understand your reluctance at footing the bill for such a thing if the traffic got out of hand.
_____________________
From: Hiro Pendragon Furthermore, as Second Life goes to the Metaverse, and this becomes an open platform, Linden Lab risks lawsuit in court and [attachment culling] will, I repeat WILL be reverse in court.
|
|
Richie Waves
Predictable
Join date: 29 Jun 2005
Posts: 1,424
|
10-10-2005 15:53
Well just after the Bourbon update, we were seing 250 google bots in our forums at a time! peaked at 310!
_____________________
no u!
|