Welcome to the Second Life Forums Archive

These forums are CLOSED. Please visit the new forums HERE

Are multiple redundant crawls of the wiki contributing to exceeded bandwidth?
Jesse Barnett
500,000 scoville units
Join date: 21 May 2006
Posts: 4,160
11-19-2006 10:54
I don't know, I don't do crawls. But I will ask the question again that I asked in the LSL wiki stickie:

Wouldn't it be better if there was a link and crawl date for the latest crawl in the wiki homepage? If someone saw that the date was a couple of days old they could always do a new crawl and update the link/date???
_____________________
I (who is a she not a he) reserve the right to exercise selective comprehension of the OP's question at anytime.
From: someone
I am still around, just no longer here. See you across the aisle. Hope LL burns in hell for archiving this forum
Newgate Ludd
Out of Chesse Error
Join date: 8 Apr 2005
Posts: 2,103
11-19-2006 12:53
From: Jesse Barnett
I don't know, I don't do crawls. But I will ask the question again that I asked in the LSL wiki stickie:

Wouldn't it be better if there was a link and crawl date for the latest crawl in the wiki homepage? If someone saw that the date was a couple of days old they could always do a new crawl and update the link/date???


The only crawls I do are pub ones.
What the heck is a crawl Jesse?
Jesse Barnett
500,000 scoville units
Join date: 21 May 2006
Posts: 4,160
11-19-2006 12:58
A program that will get a copy of each page of the wiki to use in a mirror. Or better yet, one that only gets pages that have been updated. I am familiar with them but don't really know the correct terminolgy outside of "crawl". Look in the sticky towards the end of the thread. There is some talk there about the subject.

Or here in wikipedia:

http://en.wikipedia.org/wiki/Web_crawler
_____________________
I (who is a she not a he) reserve the right to exercise selective comprehension of the OP's question at anytime.
From: someone
I am still around, just no longer here. See you across the aisle. Hope LL burns in hell for archiving this forum