|
Adam Zaius
Deus
Join date: 9 Jan 2004
Posts: 1,483
|
03-28-2006 00:33
From: Blakar Ogre The raw economic data of SL includes any transaction where L$ were transferred. Anything else is a summary. Extracts are pointless cause you'll miss data you need to do an analysis. At present I'm not even sure LL keeps the raw data and if they do it should be a few TB by now.
Even if it would be only 1GB of raw data I still doubt many people would have a use for it. How many have set up databases with economic data and have then performed analysis upon it?
An extensive summary with the option of asking for additional data summaries when something is missing would already be quite ok. Well, I had a quick script to import the data LL released into a DB for analysis. I know Ricky has been importing the LindeX data and making graphs and general analysis. There are countless others as well. At the end of the day, LL isnt going to cater for each specific request for a particular statistic; but if we have the data itself on hand, we dont need to ask LL to do it. |
|
Adam Zaius
Deus
Join date: 9 Jan 2004
Posts: 1,483
|
03-28-2006 00:35
Also, the filesize will be tiny; this is very repetitive data, it should compress nicely.
You can make a table with twenty million rows, with say 5 20 char columns, and it will still end up fairly small.
SL's asset system is only just approaching 13TB. And that's hard content which is less easy to compress. Financial transactions are both simple, small, and easily compressable; which make up for the large number of them. The complete data I wouldnt put more than half a gig.
Remember, 1KB ~= 1000 chars of text; and this data is going to be encoded at a binary level. 1GB is an awful lot of rows.
|
|
Blakar Ogre
Registered User
Join date: 18 Mar 2006
Posts: 209
|
03-28-2006 00:59
Raw data doesn't contain only figures. It's also timestamps, names and transaction identification. Off those they'll need to cut out the names at the least for privacy issues. At that point it's already silly not to do a summary as part of your granularity has been removed and your records will be too alike for them to have a value on their own.
I don't see the value of knowing every exact point in time on which a texture was uploaded. I'd be willing to settle for textures per hour. There's a zillion examples like that. LL surely has a datawarehouse set up to contain the valuable data and they should be able to output meaningful summaries just fine.
I've seen many auditors pass by who thought the same as you. They expected to be able to burn the data on a DVD. They never figured that DVD wouldn't even contain one hour of data. Admittedly SL is a lot smaller than what I'm referring to but still the full raw data should be quite large.
|
|
Jesrad Seraph
Nonsense
Join date: 11 Dec 2004
Posts: 1,463
|
03-28-2006 01:37
I'd like to import the transactions data into a graph where every node is a resident  That would eliminate refunds and connect alts together. The resulting graph would show where money comes in and where it comes out of the economy, as well as balances, trends, popular sellers, etc...
_____________________
Either Man can enjoy universal freedom, or Man cannot. If it is possible then everyone can act freely if they don't stop anyone else from doing same. If it is not possible, then conflict will arise anyway so punch those that try to stop you. In conclusion the only strategy that wins in all cases is that of doing what you want against all adversity, as long as you respect that right in others.
|
|
Shep Korvin
The Lucky Chair Guy
Join date: 30 Jun 2005
Posts: 305
|
03-28-2006 04:37
From: Jesrad Seraph I'd like to import the transactions data into a graph where every node is a resident That would eliminate refunds and connect alts together. The resulting graph would show where money comes in and where it comes out of the economy, as well as balances, trends, popular sellers, etc... ...not that you'd be able to logically link those biggest-spending "anonymous" avatars to any real-world individuals. *cough* |