Welcome to the Second Life Forums Archive

These forums are CLOSED. Please visit the new forums HERE

A Consumer Watchdog in Second Life?

Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 12:51
From: Mike Westerburg
Heh, they did it just for the heck of it against individuals when we had the normal +/- rate system.


Yeah, and this wasn't a good thing. That's why Linden got rid of it, and diminished the importance of it.
David Jacobs
Just
Join date: 5 Jun 2004
Posts: 235
11-28-2005 12:52
From: Mike Westerburg
hmm, ok, so it would be close to the BBB setup then from the way it looks. Would also be nice to have a complaint/resolution config too like the BBB to see how a particular business is at handling customer disputes which can sometimes break a company. I am going to bore you with a tiny but funny (to me) story:

My last job, we were a member of the local BBB. One day, the rep from the BBB got fed up with trying to contact the owner of the company to work out a customer dispute (my old boss was horrible at contacing people). This BBB rep pops in, rips the BBB membership sign off the wall and storms out. That was the funniest thing I had ever seen. I guess you had to be there. We still weren't back to good relations with the local BBB when I left that company.

Sorry , but this thread poped up an old memory lol :)


'Considerds this a good way to say..No longer wanted..Terrar'..I'll have to remember it! :P
_____________________
Second Life Mentor - 2.0

"Your World, Your Imagination!" - Linden Labs

"United We Stand, Divided We Fall" - Aesop

"Never doubt that a small group of thoughtful, committed citizens can change the World. Indeed it is the only thing that ever has." - Margaret Mead

"The Universal Brotherhood of Man is our most precious possession" - Mark Twain
Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 12:54
From: David Jacobs
Unfortunatly, it's a 99.9% garuntee it's going to occur, however when it does..I will take measures to remove those votes [I pressume you mean on the website] and will do all I can to stop them from voting again.


Another interesting occurance that could happen, David:

"Customer: If you don't give me this item for free (or at a discount) I'll report you negatively at the SLBBB (or whatever the site will be called.)"


People on SL are very good at, if anything, finding ways to manipulate systems to their gain. I don't think the above is all that unthinkable.

I'm just trying to raise these questions (as were raised in another thread, actually) to bring them up -before- a system becomes entrenched.
David Jacobs
Just
Join date: 5 Jun 2004
Posts: 235
11-28-2005 12:54
From: Michi Lumin
Yeah, and this wasn't a good thing. That's why Linden got rid of it, and diminished the importance of it.


Surely however, a monitored voting service that is closely watch would be better then something that is basically free-for-all.
_____________________
Second Life Mentor - 2.0

"Your World, Your Imagination!" - Linden Labs

"United We Stand, Divided We Fall" - Aesop

"Never doubt that a small group of thoughtful, committed citizens can change the World. Indeed it is the only thing that ever has." - Margaret Mead

"The Universal Brotherhood of Man is our most precious possession" - Mark Twain
David Jacobs
Just
Join date: 5 Jun 2004
Posts: 235
11-28-2005 12:55
From: Michi Lumin
Another interesting occurance that could happen, David:

"Customer: If you don't give me this item for free (or at a discount) I'll report you negatively at the SLBBB (or whatever the site will be called.)"


People on SL are very good at, if anything, finding ways to manipulate systems to their gain. I don't think the above is all that unthinkable.

I'm just trying to raise these questions (as were raised in another thread, actually) to bring them up -before- a system becomes entrenched.


They are good questions, I suppose we could impliment a complaint or an inspection system to find out if the report it just or unjust.
_____________________
Second Life Mentor - 2.0

"Your World, Your Imagination!" - Linden Labs

"United We Stand, Divided We Fall" - Aesop

"Never doubt that a small group of thoughtful, committed citizens can change the World. Indeed it is the only thing that ever has." - Margaret Mead

"The Universal Brotherhood of Man is our most precious possession" - Mark Twain
Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 12:56
From: David Jacobs
Surely however, a monitored voting service that is closely watch would be better then something that is basically free-for-all.


Yes, but monitored by who? Whoever monitors it would have to remain ever vigilant, it'd be a full time job. You couldn't just get tired of the investigations and say "fine, whatever was entered, that's what stands".

You'll essentially have 'reputation griefers' that you'll have to deal with.

EDIT: I'm not saying this is a horrible idea in its 'ideal', but just that to create a fair and objective agency, that has creedence, credibility, and a good reputation *on its own* it takes a lot of work.

As soon as the system was gamed, or it became basically a flame board or a medium for griefers, the site's credibility would disappear: nobody would take any stock in it anymore.

For something like this to work, fairness *has* to be your #1 "product", and that takes a LOT of work to maintain.
David Jacobs
Just
Join date: 5 Jun 2004
Posts: 235
11-28-2005 13:02
From: Michi Lumin
Yes, but monitored by who? Whoever monitors it would have to remain ever vigilant, it'd be a full time job. You couldn't just get tired of the investigations and say "fine, whatever was entered, that's what stands".

You'll essentially have 'reputation griefers' that you'll have to deal with.


This surely depends on how big it gets, obviousaly it'd be ideal to be big and beautiful..I've seen certain business that are mostly automated..With moderation..I don't think it'd be a full time job, but I do think it would be a bit of a big task.
_____________________
Second Life Mentor - 2.0

"Your World, Your Imagination!" - Linden Labs

"United We Stand, Divided We Fall" - Aesop

"Never doubt that a small group of thoughtful, committed citizens can change the World. Indeed it is the only thing that ever has." - Margaret Mead

"The Universal Brotherhood of Man is our most precious possession" - Mark Twain
Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 13:08
From: David Jacobs
This surely depends on how big it gets, obviousaly it'd be ideal to be big and beautiful..I've seen certain business that are mostly automated..With moderation..I don't think it'd be a full time job, but I do think it would be a bit of a big task.



Thing is, the more automated it is, the easier it'll be to manipulate. A small business could live or die on an unfounded rumor. (As could a large one, really.)

Perhaps an intricate system like 'resellerratings.com' uses, where the business owner can comment after each rating.

This, of course, won't stop team or mass negatives. While a couple of pages of "-5 OMG U GIZE ARE FAGgS LOL!@#" probably wouldn't be taken seriously, a "summary" of (-2500) because of those ratings, and a position at the very bottom of a rankings list, likely would have a negative effect even if it wasn't deserved.

To avoid this would require extra human intervention, as well as a judgement call as to what entries are frivolous.

There, we open up the pandora's box of bias and personal opinion of the moderator -- and the appearance of such -- even if the moderator is not actually biased.

Perception of bias leads to reduced credibility, which leads to diminished efficacy of a service like this. Just like how before 1.7, you couldn't *really* judge how "bad" a person was by their received negatives. The system essentially obsoleted itself because of lack of oversight and its completely arbitrary (and automated) nature.
David Jacobs
Just
Join date: 5 Jun 2004
Posts: 235
11-28-2005 13:10
From: Michi Lumin
Thing is, the more automated it is, the easier it'll be to manipulate. A small business could live or die on an unfounded rumor. (As could a large one, really.)

Perhaps an intricate system like 'resellerratings.com' uses, where the business owner can comment after each rating.

This, of course, won't stop team or mass negatives. While a couple of pages of "-5 OMG U GIZE ARE FAGgS LOL!@#" probably wouldn't be taken seriously, a "summary" of (-2500) because of those ratings, and a position at the very bottom of a rankings list, likely would have a negative effect even if it wasn't deserved.

To avoid this would require extra human intervention, as well as a judgement call as to what entries are frivolous.


Well if there is a register system where people register to vote, it'll be alot easier to tell if they are group voting..And alot easier to ban the individuals who are doing it, rather then shutting down the voting system.
_____________________
Second Life Mentor - 2.0

"Your World, Your Imagination!" - Linden Labs

"United We Stand, Divided We Fall" - Aesop

"Never doubt that a small group of thoughtful, committed citizens can change the World. Indeed it is the only thing that ever has." - Margaret Mead

"The Universal Brotherhood of Man is our most precious possession" - Mark Twain
Mike Westerburg
Who, What, Where?
Join date: 2 May 2004
Posts: 317
11-28-2005 13:15
From: Michi Lumin
OK Mike, does that neccessarily mean that the complaint was valid, or that your boss is just bad with getting back to people?



LOL! I never really thought people would read it ;) so I may have skipped some of the more boring details. The complaint was valid, the complaint was against him. He was terrible at getting back to anyone, he was also bad at dealing with anyone in person, I have a few stories about that too, but those are for a different day and thread.
_____________________
"Life throws you a lemon, you make lemonade and then plant the seeds"
Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 13:18
From: David Jacobs
Well if there is a register system where people register to vote, it'll be alot easier to tell if they are group voting..And alot easier to ban the individuals who are doing it, rather then shutting down the voting system.



Not sure about that. I (and some other SL users) have recently been "working" at a site, Amazon.com's "Mechanical Turk" - a site where you are given tasks that only humans can do (computers cannot; i.e., 'identify the pizza store in this picture') - and you get paid per work unit.

The system uses voting logic, to determine what the 'correct' answer (or 'correct' picture in a group of several, i.e., the one that actualy -does- contain the pizza store) actually is.

Over the weekend, a few "enterprising individuals" found a way to script bots to hammer the site with random answers.

Now, the entirety of the data is dirty, and no 'humans' can actually do the work units because they are all 'contaminated' and taken by the bots.

The bot script was posted, and now hundreds of users are simply running bots on the off chance that even a 'low' percentage of their hits are correct - with the current system (until it is shut down, which it undoubtedly will be) they will at least get some pay for the bot's "random correct answers".

The point here is that "mass" votes or negs can't always be tracked or filtered out, and sometimes (often) a system is 'gamed' in such a way that it isn't expected.

If you are the type of person who doesn't like a certain category of person or product, you may be compelled to vote negatively at random times, or simply when browsing categories, even if you have never had a transaction with this person or used their product.

This would be very hard to track. Not all "attacks" on a system happen in bursts, come from the same location, or even show a solidly identifiable trait.

Granted, most businesses won't have to worry about this. There aren't entire categories or teams of people who hate, for example, shoe vendors.

But some businesses certainly will suffer due to large numbers of people who simply want to make trouble. (However, similar problems could be caused by 'competitors' and their 'shills' as well.)
Mike Westerburg
Who, What, Where?
Join date: 2 May 2004
Posts: 317
11-28-2005 13:18
From: Michi Lumin
Yeah, and this wasn't a good thing. That's why Linden got rid of it, and diminished the importance of it.


I agree completely with you. any type of system used to rate products/people would need to have some sort of checking system to verify the complaints/comments/ratings or it would turn into the same crap we had to deal with while we had the +/- rate system for avatars. Apparently, spending money to give bad ratings won't deter people from doing it.
_____________________
"Life throws you a lemon, you make lemonade and then plant the seeds"
Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 13:20
From: Mike Westerburg
The complaint was valid, the complaint was against him. He was terrible at getting back to anyone, he was also bad at dealing with anyone in person, I have a few stories about that too, but those are for a different day and thread.


Well, OK. But I've heard plenty of stories where local BBB chapters actually do act in rather draconic manners, having little understanding for startups or even being accused of political bias.

Bias happens whenever an organization is run by humans. Manipulation happens whenever an organization is run by machines which are operated by humans.
Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 13:22
From: Mike Westerburg
I agree completely with you. any type of system used to rate products/people would need to have some sort of checking system to verify the complaints/comments/ratings


Exactly. This is what I originally said in my complaints of the rating system: that they have to be transactional versus arbitrary. (Philip later supported this exact notion - requirement of a transactional nature for reputation - in a speech at SLCC.)

Right now we have no API or method to verify that a transaction between two people has taken place on SL. Therefore any SLBBB would have to rely on an arbitrary data collection or rating system, which by its nature is easy to game or manipulate without constant and intensive human moderation or oversight, which inherently brings in the possible factor of moderator bias.
Mike Westerburg
Who, What, Where?
Join date: 2 May 2004
Posts: 317
11-28-2005 13:27
From: Michi Lumin
Exactly. This is what I originally said in my complaints of the rating system: that they have to be transactional versus arbitrary. (Philip later supported this exact notion - requirement of a transactional nature for reputation - in a speech at SLCC.)

Right now we have no API or method to verify that a transaction between two people has taken place. Therefore any SLBBB would have to rely on an arbitrary data collection or rating system, which by its nature is easy to game or manipulate without constant and intensive human oversight.



I am not a programmer, but couldn't a system based off of the XML implementation in SL be used for these types of functions? Or did I totally botch this train of thought up too?


I seem to be batting -5,000 today....I hate Mondays!
_____________________
"Life throws you a lemon, you make lemonade and then plant the seeds"
Michi Lumin
Sharp and Pointy
Join date: 14 Oct 2003
Posts: 1,793
11-28-2005 15:06
From: Mike Westerburg
I am not a programmer, but couldn't a system based off of the XML implementation in SL be used for these types of functions? Or did I totally botch this train of thought up too?


They certainly could be, but it'd have to be a standard, and univerasally acepted, and used.
eltee Statosky
Luskie
Join date: 23 Sep 2003
Posts: 1,258
12-01-2005 09:42
I used to toy around with this overall idea myself some but i decided the overall work load for such a system would probably be too high.

Generally what has to happen is the complaints have to be 'factually' verifired before they are ever entered into the system, aka there has to be specific human oversight, or at leas a semi-automated way of contacting people when complaints are raised and allowing them to factually verify the very basics... a) did so and so actually come by on day X, b) did so and so purchase any product or service, c) when was this transaction made, d) when was complaint Z raised, e) when and how was the complaint 'handled' by the seller... can person X who raised the complaint, if the seller denies, actually produce the sold object for inspection?

etc etc...

Now im not saying this is a bad idea, overall, i think its interesting and could be used for alot of good things, but it really does need to have alot of direct hands on investigation and resolution of complaints otherwise its just going to be a grief/extortion tool.

one potential option would be to mandate that any complaints tendered must have an agreed upon log of the support session before being made 'public' to the site (agreed on as the factual log of the conversation by both parties) etc...

again i'm not saying that any of this is bad, just that its going to require alot of careful thought and planning, if its really going to be a good tool to help the people of secondlife
_____________________
wash, rinse, repeat
Gabe Lippmann
"Phone's ringing, Dude."
Join date: 14 Jun 2004
Posts: 4,219
12-01-2005 09:47
Sounds interesting, David. FFRC meetings are on Sundays, 1PM SL. There are obvious synergies here.
_____________________
go to Nocturnal Threads :mad:
1 2