
Vektor Linden: This gathering is basically to start getting our heads together around the 1.7 preview testing effort...To start I was hoping to discuss what worked and what didn’t in 1.6, for those familiar with that marathon....
Vektor Linden: Preview 1.6
eltee Statosky: well on the positive side, the ability to see test descriptions before taking a test was good
eltee Statosky: i also liked the ability to see which tests had been taken out, verified, or were still open
Michi Lumin: Vektor, to an extent, I think that we got into 1.6.pre at a point where some of the changes were already in the 'too late' stage... I think maybe some more 'formative' and proactive testing would have been better there.
eltee Statosky: i would also like to see more of a library of smaller 'stuff should still work' tests
eltee Statosky: we got lucky and caught some bugs kinda jus playing around, but it would be nice to have a more formal arrangement for testing the parts of SL various people really care about
Vektor Linden: michi, you are correct in that we have another grid for DMZ testing....much of the decision lies however in the criteria that we have set for a stable beta build
Michi Lumin: yes Vektor, at a point where people can say, "This is a bad idea, at least in how it's carried out, that may have a widespread deletirious effect" before its "too late" to change the way a feature operates.
Rock Psaltery: Yes, I'd like to see popular games brought into the testing phase
Michi Lumin: For example, some of the building tool changes likely could have been optioned or compromised on in a way that would have caused an ease of transition if we got in on the process earlier.
Vektor Linden: I think that the 'smaller stuff should still work' tests would be a great "build acceptance" suite
eltee Statosky: yeah but it would be nice to have a whole lot of smaller tests
Chromal Brodsky: In world unit-testing, huh?
eltee Statosky: michi and i worked on some 2-3 hour marathon ones, but it'd be nicer to have a bit narrower focus for each one
Vektor Linden: I'll see about bringing games in
Nathan Stewart: also would be nice to see the builds earlier here, it seems we seem to get them and then sometimes find bug that have past the cut off time
Nathan Stewart: and you have to release and update the same day
Vektor Linden: Contacting the creators might be a good idea...it is in all of our best interest, I think, to test as much content as possible
eltee Statosky: also a bit more information on what expected outcomes are/should be, would be helpful too
Usher Caldera: I’m sure this won't happen, but i for one would spend more if not all of my spare time in preview if content could be transferred to the main grid afterwards
Michi Lumin: <nods to Nathan> ... That's what I mean about getting to them earlier, where the feature implementations are still malleable, and not frozen in the way they're going to be carried out in the UI.
eltee Statosky: we had some problems with the group land and object permissions tests
Lex Neva: can you bring over specific assets created after the db snapshot?
Rock Psaltery: Yeah, if you need help finding the creators, let me know.
Brent Linden: A lot of those tests were carried over from older versions (tests before user testing was the norm)
eltee Statosky: because we honestly didn’t really know exactly what the 'share with group' land setting was *supposed* to do
eltee Statosky: in the first place
Vektor Linden: We saw it Lex, but it wasn't a show-stopper. Someone made the decision to release
Vektor Linden: Yes Chromal, in-world unit testing
Vektor Linden: So far I am seeing a desire to get into Preview sooner
Chromal Brodsky nods. "I wasn't around for 1.6 testing, so some of this is new to me-- I'll try to learn fast."
Brent Linden: Smaller tests would contribute to getting more tests accepted and completed
Baba Yamamoto: I would love to see preview much sooner
Michi Lumin: (Just one note here that I"ve been biting my tongue on - Everyone's wrists look screwed up here in 1.6.5. but... again, -- this is another thing that could have to do in 1.7 : and in 1.6 - we were not informed of changes that went on.)
Vektor Linden: Usher: I am looking into that.
Baba Yamamoto: even if its in a far more unstable state
Michi Lumin: (Undocumented changes are... kind of a wrench in the works)
eltee Statosky: also smaller tests would probably help with 'someone forgot to do x' lets repost the whole 3 hour thing again problems
Nathan Stewart: i have no problems with downloading buggier builds
Vektor Linden: So you feel that it would behoove us to let the residents in earlier so that the features may be better tuned to what the population wants?
Nathan Stewart: if it helps find these issues and produce a more smoother final update
eltee Statosky: yeah vektor thas prolly overall a good idea
Michi Lumin: yes Vektor. One of the ONLY things that has steamed me in the past about LL more than anything, since 1.0, is the tendency to "dump an unannounced change on the population".
CrystalShard Foo: If anything, people who come here to preview should come for the sake of helping with the preview, not to get a prize.
Michi Lumin: And once the change is implemented, it's ALWAYS too late to do something about it.
Lex Neva: I don't see how it could hurt to get people in here earlier. I think it could only help.
Koyuki Michabo: nah, testing is for testing purposes, not a way to make money
eltee Statosky: mebbe not general access, but invite some residents in earlier in the process
eltee Statosky: people who understand the nature of early build testing
Garth Fairlight: less bugs is a big incentive
Michi Lumin: Sorry to be harsh on that Vektor, but it's something I think does have to be changed.
eltee Statosky: and won't be put off by the occasional hiccup
Baba Yamamoto: I would recommend that early preview builds be announced only in the forums... the ease of getting it on the website might lead people to think this is how the next version will be
Baba Yamamoto: because they're here to look and see rather than test
Chromal Brodsky: I think michi is talking especially about many of the tweaks-- things that are probably pretty subtle changes, e.g. redefining constants in the physics or energy limits, that have unexpected and subtle impacts. Or not so subtle, sometimes...
Vektor Linden: Hopefully meetings like this will help to generate better response to what the residents need
Michi Lumin: we get a situation where it's kind of , "Surprise, here's an operational change, and the feature and implementation is already frozen."
Vektor Linden: I will try and make the meetings more structured in the future lol
Chromal Brodsky: Or changes to interfaces that come unexpectedly and without apparent demand.
Rock Psaltery: People seem to often not be very enthusiastic about the upgrades, and I think that affects their willingness to test.
Baba Yamamoto: well a good focused group of testers...

Vektor Linden: Lex, one of the problems with alpha is that a lot of exploits become exposed, and we need to tie them down fast so that we can let folks in
eltee Statosky: surprise isn't always bad, but I think things that are surprises, should have a higher priority to be made in some fashion optional, so people can transition
Chromal Brodsky: Vektor, will the effort here be to help a test community give feedback on feature choices made by the dev team, or is that presumptuous and beyond the scope of 'testing' ?
Vektor Linden: A little order...but I am following, it’s just a little chaotic
Torley Torgeson: yeah and to have a diverse range of testers helps a lot because of the multitude of perspectives involved... different people approach things in different ways.
Baba Yamamoto: i would have no problem signing a NDA... for alpha tests

Koyuki Michabo: hehe yeah an IRC preview discussion would have suited me
Vektor Linden: Chromal, resident opinions and testing were critical to how 1.6 turned out
Vektor Linden: Yes they do, Torley, which is a great reason to really populate this grid during major previews of releases
Vektor Linden: Perhaps we can moderate this a little...
eltee Statosky: yeah Vektor, tho like i said it might be advantageous to have a smaller group give feedback earlier on in the process
Torley Torgeson: eltee: yeah and then scale it upwards gradually.
eltee Statosky: before things are necessarily ready to be hit by a 500 person at once stress test open to the public
Chromal Brodsky: Vektor, is there any sort of feature/bug tracking system specifically for preview that would be more 'open' to the test community? Maybe a preview bugzilla?
eltee Statosky: that’s another thing i wanted to mention about the previews
eltee Statosky: right up before 1.6
eltee Statosky: there was a string of refresh releases on the preview client
eltee Statosky: but we had no idea what was or was not supposed to have been fixed
eltee Statosky: we probably could have given much better live feedback on those revisions
Michi Lumin: yes, I made that point a few minutes ago eltee: We NEED to be apprised of what has been changed.
eltee Statosky: if we knew what they were supposed to have entailed
Vektor Linden: Brent will filter questions via IM and I will do my best to answer
Vektor Linden: Even though what I have seen has poured out chaotically in my chat history,
Vektor Linden: I am seeing a lot of valuable feedback already
Brent Linden: Oz Spade: What is the main purpose of this meeting?
Vektor Linden: Just little structure - I hope you all don’t mind it if we try moderating it this way
Vektor Linden: OZ: aside from making liam drive too fast, it is to open discussion about 1.7...in addition; I wanted to look critically at 1.6 preview, what worked and what didn’t,
Vektor Linden: as well as considering approaches for 1.7...discussion about the test cases that we used / will use, etc
Garth Fairlight: Him Strife
Vektor Linden: I value all of your opinions, and this meeting is to get the ball rolling, so I can run with it
Vektor Linden: so we all can
Vektor Linden: next
Brent Linden: Chromal Brodsky: We've been asked for feedback about what worked/didn't work from the 1.6 preview-- what is the Linden staff perception of what did and did not work in Preview 1.6?
Vektor Linden: Chromal, people at the lab were thrilled by the dedication of the residents (we’re all residents too)....
Vektor Linden: and 1.6 was *much* more solid than 1.5, which rolled out after 1 day in preview
Vektor Linden: Personally I can’t say enough about how impressed I was, and am by what happened with 1.6
Brent Linden: Please IM you questions to me (Brent) and I'll filter then to Vektor
Brent Linden: and here's the next: Huns Valen: About when is the first 1.7 preview build going to be released?
Vektor Linden: Chris is here, and will answer Hun's question
Chris Linden: Hi folks,
Chris Linden: So the question is when will the first 1.7 preview be correct?
Chris Linden: Sorry we don't have a specific timeline for that. I'm watching carefully the state of all current development and will be developing a timeline in the coming weeks.
Chris Linden: Short answer: we will know in a couple of weeks.
Vektor Linden: And I will be sure to let everyone know as soon as I am able
Brent Linden: CrystalShard Foo: Hows the "direct object-to-object" messaging going?
Koyuki Michabo: hehe i wonder where we'll be by September when i get back home
Vektor Linden: Chris'll field this one as well
Chris Linden: In development, but I don't know exact details at this time. Next q
Brent Linden: Michi Lumin: Vektor, how do you feel about residents having more of a formative position in testing. I understand that the voting system is supposed to do this, but we need a reaction-based evaluation as far as how new features are implemented
Vektor Linden: But I would like questions to please be mostly along the lines of testing....
Brent Linden: ...
Brent Linden: And a reduction in "surprise changes"
Vektor Linden: Well, if you recall we had a lot of the reaction of the resident’s factor into the QT, for example
Vektor Linden: We added functions to more greatly allow use of the QT plugin, largely as a result of feedback in 1.6 preview from residents
Vektor Linden: I hope more of that will happen in 1.7 preview
Brent Linden: Michi Lumin: Michi Lumin: #2: on that, what large operational and implementation changes can we expect or, look out for, in 1.7?
Vektor Linden: Michi, in regards to preview testing?
Michi Lumin: (I’m talking mostly about the build tool changes here.)
Michi Lumin: in 1.6, many people identified shortcomings in the new implementations.
Michi Lumin: As far as I know, those haven' been addressed yet.
Vektor Linden: Many have, some haven’t....you’re right
Michi Lumin: so if there's a new feature, that people ---- how can I say, disagree with the implementation of, what's the venue for that?
Michi Lumin: because part of testing is usability...
Rock Psaltery: true
Michi Lumin: 1, if a feature works as it should, and 2, does it enhance usability.
Vektor Linden: I will soon be posting some information regarding new features, within a few weeks hopefully
Vektor Linden: One of the problems that I had with 1.6 was filtering all of the information coming back from the residents
Vektor Linden: With barely enough time to track test responses, it was hard for me to keep up with other feedback
Michi Lumin: so likely we need a more formalized method for that.
Vektor Linden: I would like to explore new mechanisms for communication with the group as we move forward
Chris Linden: I should jump in and say: There was some feedback in the forums, but overall the low turnout of residents coming into Preview didn't help with the amount of feedback
Brent Linden: Garth Fairlight: Can Vektor outline the changes expected in 1.7 already?
Chris Linden: and yes, to everything Vektor said
Vektor Linden: Not yet Garth, right now we're having a pow-wow...
Garth Fairlight: ok
Vektor Linden: but of course Havok-2, better sim communication, etc, are highlights
Vektor Linden: we can all expect havok itself to keep us busy
Vektor Linden: next please
Brent Linden: Lex Neva: Someone mentioned something about bringing games in to be tested in 1.7. Does that mean it's possible to bring specific assets in from the main grid? If I have something I think would test a lot of functionality, how do I have it brought in?
Vektor Linden: Lex, I am considering an asset update for the preview grid
Lex Neva: Ah. That works.
Vektor Linden: So that it will be current
Brent Linden: Ice Brodie: Would it be possible to get a list of fixes to test with future releases, it was mentioned before.
Vektor Linden: Yes Ice, I admit that my response in that area for 1.6 was spotty, at best, but I think it was a good start - I was told that bug fixes hadn’t been posted before
Vektor Linden: I hope to work with everyone to find a more efficient way of disseminating information to the test group
Ice Brodie: it, as mentioned by a few people, would help if we knew what old bugs to check for fixed state.
Brent Linden: eltee Statosky: i just wanted to ask vektor if it would be a good idea to have a pre-formatted 'test sheet' for tests, that would be easier for people to check things off, or give better feedback on the problem sorta like how report a bug works now
Vektor Linden: Yes Ice, I have a small section for that here, and I did post to the forums a few times, but not enough
Vektor Linden: eltee, I am looking at something like that, that could be used in an inventory drop
Vektor Linden: and would be emailed to me formatted so that I can just parse it
Vektor Linden: I want to simplify that process and anyone that has feedback on that may IM me or email me @ [email]vektor@lindenlab.com[/email]
Vektor Linden: feedback on any issue related to 1.7 testing for that matter
Brent Linden: eltee Statosky: and a second question: would you prefer it if residents focus their attention more on the new features of each release, or went back and tried out existing things to re-verify them, aka what should we spend our time doing, to be the most..
Brent Linden: helpful
Vektor Linden: Well, first thing is first, and existing functionality needs to be verified, needs to be solid before we can really hammer new features
Vektor Linden: the havok-2 integration will obfuscate that a little, as it touches so much of the application
Rock Psaltery: Would seem logical to test old things first
Vektor Linden: but old stuff comes first
Brent Linden: CrystalShard Foo: How about using a dedicated Preview Bugzilla to track preview problems? We can use that to try and look for previous posts of the same bug before posting again, thus moderating ourselves.
Vektor Linden: CShard, we're looking into that strongly
Ice Brodie: bugzilla's been a popular suggestion o.o
Vektor Linden: next please
Brent Linden: Baba Yamamoto: Will it be possible for residents to join in much earlier preview testing, even if they must sign and NDA?
Ice Brodie: I'd sign the NDA to help.
Chris Linden: nothing to say we can't have external bugzilla
Vektor Linden: We're strongly considering it
Chris Linden: or nothing to say in fact that the community can't setup their own bugzilla site
Torley Torgeson: I’ll sign NDAs! just for the heck of it! lol.
Chris Linden: just some random thoughts....
Lex Neva: might be best if you run it so you see it frequently...
Vektor Linden: ok, I definitely get the idea that folks want to come into preview earlier
Vektor Linden: ok next please
Brent Linden: Strife Onizuka: For the 1.7 preview could it be made so everyone can own 16m of land regardless of tier?
CrystalShard Foo: Well, it seems like just submitting bug reports via the normal form flooded SL, so putting up a dedicated service will be interesting.
Lex Neva: or just make us all premium accts
Vektor Linden: Strife: I am looking at land requirements for testing, tier requirements, and total number of sims that we'll need. I am hoping that we can get a better assessment as preview 1.7 gets closer
Vektor Linden: next please
Garth Fairlight: better servers too?
Strife Onizuka: (it's tough to do land testing when you can't own land)
Brent Linden: Michi Lumin: Vektor: Perhaps we need to formalize 'volunteer testers', and set up a system where they can work on a 'trouble ticket' system; where people will, in a way, have a sort of "bug ownership", following it through from version to version, to...
Vektor Linden: Garth that’s TBD
Garth Fairlight: ok
Ice Brodie: this could be where really early preview could come in, those on pre-public testing, a beta team, would be allotted a fixed size, maybe?
Garth Fairlight: and sorry to but in
Brent Linden: ...make sure that showstoppers are eradicated. This would also streamline the flow of how things are reported, and leave a testing trail that can be more easily scrutinized to see where things went wrong.
Chris Linden: Michi: let me answer your suggestion
Chris Linden: formalize volunteer testing is in fact one thing we cannot do for legal reasons
Chris Linden: formal and volunteer are two words that don't go together
Chris Linden: that said, there are things we can do to help you help us
Michi Lumin: (I don’t mean an employee position.)
Chris Linden: which is why we are here
Chris Linden: in this meeting that is
Vektor Linden: I would like to talk with you more later about organizing our efforts, but right now I'd still like to Q& A and brainstorm a little
Vektor Linden: next please
Michi Lumin: ok. I was speaking more in terms of assignments of areas of focus, not really anything to do with Linden employment.