Rolling Restart for Server 1.30

Methinks Lil counts different than we do,

3700+2200 = 5900 server hosts

There are 29,000 map regions/sim processes that are running 4 or more per server.

We users see map regions, we dont normally think in terms of servers cause we dont directly know which regions are hosted on what server aside from the one we are located in.

(and thanks very much for status updates, its greatly appreciated)

We had a major slow-down during the deploy because of some grumpy sims; we had to get them back up by hand. By now every sim in the roll has been started, though, so it's just a matter of time till they're all back up.




Keep in mind I'm ex-Ops (not to be confused with ex-special ops!), so I tend to look at the bare metal



Yep. To get the security fix out, we needed to re-roll every single sim.

*whew*

Done for the night. We'll be back at it bright an early, 5:00am PDT.

I can't help but feel a bit for the poor grid monkeys having to pull a fast restart to get this one out, it must have been a bad securety breach to be needed pushed out so fast, as usual I don't expect we will be told what the securety fix was till the full restart has been finished.

We're starting the final rolls today. The rest of the evens are going first (~900 hosts), then all the odds. I'll be back for an update between the two groups.

How did the first part of the restarts go? Everything ok?

At Andrews office hour on Thursday night, he said he came into work that day to find a permissions exploit waiting for him.. I'd guess it's related to that, though he (of course) didn't go into any more details.

The evens are done! Odds will be starting shortly, I'll give updates at the ~33% and ~66% marks.

FYI, the version we're rolling is 1.30.0.133784

As a math nerd, I worked out that's a map region every 2 seconds, and about 6 hours to process the odd numbererd hosts if they keep the same pace.

The odds are about 50% done. We're gonna take a short break (30m) and then knock them out as soon as possible.

It's been fun, everyone, but all good things must come to an end. The grid is now 100% 1.30.0.133784 (a rather '1337' revision!)

If you see anything strange, please open a JIRA for the 1.30 server.

Thanks for your patience and suggestions on my first roll

awesome thanks lil!! it's feeling pretty good now in there... all the previous tp/standing lags seem cleared up now... :0

the lindens resatred my sim today got a five min warning its been runing at extre,mly log lag all day tanx

man this is turning into absolute pure crap. ever since the updates my sim has been experiencing almost zero lag, my internet connection is great i got a gig oF memory in my nvidia 9500 geforce gt a crapload of ram a 3.2ghz chip and i log on and can hardly move. i have to relog a dozen times before sl will run right. this is getting RIDICULOUS. I WANNA THROW THE GOT DAM COMPUTERAGAINST THE WALL. THANX A BUNCH!

Which region?

edit: wich reegin?

i logged off i aint playin this crap

i been suffering low fps for no good reason ever since they rolled out 1.30 . intermittedly now all the time. i got my sliders all the way down and aint suffering any packet loss and my rig was awesome just before is sl borked under attack or what

wich reegin?

edit: you sure you mean client-fps and not sim-fps? Like, are things just slow and jerky or are you looking at the stats bar?

stats bar

Will it help you in your pain and suffering if I pretend to give a dam? Why hold back expressing your thoughts, hasn't stopped you so far? You been practising coming across as an old school teacher speaking to her class? What makes you believe you are my peer lol.. which you could never be.

Once you and the many other 'experts' here speaking for LL without engaging the brain first, realise why I wanted my question answered by a Linden expert on their forum, and not any single one of you, then you may just understand and see the bigger picture.. Looking at all the posting here and elsewhere, you only ever see fragments, from that you start guessing and filling in the blanks yourselves.

In future, when I'm speaking to the Organ Grinder, can all the monkeys chew a banana.

Lest LL think that *everyone* is happy again, SVC-4196 is still alive and kicking.

I've barely logged in at all this month because of this bug. It has literally destroyed my SL.

poor awm does not even realise no linden actualy reads this topic anymore, by the next roling restart this one will get closed and a new one opened and he still would not have his answers because they are offtopic

there has been intermittent lag since 1.23 viewr rolled out that just comes and goes for no known reason its all over the jira, search lag on login

:0 lol well sorry - i did speak too soon; i haven't had much time to spend inworld lately :\...

i've seen reoccurances of chronic 'chatlag' (i think not the same as avatar entry/exit stalls). mainly this seems to affect script frequences (<0 channels)... sometimes it's there, sometimes it's not. :\ maybe there's another jira for something like that?

I sympathise, I'm having the same bizarre problem. Logging in is now done out of hope rather than expectation. I log in, my frame rate drops to next to nothing, maybe 20 frames per minute. I've logged in about fifteen times in the past couple of days and only about four of them have been clean log-ins, the others have either seen me crash out because of the lag, log out voluntarily because of the lag (when the lag eases up enough for me to hit 'Quit') or had me wait for ages for the lag to clear up. I've tried logging into numerous sims, even Serren which is an empty ocean sim with nothing to draw but my avatar and basic grid ground, sky and water and I still lag. I've cleared the cache, set the graphic levels to their minimum, even uninstalled Second Life and deleted everything in the SL folder. I've closed down all other processes running in Windows, I've uninstalled my anti-virus and still this frustrating lag persists.

UPDATE 5th Oct. 2009 - The problem seems to have cleared up considerably. I'm still a tad laggy when I log in but it lasts for no more than 30 secs and then I tend to be lag free for the rest of the session, which is great!