Welcome to the Second Life Forums Archive

These forums are CLOSED. Please visit the new forums HERE

Lip sync coming to Second Life
Geuis Dassin
Filming Path creator
Join date: 3 May 2006
Posts: 565
05-29-2008 00:49
Mike Monkowski(SL-> Mm Alder) has been working on lip sync code since last year. Its now in the official release candidate and will be available for everyone to enable under the debug menu.

I wrote up about it, plus some additional thoughts. This is something that's personally important to me that is useful for machinima, but also has much broader implications.

http://www.trending.us/2008/05/28/lip-sync-coming-to-second-life-and-why-this-could-be-the-most-important-news-all-year/
Dylan Rickenbacker
Animator
Join date: 11 Oct 2006
Posts: 365
05-29-2008 02:00
Wow, that's awesome!
AWM Mars
Scarey Dude :¬)
Join date: 10 Apr 2004
Posts: 3,398
05-29-2008 04:48
That will make a huge difference in creating the realism for SL.
_____________________
*** Politeness is priceless when received, cost nothing to own or give, yet many cannot afford -

Why do you only see typo's AFTER you have clicked submit? **
http://www.wba-advertising.com
http://www.nex-core-mm.com
http://www.eml-entertainments.com
http://www.v-innovate.com
Infrared Wind
Gridologist
Join date: 7 Jan 2007
Posts: 662
05-29-2008 05:47
Just tried it out...pretty cool. Though it's not as sophisticated as
something like Crazy Talk. I tested saying vowels, open oooooo's
and the like. It's more like when you start speaking the mouth
is doing movement.

I think this is an excellent feature, as any movement of the mouth
will add realism. I think it should be added to type chat as well.

However, doing some FRAPS captures, the lag between what's
spoken and heard is extreme. So I don't think that's anywhere
near prime time.

One would still need to do voiceover in production.

Thanks Geius, for the heads up on this.
Infrared Wind
Gridologist
Join date: 7 Jan 2007
Posts: 662
05-29-2008 07:04
Well had to try it more. So here's a little video demonstrating
what the lip sync bit in SL looks like.

I used chat in SL. In fact you can just hold down your Talk button
and not say anything and the mouth will move. But I did talk.

The result, recording with FRAPS is that the voice is very out of
sync with the action.

That's OK for now. Doing a voiceover is easy.

So I used a clip from Allen Ginsberg reading a bit from Kaddish. =)

I think this lip sync feature is most excellent for many reasons...but
for machinima it is boon.

Again, Geuis, thanks for the post on this!

Here's the low rez clip:

http://vimeo.com/1085262

-i
Robustus Hax
Registered User
Join date: 4 Feb 2007
Posts: 231
05-29-2008 08:05
Experimented myself with this using our intro to our News program (which we use crazytalk) and yeah it definitely could use work, however is perfect for far away shots, walking and talking shots, or side of the head talking shots at quick changes of the camera