Results 1 to 8 of 8

Thread: Nevron Facial Capture

  1. #1
    Often Banned Megalodon2.0's Avatar
    Join Date
    Oct 2012
    Location
    Midlothian, VA
    Posts
    1,029

    Nevron Facial Capture

    Okay, I understand the AU - animation units - that Lino showed in his great video: NevronMotion - Kinect Facial Control

    However, is it possible to acquire eye blinks and eye movement through the Kinect? It seems that the facial capture is quite limiting, though I'm hoping that it's just because it hasn't been well documented. Will there be more Animation Units available to connect via the Kinect?

    I already have Nevron and have just ordered a Kinect. Lino did a great job showing how it works (and I hope it's as easy to setup as he shows) but it would be great to have more "channels" for greater facial movements. Is this possible?

  2. #2
    Eye blinking and eye movement isn't tracked by the Kinect to my knowledge and even if it was the resolution likely isn't high enough to track it reliably. One-sided actions such as a raised eyebrow isn't something you can do with the Kinect in Lightwave out of the box.

    You can, however, tie up the things the kinect does track and attach them to just about anything in Lightwave. Example: You could take the head rotation and hook it up to a null that drives how the eyes move; you'd have to do it in a separate animation pass, but it is an option.

    Also, at least with my face and available lighting setup I have a lot of trouble getting solid results when it comes to the eyebrows, so from my experience the greatest value you get from the Kinect facial tracking is fast lipsyncing. I don't do a lot of hand-animating anymore when making characters talk... that's a drudgery task I won't miss doing.
    Last edited by Ryan Roye; 04-27-2014 at 07:31 PM.
    Professional-level 3d training: Ryan's Lightwave Learning
    Plugin Developer: RR Tools for Lightwave

  3. #3
    Often Banned Megalodon2.0's Avatar
    Join Date
    Oct 2012
    Location
    Midlothian, VA
    Posts
    1,029
    I was afraid that might be the case. Sad that eye blinking at the very least isn't supported since THAT is a pretty big element of facial capture. Animating eye direction is something I was doing manually already, so that isn't too bad. But once you've got the primary facial motions captured with the Kinect, how easy is it to add eye blinks manually?

    I'm just looking for the subtleties of facial animation. I've used TAFA and really like it, but my limited expertise in animation makes it difficult to create the nuanced facial animation I'm looking for. We've got an Optitrack mocap system that works very well and has saved us an incredible amount of time, but I've been avoiding adding their facial capture system and Nevron looked like it had potential. It still might - I'll find out.

    Thanks!

  4. #4

    i'd rather add endomorph blinks later to be honest, as it's fairly easy to do, and gives precise control...

    for Face Cap though, it wouldn't surprise me if that Optitrack mocap has much better precision than Nevron Facial Cap
    Last edited by erikals; 04-28-2014 at 02:30 AM.
    LW vidz   DPont donate   LightWiki   RHiggit   IKBooster   My vidz

  5. #5
    Registered User
    Join Date
    Feb 2012
    Location
    Austin, TX, United States
    Posts
    164
    Was there more replies to this thread earlier today? I swore I saw various replies by chazriker about facial motion capture and some videos he had done posted somewhere but now I can't find them. One video featured the alien and one of his characters and how he was talking about doing multiple captures for neck or head rotations. I was going to watch them. Chazriker are those videos on a website somewhere?
    It's better to have tried and failed, than to have failed to try.
    Patreon - www.patreon.com/ernesttx

  6. #6
    Often Banned Megalodon2.0's Avatar
    Join Date
    Oct 2012
    Location
    Midlothian, VA
    Posts
    1,029
    Quote Originally Posted by erikals View Post
    i'd rather add endomorph blinks later to be honest, as it's fairly easy to do, and gives precise control...

    for Face Cap though, it wouldn't surprise me if that Optitrack mocap has much better precision than Nevron Facial Cap
    That's what I do now through TAFA. But as I see it, Nevron uses endomorphs as well - so can you bake out the Nevron motion capture and then ADD endomorph blinks?

    And yes, I'm sure the Optitrack system is far more accurate, but it's also around $2k just for the software. (Fortunately I could use the same cameras that I use for full body capture.)

  7. #7
    Quote Originally Posted by ernesttx View Post
    I swore I saw various replies by chazriker about facial motion capture and some videos he had done posted somewhere but now I can't find them.
    This thread contains all of the Nevron-related videos i've done.
    Professional-level 3d training: Ryan's Lightwave Learning
    Plugin Developer: RR Tools for Lightwave

  8. #8
    Registered User
    Join Date
    Feb 2012
    Location
    Austin, TX, United States
    Posts
    164
    Thank you Chazriker. I found some of YouTube. Good stuff.
    It's better to have tried and failed, than to have failed to try.
    Patreon - www.patreon.com/ernesttx

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •