Results 1 to 10 of 10

Thread: Active Kinect retargeting using the Nevron Genoma preset...95% there....

  1. #1
    Member snsmoore's Avatar
    Join Date
    Apr 2005
    Location
    Santa Rosa, CA
    Posts
    200

    Active Kinect retargeting using the Nevron Genoma preset...95% there....

    I'm almost there....here are the steps I used to get my character to follow the Kinect, with a bit "stair-steppy" deforming, especially when the arms are at my side.

    1) Load the character into Modeller
    2) Add the Genoma Nevron preset
    3) Adjust body (points) of rig to match character
    4) adjust arrows for finger direction
    5) Export to Layout
    6) Set object’s subpatch level to 1
    7) Change view mode to bounding box to speed things up
    8) Choose Setup-> Genoma-> Create Rig to create the Genoma rig.
    9) Go back to textured view (no more bounding box)
    10) Set bone x-ray
    11) Test the green controllers to make sure they deform the character
    12) Save the scene if the previous steps are working well.

    (this really is a good place to save)

    13) Make sure the Kinect is functioning properly in the Device Manager (status should be ready on the Kinect_A device and when you click the open, you should see the Kinect view and the Kinect skeleton)
    14) Load the Kinect_Skeleton.lws scene to test out whether or not Layout enables the Kinect to modify the skeleton.
    15) Load objects from scene – use the Kinect skeleton scene
    16) Access the Studio window by going to Virtual Studio->Studio.
    17) Click the Active and LIVE! Buttons.
    18) Test the Kinect, if all is working the green skeleton bones will move as you move.
    19) Now reload your scene (from step 12). (Note: Steps 14-18 may not be necessary when things stabilize in the future)
    20) Now choose the “Load Items From Scene” menu option and choose the Kinect_Skeleton.lws scene and load based on the defaults (don’t load camera’s, lights which by default are unselected)
    21) Verify again that if you go to Studio and click Active and LIVE! that the green skeleton will move with your movements.
    22) Select one of the Kinect_Source_Rig bones, then go to the Items menu -> Select -> All -> Select All Bones of Current Object
    23) Turn the Active and LIVE! buttons off.
    24) Select one of the green (Kinect) skeleton bones.
    25) Use the menu option Items->Select->All->Select All Bones of Current Object
    26) Click the “y” then “n” to edit the rotations of the bones, setting the heading, pitch and bank to 0. (these seem to already be at 0, but do it anyway)
    27) Adjust the green Kinect skeleton’s size by selecting the master Kinect skeleton’s null (Master_SKL_Global_0 in this case) and adjusting the scale and position.
    28) Adjust the character using the green controls so that the character roughly matches the Kinect skeleton
    Note: the skeleton is not in a very good T-pose, which may be part of the problem.
    29) Access the Nevron Motion, panel. Since the Kinect skeleton is prefixed with “SKL0_” then specify SKL0_ in the Text input box and click the Source Modifier drop down box and choose the “Add Prefix” button.
    30) Click the “Retarget” button. (Magenta boxes should appear)
    31) Click the LIVE! and Active buttons.

    Almost there, except for some stair-steppy deformation happening....
    Click image for larger version. 

Name:	Active Kinect Retargeting Almost.JPG 
Views:	346 
Size:	55.1 KB 
ID:	116622

  2. #2
    Registered User
    Join Date
    Jan 2004
    Location
    Broken Arrow, Oklahoma
    Posts
    936
    Thanks snsmoore It seems your not the only one with issues. Lino, what was left out here? We know that the "stair steppy" deforming is not appropriate nor "good enough". When can we expect a video showing the workflow of the Kinect and Nevron?

    snsmoore this is a great step by step, if everyone else get's same/similar results there must be something we are not figuring out..surely. Please help Lino!!!

  3. #3
    Member snsmoore's Avatar
    Join Date
    Apr 2005
    Location
    Santa Rosa, CA
    Posts
    200
    Yeah, I'd be curious what results others get from the steps above or there are areas people see that I could have missed.

    note: I didn't use weight maps, might try that this weekend.

    -shawn

  4. #4
    Super Member LW_Will's Avatar
    Join Date
    Feb 2003
    Location
    Somewhere, Out there...
    Posts
    1,188
    yeah, me too!

    the workflow for this tool is a little jankie.
    Will Silver
    Animator
    digital TRiP
    "Frak'em all! I USE LIGHTWAVE!"

  5. #5
    Member snsmoore's Avatar
    Join Date
    Apr 2005
    Location
    Santa Rosa, CA
    Posts
    200
    Tried another test today to see if recorded motions on the Kinect Skeleton exhibit the same behavior as the live Kinect capturing and indeed they do. So there must be some general issues with the Kinect skeleton when mapping them in Nevron.

    From other examples it seems like manual retargeting using other types of motion capture files seem to be working. I need to try an example using some other capture source. (need to search for some good capture samples)


    -shawn

  6. #6
    Super Member LW_Will's Avatar
    Join Date
    Feb 2003
    Location
    Somewhere, Out there...
    Posts
    1,188
    Okay... I've got the Kinect hooked up, got the retargeting down pat, BUT...

    I cannot get the dash naggit kinect skelegons to work! I think I've tried everything that I possible could.

    What are the steps to get the Kinect to drive the skeletons in Layout?

    Thanks.
    Will Silver
    Animator
    digital TRiP
    "Frak'em all! I USE LIGHTWAVE!"

  7. #7
    TD/Animator lino.grandi's Avatar
    Join Date
    Jun 2003
    Location
    Rome
    Posts
    1,700
    Among the videos we're making, one will explain the Kinect/Nevronmotion workflow (and of course the final docs will deal with it).
    Lino Grandi
    3D Development, LightWave 3D Group/NewTek, Inc.

    https://www.lightwave3d.com/

    LightWave 3D Group YouTube channel:

    http://www.youtube.com/user/Official...?feature=watch

    My YouTube Channel:

    http://www.youtube.com/user/linograndi?feature=mhee

  8. #8
    Super Member LW_Will's Avatar
    Join Date
    Feb 2003
    Location
    Somewhere, Out there...
    Posts
    1,188
    Quote Originally Posted by lino.grandi View Post
    Among the videos we're making, one will explain the Kinect/Nevronmotion workflow (and of course the final docs will deal with it).
    Lino, all I will need is a simple set of instructions. Please. Simple! ;-)

    Thanks a bunch!
    Will Silver
    Animator
    digital TRiP
    "Frak'em all! I USE LIGHTWAVE!"

  9. #9
    Member snsmoore's Avatar
    Join Date
    Apr 2005
    Location
    Santa Rosa, CA
    Posts
    200
    Lino,

    Even if you could look at my steps at the beginning of this thread and point out what I may be missing that would be great!

    -shawn

  10. #10
    Banned OnlineRender's Avatar
    Join Date
    Dec 2008
    Location
    Glasgow , Scotland , UK
    Posts
    6,359
    ok I can get it to drive the character but he flys around the scene rather than follow the Kinect Data after I have targeted

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •