View Full Version : Facial Capture for LW?

10-16-2006, 04:01 AM
Does anyone have field experience of using facial capture with LW? If so, could you point me at some appropriate tools for this? I've got a gig coming up where this could be really beneficial, but I honestly wouldn't know where to start when it comes to speccing software tools for this.

Thanks in advance.

10-16-2006, 07:36 AM
Bog track down Ben Simth he's worked on a couple of jobs one was a baby and the other a dog (there was a article about it in 3D World a while ago).

Maybe not actual tracking as no doubt that requaires another application but he used LW to make the above subjects speak.

try here http://www.redstarstudio.co.uk/

10-16-2006, 07:48 AM
It was hand-done... You can do that if you wish Mark, but I'm sure that Ben would seek to dissuade you! :D


10-16-2006, 08:10 AM
By facial do you mean tracking or scanning?

On the scanning side there's a link by StereoMike over on spinquad for a free up and coming scanner...
Essentially buy your own lazer level and go :) (I'm guessing there would be a heck of a lot of clean up work involved though)
On facial tracking I saw some software a while ago, think it was an application but the demo video was outputing to max. (don't think the price could be described as anywhere near reasonable :devil: ) . Can't find any links to it unfortunately.

10-16-2006, 08:52 AM
I mean tracking - I'm looking at a project that's got a *lot* of lip-sync for it's buget (about 5 minutes), and seeing as it's just little old me (second-rater that I'm assured I am ;) ) doing it, the thought of plausibly keyframing that many frames and landing with both boots solidly on the uphill side of the Uncanny Valley seemed a bit... um... tough. So I thought to look to capture/tracking.

I seem to recall a couple of different systems that would work with a normal video camera (some with dots, some just reading the face au naturale), but I'm deuced if I can remember their names. Or, for that matter, how to find out if they're worth it.

10-16-2006, 09:02 AM
What about Mimic (http://www.daz3d.com/shop.php?op=itemdetails&item=1993) from DAZ? Not as good as a face capture system but it could save you a bit of work over doing it by hand.

10-17-2006, 04:44 AM
You find something do reply on this thread or on my PM will you Bog?
Ive went through motion capture, and find out it wasnt good enough for what Im interested. Fascial tracking was then at its beggining stage, and I think they did that with light bulbs on various faces. But that was a year and a half ago. Who knows what may have came up ever since.

10-17-2006, 04:50 AM
I did wonder if Logitech's camera systems might be persuaded to do this. It would seem to be a neat use of their software, which tracks facial characteristics to overlay effects. Might be worth dropping them a line.

10-17-2006, 04:53 AM
Have you seen proFace? http://www.famous3d.com/3d/products/proFACEmocap.html

There's a version for working with video footage as well. http://www.famous3d.com/3d/products/proFACEvideo.html

10-17-2006, 04:55 AM
Best I can find from a quick Google search is :

http://www.inition.co.uk/inition/product.php?URL_=product_mocaptrack_x_ist_facetrac ker&SubCatID_=19

which also appears here : http://www.vrealities.com/facetracker.html


10-17-2006, 05:17 AM
Diedond, my PM box was full - please send your PM again.

I'll be giving every suggestion here a try in due course. Thanks very much for the intel so far, people :)

10-17-2006, 07:01 AM
YEEOUCH, vrealities facetracker.

Maybe it's just me but $8750 seems a bit pricey for a webcam on a stick.

10-17-2006, 07:09 AM
SynthEyes (http://www.ssontech.com/) is a capable program. To be fair, I've not really used their facial tracking feature on paying jobs yet.

I've used it mostly for matchmoves to import into LW. However, I can say it's a GREAT program (I've been using it for about a year or so). And in the facial section, it looks like it's got promise.

You'll need at least 2 cameras (DV can work) and you'll have to do a calibration with a funky star ball thing (not really hard).

They have a demo to download and play with too.

Good luck!

10-17-2006, 07:11 AM
This probably won't be to helpfull to your quest, but it's interesting nonetheless.

These chaps are using advanced face tracking tech to fly over models of Hawaii and play Quake :D

Seriosly though, the articles informative.


10-17-2006, 08:45 AM
YEEOUCH, vrealities facetracker.

Maybe it's just me but $8750 seems a bit pricey for a webcam on a stick.

I thought so, but it was the only immediate solution that google threw up.

That said, I was quite impressed with Logitech's webcam face tracking (seen by chatting to relatives in the UK via Skype). If they could expose their application to developers or just dump raw data, it would make a very inexpensive device for this kind of use. *shrug* It might be worth a good portion of the LW userbase dropping a note to their customer service department, or, alternatively, trying to persuade a keen developer to look into hijacking their app/camera/whatever.

I wasn't aware that SynthEyes provide facial tracking, though. I'll have to take a look :)