PDA

View Full Version : no more bluescreen or rotoscoping... zdepth from camera footage!



jin choung
02-24-2008, 01:18 AM
http://www.news.com/8301-13580_3-9874436-39.html

always wanted this. always wondered how it was gonna go down.

thought maybe using a rangefinding laser and that records depth info simultaneously onto a separate track on video or something....

but it looks like something like this may be the way forward!

can you imagine? you never have to worry about separating foreground from bg again! you have the equivalent of a liveaction .rla!

and focusing can be done AFTER THE FACT. just like a .rla, .rpf 3d render.

all experimental now and probably will appear as still photo equipment first. but i have no doubt this is going straight to hollywood and then hopefully straight to my prosumer/consumer hd camcorder!

jin

akademus
02-24-2008, 01:37 AM
Let us wait patiently for your (and my) wishes to come true... neat!

pooby
02-24-2008, 04:20 AM
That's great but until then..
Hasn't someone made a plugin that can gauge Z depth using an offset secondary camera's footage? - Surely that's possible - I could almost work out an algorithm for that myself (and I'm shite at maths) ..

jin choung
02-24-2008, 04:43 AM
there's stuff that can figure out depth from a moving camera using parallax info... just like for camera tracking. there's at least a siggraph paper on it if not an actual product.

but this takes all limitation off. no need for moving camera parallax because the separate views of each element generate their own.

jin

KillMe
02-24-2008, 04:44 AM
That's great but until then..
Hasn't someone made a plugin that can gauge Z depth using an offset secondary camera's footage? - Surely that's possible - I could almost work out an algorithm for that myself (and I'm shite at maths) ..

that is effectively all this is doing just doing many many times

for big screen filming though i would think that your method would have already been employed - guess teh cameras are so expensive though they dont wanna have more than one on each rig =)

all that said it cant completely get rid of bluescreen and rotoscoping since depth info isn't quite so handy when dealing with things at relatively close depths or identical depths for that matter and for say replacing a persons body with cg double subject matter going behind thigns you want to put and effect one etc etc etc

but will be useful for alot of things even if jsut simple stuff like adding a nice fog to a scene or having characters pass through objects like stargate does with tehg ate event horizon - always felt that was the weakest part of it never looks liek they gone through it perfectly =)

Mr Rid
02-24-2008, 05:07 AM
Actually, about 7 years ago I read about this Israeil company that had developed this tech for moving video.
http://www.3dvsystems.com/gallery/gallery.html
Demoed at NAB '02, I have no idea why it has taken so long to catch on.

The 3DV system keys and allows interactive 3D graphics in realtime, and tracks the motion of objects, people, or their hand as it waves around as in the 'Throw a ball at your TV' demo. It is a scanning device that sits right under the camera and records the depth alpha in a separate channel for use in post or realtime.

I have some earlier demos saved that are no longer on their site. This one shows how the eerie looking 3D alpha looks near the end-
http://www.box.net/shared/static/t9u5crmogo.wmv

But this particularly blew my brain of a 3D graphic tracing light and refraction on a live plate-
http://www.box.net/shared/static/lo1ioyi68s.mpeg

There was another site that had realtime 3D tracking I cant find now.

Exception
02-24-2008, 10:04 PM
Cool link Jin, thanks!

Definitely exciting.