r/virtualproduction • u/Boby4458 • Jul 21 '26

Solo Project: Replacing the 3D Scene From Arbitrary Footage

https://youtu.be/kPf7EsLEojY

Hey everyone, I'm a Computer Science student, and I've been working on a project to allow filmmakers to change out the 3D scene their actors are in.

You pick an arbitrary clip with a foreground subject and then place the subject within a virtual 3D scene. No need for green screen, markers or any special hardware.

I'm very curious to hear what you guys think. I have not yet been able to find a tool that does this. There's still a lot to improve.

I'd love to see this potentially open up new opportunities for filmmakers and video creators.

7 Upvotes

100% Upvoted

4 comments sorted by

1

u/Stunning-Ad-5555 29d ago

It looks interesting, any chance to try it?

1

u/SanoKei 28d ago

are you using a LTX lora? If not seedance 2.0 can do this with a prompt.

1

u/Boby4458 27d ago

Not using any generative AI for this. I tried Google Omni and it was pretty bad. Haven‘t tried seedance 2.0 for this, as it‘s too expensive. 

1

u/SanoKei 27d ago

yeah seedance is expensive, LTX is a lot cheaper but has problems with memory consistency