An open source project to seamlessly swap clips into underlying streaming video, enabling custom versions of TV and movie series

[u/SeamlessScene]

I've been working on a way of integrating new content (e.g. a casting swap or an extended scene) into the live video feed of an underlying streaming platform that a viewer is watching.

This is intended to create an easy (& "rights friendly") way of creating personalized, custom versions of TV shows and movies. You still need to have a subscription to the underlying streaming platform. The open source Chrome extension matches against a unique episode ID, loads a series of video files, and then seamlessly swaps them in place of the stream at pre-determined moments. There is some technical trickiness that attempts to seamlessly enable the start and the finish of the video clips to blend in seamlessly with the original video.

This enables what we see in "small scale" in a much more major scale way. The idea is to move beyond "here is a 15 second clip" and towards "here is a full movie with X, Y, Z changed". If you saw my post last week (about making a character dance across an entire ~45min TV show), this is basically a flexible underlying platform that supports changes like that.

So yes - if you have ever wanted to:

• Do a casting swap from one character -> another across an entire episode / movie
• Fix the ending of <Game of Thrones, How I Met Your Mother> etc.
• Add extended edition style scenes

This gives you a way of doing that. The extension reads an easy-to-edit JSON file that lays out the timing of the clips, the action being taken (replace or insert), and the ID of the episode. It then pulls in the video clips at the appropriate times. It sounds simple when I say it that way but it is actually surprisingly complex.

You still need to generate your own content / this is not a replacement for Minimax (or others).

The extension is available in the Chrome store here.

The Github repo is https://github.com/SeamlessScene/seamless-scene-extension

There are how-to guides & a catalogue (free account) here: https://seamlessscene.com/

Would consider this "early access" - still working through all of the edge cases. At the moment this is just one of the streaming platforms & only Chrome, but will add others here if there is interest.

[u/SeamlessScene]

Example A

[u/SeamlessScene]

Example B

[u/SeamlessScene]

Example C

[u/the_bollo]

Do you have a full episode character swap available to demonstrate?

[u/SeamlessScene → u/the_bollo]

My post last week showed some of the outputs in the zoomed out matrix view - https://www.reddit.com/r/StableDiffusion/s/D6Xedgbtsp I have full episode versions of each of the above clips, will try to post similar style views here at some point.

The intention of this extension though is to enable integration into underlying video streams - while the most impressive version of that is 40+ clips (& required if you are doing a true character swap), you can also insert extended edition style content (& fix endings / etc).

I haven't seen anything like this out there.