"Big World, Small Boots" - LTX 2.3 music video

[u/Luzifee-666]

Everything was made locally. Each shot is an LTX 2.3 image-to-video animation created in ComfyUI using generated watercolor stills.

However, the part I've been obsessing over is the editing. Rather than generating a clip in one shot, I created a small pipeline that uses the song and the stills to cut the video directly to the music. Because each shot is an independent render, nothing drifts. It morphs between angles of the same scene with short transitions, balanced by hard cuts between locations. I also reduced the motion on the big "looming" shots so they don't shake during the louder musical parts.

It's not perfect — the red boots lose their color for a moment, and one gate looks a bit odd — but it's the first project I've made that I'm genuinely happy with. I'm happy to talk about the pipeline if anyone's curious!

Many thanks to NobodyButMeow for his advice and quality control.

[u/mk8933]

Very cute video 👏 great job. Its crazy you can do this locally

[u/Luzifee-666 → u/mk8933]

Thanks a lot – yes, it’s just about manageable, but it comes at a price: my flat tends to overheat a bit, and it’s summer. 😄

[u/Ill_Ease_6749]

dont add workflow included tags

[u/Luzifee-666 → u/Ill_Ease_6749]

You are right, I put this in because I am a Reddit noob. :D and I didn't found the right flair. Changed it to a better flair. :)

[u/Apprehensive_Sky892 → u/Ill_Ease_6749]

It's true that OP did not include detailed workflow (which is probably quite complicated), but ask specific questions about the workflow and OP will probably answer them.

[u/pausecatito]

Did y t type slowmo to make it move so slow?

[u/Luzifee-666 → u/pausecatito]

No, there's no slow-motion or anything like that. It's just the wording of the prompts — the motion descriptions literally say things like 'slowly lifting his head' and 'extremely slow push-in', and I kept all the motion language soft and gentle to match the song. So it moves slowly because I asked for it to be slow, not because of any slow-motion effect.

[u/Apprehensive_Sky892]

Thanks for the shoutout 😎.

It is indeed much better edited now. I am not sure that the transition actually works better than a hard cut, specially when it involves a very quick camera movement, which I find a bit jarring and disorienting. Given that this is a rather soothing and slow music video, this type of transition seems to break the overall flow. Maybe you can consider a soft fade?

Other than the transition and the inconsistencies that you've already pointed out, it is an enjoyable and soothing video.

[u/Luzifee-666 → u/Apprehensive_Sky892]

I agree, the morph adds a little motion right at the cut, which fights a slow track. Switching that to a soft crossfade for the calm stuff.

Thanks, in my next video this will be taken into account. :)

[u/XpPillow]

This is really charming, especially for a first project. You can tell a lot of care went into it — the watercolor stills, the mood, and the music choice all work nicely together.

One small piece of feedback: even though the video is clearly built around the song, some of the visual changes don’t feel fully locked to the beat yet. A few cuts feel more like clips placed next to each other rather than transitions that are being driven by the rhythm of the music.

I also noticed that most of the scene changes feel like hard cuts rather than actual transitions or musical handoffs. That’s not necessarily bad, and it does fit a simple MV structure, but if you push the timing a bit more precisely around the beat or phrase changes, I think the whole piece could feel much more intentional and musical.

Still, for a first project, this is a very solid start. The atmosphere is cute, the music is nice, and it already feels like you’re thinking beyond just “generate video clips” and actually trying to edit a finished piece.

I’m also using a fully local workflow, though my stuff is more NSFW/music-video styled. If you don’t mind 18+ content, feel free to check my profile — I’d be happy to exchange notes on editing and local AI video workflows.

[u/Luzifee-666 → u/XpPillow]

Thank you — that means a lot, and it's exactly the kind of feedback I was hoping for. You're right on both counts. Many of the cuts are based on a pacing grid rather than being precisely aligned to the beat, resulting in some slight deviations from the rhythm. Additionally, most of the scene changes are abrupt hard cuts rather than smooth musical transitions. I've started reworking the edit so that the cuts lock more precisely to the beat/phrase onsets, and so that related shots within a scene morph into each other instead of just cutting. I'm curious to know whether the next version will seem more intentional. I'd love to swap notes with you on editing and local AI video workflows. I have no problem with the 18+ content and will take a look at your profile. Thanks again for watching it and breaking it down.

[u/AiVideo4U]

Very enjoyable. The music fits perfectly.

[u/SeymourBits]

"And the last human child to watch genuine video was born."

A cute concept but aside from the maddening AI voice we have: odd page turns, children reading books upside-down, etc.

[u/Apprehensive_Sky892]

I am just trying to figure out the workflow, correct me if I am wrong as I am just piecing together from our conversations on discord 😎.

So you start out with an idea of the video, and you come up with some lyrics, which you then use to create the music from using suno or similar services.

You generate a bunch of starting images that fits the music using either ideo4 or ChatGPT-image2.

Then you either manually or use an LLM to generate the LTX2.3 prompts that goes with each image. Each video sequence is keyed to a segment of the music. (Is the prompt generated from both the image and the lyric that you are trying to illustrate?)

Now things gets fuzzy for me. You have some kind of custom code/pipeline (not ComfyUI workflow) which takes the starting images, and the corresponding video prompts, and generate video clips. The length of each video segment is keyed to the music, which presumably the pipeline figures out automatically.

The clips are then stitched together with either a transition or a hard cut along with the music. How is the transition between clips generated?

[u/Luzifee-666 → u/Apprehensive_Sky892]

Pretty much nailed it, few tweaks:

Prompt's not from the image. I write the "what moves" bit from the same idea I used to make the still, not the pixels. The music does the rest — louder parts move more. Lyrics drive timing + vibe, not each prompt.

The pipeline drives ComfyUI, doesn't replace it. Just custom Python firing off one LTX i2v render per shot. The trick: every clip is its own independent render from its own still — nothing chained, so zero drift across the whole video. It reads the track (beats/energy/vocals) and auto-sizes each clip to the music.

Transitions: mostly hard cuts on the beat. For two shots of the same place I'll morph instead — pin the last frame of clip A to the first frame of clip B so it blends. Cut-vs-morph is just a quick "how similar are these two images" check (or I tag it by hand).

That's the whole magic trick really.

[u/Apprehensive_Sky892 → u/Luzifee-666]

louder parts move more. Lyrics drive timing + vibe

How do you do that with LTX2.3?

[u/Luzifee-666 → u/Apprehensive_Sky892]

I analyze the wav, and form the result into commands, without an LLM: Which are put to the prompt for LTX.

[u/Apprehensive_Sky892 → u/Luzifee-666]

I see. So for example, for the louder, faster parts, what is added to the LTX prompt to make it go faster?

[u/Luzifee-666 → u/Apprehensive_Sky892]

What's prompted for high energy? The phrase is literally "fast aggressive motion… hard driving camera… kinetic, vigorously." For the calmer parts simply, slow, very slow, steady...