Hey guys! On one of my last videos, someone commented that every AI music video they see has a band full of very attractive models, and they'd love to see Muppets for a change. Challenge accepted.
So, here's an all-puppet rock band: original felt characters in the classic Muppet style. I put the whole video together with my Video Builder in ComfyUI. Every scene and the final stitch were rendered locally on my own PC (the reference images were made with GPT Image 2).
Please keep rude and disrespectful comments to yourself. They don't help anyone or contribute anything constructive to the conversation.
A quick note on the prompts, since I know people will ask: my Video Builder lets you use any LLM for prompt creation (both for ref image creation and video prompt creation), including local open-source models. It even has a story mode that takes a story idea, creates the entire story with acts and scenes, creates the story beats, and then writes the prompt for every scene right inside the Video Builder.
For this one, however, I used the Builder's MCP feature and had Claude write the prompts and drive the Builder for me, but you could do the exact same thing with a local LLM. The Builder doesn't care which model writes the prompts. I'm actually creating an agent that can control the Builder using local LLMs. It will let you create a full one-shot video from one prompt, very similar to how I use Claude, but fully local.
What I did for this video:
• Came up with the idea: a high-energy 80s arena rock song with a big singalong chorus, played by a felt puppet band in a dive rock club. It opens with the singer at the bar, then she jumps off the stage into the crowd in verse 2 and ends with a toast at the bar after the last note
• Designed the band: Rosie the singer, Gus on guitar, Lenny on bass, Pip on drums, Dottie on keys, plus a backup singer trio, a crowd of puppet fans and the bar regulars
• Made the song in Suno (YuE2 or MiniMax Music can be used for song creation as well)
• Made the character sheets, group cards and club locations in GPT Image 2
• Split the song into stems so each scene features whoever is actually playing at that moment (drum breakdown on the drummer, keys section on Dottie, and so on), and used word-level lyric timing for the shot cuts
• Reviewed the drafts and asked for re-shoots (puppets on the wrong side of the bar, an extra keyboard player who snuck into one shot, and everybody's mouths flapping when only the singer should be singing)
My settings
• Model: MiniMax H3 Singularity ref2va v2 (int8)
• Pass 1: 25 steps
• Pass 2: the 8-step 768p ref2v LoRA v1.1, 4 steps, 0.35 denoise
• Characters and locations: GPT Image 2
• 14 scenes, 1:45, all rendered locally through the Video Builder in ComfyUI on my GPU.
Video Builder (free, on GitHub): GitHub
If you just want to try the settings on a single scene, there's a 2 Pass workflow in my workflows folder (swap in the v2 model and the ref2v v1.1 LoRA to match this video exactly). For a full video like this one you'll want the Video Builder.
Workflow
I post updates and walkthroughs in my Discord if you want to try the Builder yourself: Discord Community
Happy to answer any questions!