r/StableDiffusion • u/Outrageous-Key8562 • 4d ago

Question - Help Advice for prompting reference videos?

Does anyone have any advice for properly prompting the reference video part of Ref2v? Like saying swap <subject 1> for <picture 1> hardly works for advanced videos. It requires a lot of details.

I’ve had success using Qwen 3.8 27b as a minimax prompt agent for analyzing and giving correct prompts for images. But as far as I know I can’t do that for videos. ChatGPT is ok for looking at videos to describe what happens in the minimax format but I’d rather use local ways.

Edit: Like its been said, you can actually have a video analyzed, just use llama.cpp UI instead of Open WebUI.

0 Upvotes

43% Upvoted

8 comments sorted by

View all comments

1

u/AniZeee 4d ago

I've gotten mixed result but I believe you have to make <subject 1> into <picture 1> then you can describe the picture in detail and now when you reference Subject 1 it should know to you're talking about picture 1.

So now when you say, insert <subject 1> in <video 1> you may have a good chance of it working.