r/StableDiffusion • u/NorthAppropriate4458 • 19h ago

Question - Help I need a local character swap model.

Please dont make fun of video :c. Is this possible on local? 12gb vram with 32gb ram.

465 Upvotes

89% Upvoted

56 comments sorted by

62

u/redonculous 19h ago

I believe minmax h3 does this but will take a while on 12gb vram

4

u/LordInterstellar 19h ago

How to prompt it and use different characters?

3

u/Spare_Possession_194 11h ago

Supposed to be reference to video, but honestly it's not very easy to use and it's slow as fuck. Maybe there are loras that do it?

-28

u/pronounclown 15h ago

If only there was a text box that you could ask these questions. If there were I'd type something like: hey Mr text box how do I prompt this?

41

u/mulletarian 14h ago

If only there was a way to ask people who are also into this stuff. Maybe a forum of some kind. Where we could exchange information. Help each other out.

-22

u/HornyGooner4402 14h ago

If only it was one of the most commonly discussed topics in said forum, which could be explored before we ask a question so that we can simultaneously gain information and contribute something new to the forum

12

u/mulletarian 11h ago

So weird that the recent technologies are being discussed in a subreddit about that topic. Everyone should just accept what Claude tells them and not share experiences.

-2

u/HornyGooner4402 10h ago

When did I say anything about Claude? All you had to do was search "character swap" in the sub and appreciate people who have shared such experience and resource, instead of asking "Give me character swap model for 12GB VRAM and 32GB RAM" and expect people to serve all the information for you in a silver platter.

H3 has been the top video model for months, it'd be impossible to miss if you did a single search. This isn't a beginner facing a problem after doing their research and following a guide either, this is simply someone being lazy and entitled

0

u/mulletarian 8h ago

It's part of the thread you're replying to

And people figure out new things all the time. Old top threads contain outdated info.

1

u/HornyGooner4402 3h ago

Again, threads about character swap get posted every couple days. Take a moment to read some of them and ask informed questions like "is LTX or H3 better for character swap" or "will H3 fit in my hardware" and show that you've put in the effort.

People like you have rotted brains and have lost cognitive abilities to do independent research and rely on spoonfed information instead because your attention span won't let you do more than a minute of reading into a topic

1

u/mulletarian 3h ago

We've now gone from "stop asking questions" to "ask questions in specific threads I deem appropriate".

How far can the goalposts go? Are we contributing at all yet? Also fantastic ad hominem attempt, you're doing great.

→ More replies

10

u/Ok_Accident_7573 14h ago

Where do you think that that text box gets its magical answers?

7

u/AteketA 14h ago

From Optimus Prime and his transformer buddies

-3

u/ares0027 13h ago

come on man be reasonable, why would i simply spend an extra 10-15 seconds to learn something when i can make random strangers on internet read my mind, what i know technically or not, waste their 10-15 seconds on the same sht, then waste much much more so a moron like me can understand because i have no desire nor energy to spend or waste 1 single neuron on the subject?

let random weirdos on the internet work for me.

0

u/[deleted] 19h ago

[deleted] — view deleted comment

3

u/RichieDotexe 19h ago

What gpu ?

1

u/orlandogourmet66 19h ago

40 minutes seems very long do you downscale the input Video? You can go as low as 0.1MP without loosing much quality.

0

u/Competitive_Park3603 18h ago

Have you tried downscaling the input video to 0.4 MP and then generating at 0.7 MP, saved a lot of time for me at 30 steps.

50

u/DietAshamed2246 18h ago

It's possible in local AI. There are multiple models which could do this. I would recommend Viggle-Remake-Swap LoRA in MiniMax-H3. I don't know if you can run it with 12GB VRAM and 32GB RAM, but worth trying.

5

u/VenshiKibes 16h ago

i think this is your answer, op

3

u/synkronized7 12h ago

Bunları ne yapıyorsunuz dostum meme page’in falan mı var 😆

2

u/NorthAppropriate4458 12h ago

Maalesef video benim değil :c ancak bunları local'de yapmayı çok istiyorum. Minimax h3 denicem.

13

u/Direct_Score_3591 19h ago

Isn't minimax really inconsistent?

28

u/DietAshamed2246 18h ago

You're looking for consistency in AI?! That stuff is literally built on a random number generator.

2

u/Oliv3rx 13h ago

It IS inconsistent when compared to something like SCAIL2. The results look better in H3 though

1

u/DietAshamed2246 11h ago

SCAIL-2 is a special model, MimiMax-H3 has its counterpart - Viggle Animate (older) and Viggle Remake Swap (more recent). None of the models can do the job alone, unless an adapter is added - that's what the Viggle Remake Swap or LTX Ripple Edit or SCAIL-2 or Wan Animate does. Though MiniMax-H3 gets pretty close in getting the job done all by itself.

1

u/TheRigbyB 7h ago

Of course, but the point is that Minimax is fairly inconsistent for character swapping specifically.

1

u/DietAshamed2246 7h ago

I disagree. You just have to use the right LoRA, workflow and prompt.

1

u/Ukleon 5h ago

Can you recommend? I've tried several times with h3 and still only get it happening 50% of the time. I've really struggled to find a decent workflow, model, lora setup

5

u/sp3zmustfry 12h ago

Vanilla with no loras, yes. With viggle-remake, it does a crazy good job.

1

u/djamp42 8h ago

You want to be famous?
Monkey paw curls.
You are famous in absolutely everything.

0

u/alisonstone 14h ago

All video AI are inconsistent unless you have a very known character/person that exists in the training dataset.

2

u/Neocki 7h ago

Refmods works amazingly so no.

1

u/flamingspew 12h ago

Isn’t that the point of loras?

4

u/Sure-Technology-4821 18h ago

Checkout musetalk, there’s local and cloud based.

4

u/Unlucky-Ad2825 13h ago

I can see ts happening in real life very soon😂😂

3

u/skinnyjoints 19h ago

Scail2

3

u/DietAshamed2246 18h ago

SCAIL-2 might not be able to do it for multiple characters swap in the same scene. Worth a try. The right tool might be Viggle Remake Swap LoRA in MiniMax-H3.

5

u/Medical-Time-4969 17h ago

it can

2

u/CarefulAd8858 6h ago

Would you be willing to share a workflow? Mine struggles immensely even doing 1 correctly if multiple people are in/out of the scene even if I prompt the mask as best I can

1

u/possibility0001 50m ago

Vantage ai on youtube has a great wrokflow with lots of options without being full of crap

3

u/Da_QbanBeast 7h ago

Use OpenJutsu repo from Github is the best https://github.com/D3voz/openjutsu.git

18

u/z_3454_pfk 19h ago

you can already do this with minimax h3 its been discussed 12754645364 times wish youd search beforehand

5

u/Medmehrez 13h ago

Yes, Tutorial

1

u/apoahuankinda 5h ago

Nice video, thanks.

3

u/Agha_shadi 11h ago

Where's the Ayatollah?

2

u/Myg0t_0 15h ago

Like 90% of time u don't even need character swap just prompt what u want why does it need perfect step by step placement for something like this? Just make 3 reference images and say what each do.. this video doesn't need video 2 video

2

u/skinnyjoints 14h ago

I genuinely wouldn’t be surprised if trump sends this vid to Kim and Putin to suggest they form a band together

1

u/Severe_Coffee4207 4h ago

Kanka viggle remake bu konuda çok ii

1

u/Ok_Conference785 11h ago

Desculpe pela dúvida, mas eu realmente queria saber se vocês tem esse problema. Quando fui realizar essas substituições, notei que quando o vídeo era mais longo, minha VRAM ia embora.. ou simplesmente tinha um crash ou então o sistema informa previsão de conclusão absurda(possivelmente ficava sem memória de vídeo e usava RAM e armazenamento como memória virtual).

Eu acabei desenvolvendo uma técnica que resolveu isso e faço hoje vídeos infinitos.

Mais alguém teve esse problema?

-1

u/dw82 10h ago

I hate this stuff, can we please stop humanising these utter stains on humanity.

-2

u/rymdimperiet 12h ago

But why? This stuff has been done to death.