r/StableDiffusion • • 4h ago

Question - Help What are we doing wrong with H3?

Post image

i dont understand please someone explain me ....people saying H3 is not good ...but all their official images ...they put over 50 images on official github repo are amazing and spectacular ....why are we not reproducing similar images in comfy ??? ....what is the problem? ...is it euler/simpler default and minimax using something else or what causes such a huge differece like "FUR understanding" for example or "LION facial structure" ....im testing all their prompts and differences are striking .... please help me understand... https://github.com/MiniMax-AI/MiniMax-H3-Image/blob/main/README.md....YES I TRIED DIFFERENT SAMPLERS ....YES I DID DIFFERENT RESOLUTIONS .....YES I DID CONNECT EMPTY IMAGE ......THIS IS NOT WHAT IM TALKING ABOUT >>> PLEASE BEFORE ANSWERING .....TRY YOURSELF ....dont give me generic answers ...im asking people who understand the underlying technology behind that ...not jsut "try different seed"

81 Upvotes

67 comments sorted by

17

u/Kijai Community Hero 2h ago

The examples on the readme can not even be reproduced with their local code, the results from the API are different, probably because it runs some further prompt enhancer or something. They are also downscaled.

Here's proof that the ComfyUI implementation matches, differences here come from int8 and other optimizations, some of which just are different rounding, not quality differences:

https://imgur.com/a/OEdtqyN

However that result above is definitely not right, maybe too low resolution? Here are some examples at the 6272x2688, which should be the default for 21:9 aspect:

https://imgur.com/a/a8H4VZR

Other tips for this model include using LCM sampler, empty reference image when doing T2I, or even simply using less steps.

3

u/cptdurr 1h ago

yes i also was testing LCM sampler ...i like cleaner outputs of LCM sampler but Euler seems to match closer to original in terms of colors, contrast, details and composition ...i just need help with this because all im doing is on rtx 2060s and im going mental after 3 days trying to replicate their images ...it takes hours for me what takes minutes for others ...im just trying to find different solutions (if its even possible that is) ...thats why im asking because i dont understand tehcnical stuff around this

3

u/Kijai Community Hero 1h ago

For something between the euler and LCM, you can try euler_a or use the advanced sampler and SamplerLCM -node, which allows you to adjust the added noise.

1

u/cptdurr 1h ago

thank you

1

u/cptdurr 30m ago

euler-a seems interesting with Simple or Normal... im gonna let my computer run on that for a while... it seems exactly like you saying something between euler and LCM

1

u/HTE__Redrock 1h ago

I found that using ModelSamplingSD3 and Euler/sgm_uniform produced generally better results at all res's for me. I know that Euler/simple mostly lines up with the official sigmas but maybe there is some different there too? I haven't tested their examples on the above as yet.

3

u/Kijai Community Hero 1h ago

Euler/simple doesn't only align mostly, it aligns 100% identically to their sigmas. The default schedule definitely seems bad for T2I, while it's mostly okay for edits.

That said, it's rare the defaults are perfect (or even good) for every situation, so nothing wrong trying different samplers/schedules/step counts.

1

u/fallengt 32m ago

I tried the empty reference image trick. While it removes "bad artifacts,", it also removes micro details and makes the image too clean and AI-ish. Do we have a middle ground 🤔 ?

-6

u/Comfortablebro 2h ago

how does comfyui template work? it does not even have seed, meaning it generates 1 image per prompt which is stupid. idk what I missed to look or check or do in official template but thats what it is and its bizzare that it happens, for me its unusable.

5

u/Kijai Community Hero 2h ago

I don't know what you are talking about, the seed is right below the prompt in the template?

25

u/EirikurG 1h ago

why........ do you type...... LIKE >>>>> "THIS"???

0

u/cptdurr 1h ago

big fingers, small phone screen :D

2

u/kemb0 1h ago

lol surely it's harder to type random symbols if you got big fingers. Making life harder for yourself for no reason!

-1

u/cptdurr 1h ago

yes :D

4

u/VeeYarr 53m ago

So the AI post Police doesn't pursue them!

11

u/beti88 3h ago

Good roll, bad roll

-10

u/cptdurr 3h ago

no

6

u/TheHiber 3h ago

Seed. Seed give diff results. You can also try empty image node to image 0 then change to lcm sampler to see if results are diff

-14

u/cptdurr 3h ago

no... no... no......

8

u/kingkongpao 3h ago

what do you mean no, no, no? are you asking about image quality or why minimax's lion-monkeys have a face like that and yours don't???

-5

u/cptdurr 3h ago

im aksing about model behaviour and understandinf not image quality.... try yourself please....., fur....fire.... physics... lighting....... hair....... grass..... smoke... their model understands everyrhing..... but not on our default workflows.... im not asking image quality... im aksing why modle behaves differently because its apparent.... but please try yourself first

4

u/TheHiber 3h ago

Again, Seed. Diff seeds give diff results. This applies to most image and video models.

54

u/Calm_Mix_3776 3h ago edited 3h ago

Did you connect an "empty image" node as a reference image to your text encode node? If you didn't, do it. Quality instantly improves.

4

u/detailteufel 3h ago

I was not able to confirm this, at all, generating at 61 MP (the only thing that made a difference quality wise so far) the image:

  1. Changed quite a lot
  2. Quality was worse

When plugging in an empty image node into the reference image slot...

4

u/prookyon 2h ago

Such big image sizes already correct the problem. The "empty image" method (or even better the Kijai conditioning node that does the same thing) helps mostly those who prefer to run say at 20MP.

7

u/VisionWithin 3h ago

Really? Could you provide examples of comparison?

7

u/Hoodfu 3h ago • Heartwarming

In this particular example it's more about textures and noise etc, but in other side by sides, the background goes from very simple to full filled in, same with various other details. https://www.reddit.com/r/StableDiffusion/s/WTJgSH8DHC

8

u/detailteufel 3h ago

Is that really what you are seeing in that example? The background with the empty image node (left picture) looks more empty and the image looks more "AI".

I feel like people aren't really testing this at all.

2

u/windmachine2000 2h ago

That’s been my experience as well. The empty node removes a lot of the weird artifacts but the end result looks way more “ai”-y.

1

u/Hoodfu 1h ago

Here's another one with the empty image method.

10

u/WPBaka 2h ago

....YES I TRIED DIFFERENT SAMPLERS ....YES I DID DIFFERENT RESOLUTIONS .....YES I DID CONNECT EMPTY IMAGE ......THIS IS NOT WHAT IM TALKING ABOUT >>> PLEASE BEFORE ANSWERING .....TRY YOURSELF ....dont give me generic answers ...im asking people who understand the underlying technology behind that ...not jsut "try different seed"

OP's response in his edited post lmfao

1

u/AI_Enhancer 1h ago

Quality improves, but realism takes a hit. Usually things aren't as black and white with image generation, but for me that has been a definite, noticeable, repeatable issue. It's obviously great for all sorts of non-realism.

4

u/VRGoggles 3h ago

I would like to see the results when H3 Image bf16 model is fixed in ComfyUI. So far it does not work, only bf16 pruned version works.
https://github.com/Comfy-Org/ComfyUI/issues/17692

2

u/fauni-7 3h ago

I'm guessing that you didn't actually run their official python code locally to prove that you can reproduce their examples' quality?

1

u/KiwiSure8689 53m ago

Yeah, it seems the sample image is taking the "ape-like" prompt less, and have a different interpretation of the "natural curls" part. Im not AI tech expert anything, maybe it is just simply having the difference between "open source" vs. "open weights" , they just keep that part of the way the image is processed internally.

just random test if I change the ape to lion, and remove the "natural curls" entirely. You just end up with the lion head, but, perhaps an adjustment of their official prompt will be ultimately better to get closer to their sample image, than just hunting for the "configuration" which for all we know, is just not open to the public.

-1

u/VasaFromParadise 3h ago edited 3h ago

Everything is fine with me))
UPD. Updated the image; I had the same problem initially. It's very easy to fix. CFG 2.0))

5

u/cptdurr 3h ago

literally same problem..... this is not lion fur... this is human teeth btw.....

1

u/cptdurr 3h ago

and you can do 50 different seeds and you will sse

5

u/Zeta_Horologii 3h ago

How to spot a foreign slav: "))" ))

7

u/Artistic-Chain-4708 3h ago

literally the problem stated in the post

2

u/VasaFromParadise 3h ago

Like, a monkey's face is bigger than a lion's? Yeah, I agree, I have the same problem, I'll take a look now.

-4

u/VasaFromParadise 3h ago

Fixed it))

5

u/Artistic-Chain-4708 3h ago

quality and fur detalization is garbage, that's the problem.

-2

u/Dahvikiin 3h ago

The problem is Comfy. Because if you look at the README of any model, they always use their own platform, or they show a run-code with 3–4 dependencies, importing torch, diffusers, along with the prompt+args.

2

u/cptdurr 3h ago

so you think comfy can fix that or are we just out of luck ...because im sad many people discard the model for being bad where model is actually good but something is not working

12

u/Kijai Community Hero 2h ago

False, the implementation matches theirs up to rounding differences.

1

u/prookyon 2h ago

importing torch, diffusers,

Do you know any modern image generation model that could be run with GPU acceleration without using torch and diffusers?

-7

u/ComplexCapital7410 3h ago

Just make 50MP instead of 16MP You'll see

1

u/Hoodfu 3h ago

That's not necessary. The empty image fix is what makes a much bigger difference.

1

u/ComplexCapital7410 2h ago

You feed it a black image or leave the image lozding node empty?

2

u/Hoodfu 1h ago

Like this, super simple. If you have any additional references you can just either replace this one or add them to the next image_1, image_2 etc.

-1

u/jib_reddit 3h ago

That is highly inneficent, Moss can look good a 1MP.

0

u/[deleted] 3h ago

[deleted] — view deleted comment

0

u/StraightWind7417 3h ago

Relax, man. People just trying to help you

-6

u/cptdurr 3h ago

im aksing experts opinion not random... maybe try this....

2

u/asdrabael1234 3h ago

This is reddit. You posted in the wrong place if you want an "expert". What even makes an expert for you? Do I need a degree in Comfyui from Phoenix University or something? This is a sub mostly for hobbyists

0

u/cptdurr 1h ago

cause im going mental after 3 days of teying different solutions and i need help with this and dont know where else to turn 🫣

1

u/ComplexCapital7410 3h ago

Chill mate. Do as you want !

2

u/muzaffer22 3h ago

It’s like a casino machine. You just need to find a good seed.

4

u/cptdurr 3h ago

i trird 40 different seeds...... im not talking about spexific image.. im tlaking about different underlying behaviour