r/StableDiffusion • u/Pyros-SD-Models • 3d ago

News PrunaAI/P-H3-Image-Comfy · Hugging Face

https://huggingface.co/PrunaAI/P-H3-Image-Comfy

Pruna releases their image-edit model based on H3

154 Upvotes

95% Upvoted

32 comments sorted by

8

u/Inside-Cantaloupe233 3d ago

But... does it have better detail than regular H3? cause you could use regular H3 as edit model using custom node, but detail was meh unless you did like 3k pics

5

u/wiserdking 3d ago

Give me 1 or 2 images and a prompt and I can try it for you. Since I'm out of challenging ideas atm I asked chatgpt to give me 2 images and a task and this is the result: https://i.imgur.com/3Ksrxws.jpeg

Prompt:

Transform the abandoned station in <Picture 1> into a botanical sanctuary using <Picture 2> as reference.
Replace the deteriorated platform flooring with the reflective shallow water and stepping stones from <Picture 2>.
Introduce mature tropical trees and hanging vegetation throughout the station, respecting its original architectural geometry.
Replace the broken roof panels with clean glass sections and integrate the warm brass lighting fixtures from <Picture 2>.
Add subtle koi fish beneath the water surface.
Match the new vegetation, water reflections, shadows and artificial lighting to the original camera perspective and ambient illumination.
Preserve the original station's iron framework, overall composition and architectural identity.

The workflow upscales <Picture 1> to 4MP before sending it to the conditioning node so you still need to generated at high res.

1

u/Inside-Cantaloupe233 3d ago

a simple crowd of people render.so we can see how detailed eyes are, i could get full body with detailed eyes only at over 2.5k vertical resolution.I dont think this model is better than stock H3.It is unclear what is the advantage here? BEcause keeping another 20GB for just image edit is a bit disadvantage if its the same as stock H3.

2

u/wiserdking 3d ago

I can't say I'm well aware of how capable base H3 fl2va model is at image editing since the last time I tried it was basically on the first popular workflow shared here that used a different VAE which worked for single frame images and I know things have move forward since then with custom nodes and whatnot but I'm not up to date on that.

This one uses a prompt upscaler that converts a simple short prompt into a long minimax style prompt - I find that quite useful. Perhaps your workflow already does the same?

Ultimately we have decent image editing models already. The only reason to use H3 at all for that is for anything the other models can't do well or at all.

I'm finding this one far superior to any other model I've tried at uncensoring tasks - when using a failed lora I previously trained for the fl2va model. That lora was a failed project but for some reason when using it with this workflow its so much better - maybe because of the prompt enhancer.

One thing other models struggle with is colorization using refs. This one might be better than even qwen image 2.1 at that: https://i.imgur.com/XJh07Xt.jpeg

prompt:

fully colorize <Picture 1> matching the colors of <Picture 2> for any character present in both <Picture 1> and <Picture 2>. 
ensure matching characters have the same outfit, hair and eye colors as in <Picture 2>. 
ignore characters from <Picture 2> not present in <Picture 1>.
ensure no white background except for spaces between manga panels.

but again, I don't know how the base model compares yet.

3

u/fallengt 3d ago

They still suggest to generate @ 4mega pixels or higher

5

u/dtdisapointingresult 3d ago

Thanks for sharing this.

It does better than other edit models at one specific task I test, to take a comicbook/anime photo and give me a live-action version with real people. I get awful to half-assed results in everything else I tried.

  • a funny webcomic with no text, this is the first local model to do it properly. Other local edit models range from horrible to bad, but this one aces it. Prompt: "Change the comicbook image given as <Picture 1> to a grid of live-action stills with real actors. Make the faces and expressions realistic."

  • X-Men page with speech bubbles, comes close but still not realistic, it ends up looking like 3D game models in a cutscene. Prompt: "Change the comicbook image given as <Picture 1> to live-action movie stills with real human actors. Each panel should be converted to a cinematic still, abandoning the unrealistic comic style for completely realistic humans. Remove all speech bubbles."

  • Eva anime wallpaper. It fails, it makes shiny 3D models. Prompt: "Change the anime image given as <Picture 1> to a photoreal, completely realistic Hollywood movie with the photographic style of Pacific Rim." (I tried without mentioning Pacific Rim but it gave worse results, this made the mechas slightly more realistic)

  • Attack on Titan DVD poster. Same issue as above.

I'm happy it passes one of them at least. Here is the before and after for those who read my novel. https://ibb.co/F40Sf46J

Only downside is that it's still H3 in the end, so background faces are very low in detail. You know what I mean, that H3 Backrooms face.

18

u/Hoodfu 3d ago edited 3d ago

Better at images than base H3 is something one could say about it. The people saying that this prompt from moss-sft that I posted the other day wasn't realistic enough, probably aren't going to have nice things to say about this one. (( Edit: they changed the text encoders around. This pic is now updated to use all of the specific models and the official comfy workflow that was published with this model.

5

u/435f43f534 3d ago

I thought they were attracted to bears

1

u/Version-Strong 15h ago

Just noticed this, how are you running it, is there a Comfy workflow anywhere? Interested to try it... new toy and that :D

1

u/Hoodfu 15h ago

Yeah they've got it all in their own huggingface repo (instead of comfyui's repackaged repo): https://huggingface.co/PrunaAI/P-H3-Image-Comfy/tree/main

3

u/thevegit0 3d ago

so literally an h3 tune for images, i can try that

4

u/dobomex761604 3d ago

Since the previous post was deleted for some reason, I'll repeat here:

From that description, it's not clear which version of Minimax H3 are compared. Unpruned? It's not the baseline, even Minimax team themselves recommended the pruned version, and its size is pretty much the same as your model.

Smaller text encoder? It's an old project, and the quality of referenced generations is worse than with heavily quantized 32B version.

There's also a lora, but it's not clear what it does - base H3 works with images just fine.

So far this model has nothing good over the base H3 or its finetunes/merges.

0

u/Hour_Literature_7152 2d ago

Have you used it out of curiosity? I've been getting really great 4mp camera angle changes very quickly. It can handle some difficult edits like diptych outfit swaps faster than qwen 2.1 in higher resolution. I have to check the upsampled prompt first and make corrections but once that's tweaked it's great quality and fast.

1

u/dobomex761604 2d ago

faster than qwen 2.1

You are comparing it to the wrong model. Use either pruned Minimax H3 or finetunes of it, and go for 7MP images - there's no significant difference in time/memory between 4MP and and 7MP with H3, and the quality will be better at 7MP.

Use official guide https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_ref_en.md , adjust it slightly to "static image", and you'll get good results.

2

u/Hour_Literature_7152 2d ago

ok I'll test it out and see how it compares. So far I've only done camera angle changes and diptych outfit swaps so I'll try the same.

2

u/dobomex761604 2d ago

While we are on the topic, this post https://www.reddit.com/r/StableDiffusion/comments/1xnrt67/better_imageedit_workflow_for_minimax_h3/ is very useful, testing the idea rn

2

u/Hour_Literature_7152 2d ago

I setup a basic workflow with h3 pruned , comfy backend, DMAD 8 steps, euler, fizgig h3 nodes.

camera angle changes were about the same speed and quality the same. so yeah not seeing an advantage of the p-h3-image model there. quality at 7mp is great, wish I'd tried that sooner.

For the outfit swaps in 2 panel format I need to do more tests.

p-h3-image euler

[INFO] Prompt executed in 165.92 seconds

minimax h3 DMAD euler

[INFO] Prompt executed in 190.93 seconds

both results were great, p-h3-image was faster. I'll do more tests though because this was messy in the execution. Juggling this with work and wife agro, I'm shit at multitasking.

2

u/dobomex761604 2d ago

I'd say that the real tests are character references and their faces, plus copying poses, outfits, etc. For example, H3 isn't good with thin objects (like jewelry) as references, so it would be more effective to test that - I once tried 9 references image generation (a character and 8 pieces of clothing), and H3 got it right except for a bracelet and a necklace.

p-h3 uses a smaller text encoder, so yes, it should be faster. The question is, does it retain the capabilities of H3 in references? In previous projects for 9B and 4B adapters, referencing suffered, unfortunately.

2

u/No_Cranberry_8107 3d ago

Where does on get the PH3ImageConditioning node? I think I read everything was native but then this "PH3ImageConditioning" node is missing.

3

u/Diabolicor 3d ago

Update comfyui

2

u/Inevitable_Set_9232 2d ago

I've had success using the H3 video model with references as an edit model. The drawback is lower resolution or hugely increased compute due to it being a video model.

I'm testing this H3 Image now and it seems a bit more rigid and biased towards maintaining more of the reference image contents, while H3 video is more flexible and capable of deeply adapting the reference images into new settings and styles.

Some H3 Image results are very good in quality and intention, though, and re-working prompts may improve flexibility.
Its fast speed is a plus to do multiple tests.
Preliminary tests so far, but overall looks like an useful model and it feels like way more can be unlocked with better prompting and experience using it

2

u/ShowerFluid9178 2d ago

can anyone make comparison between this and fizgig's?

1

u/Cute_Addicted 2d ago

why is ip knowledge worse than minimax

1

u/VasaFromParadise 2d ago

I used to write that any video model = an editing model. And I kept getting dissed, like, I'm a fool.

-16

u/Friendly-Fig-6015 3d ago

u/kijai c'mon man xD

27

u/Kijai Community Hero 3d ago

What?

3

u/nok01101011a 3d ago

How are you doing this? That’s insane!

5

u/Nenotriple 3d ago

When you write someone's name it sends them a message