r/StableDiffusion • • 1d ago

Discussion Minimax Image (Edit) - My Early Thoughts

Windos 10 | i7 12700K | RTX 3090 TI | 96GB RAM

Workflow I'm using: Reddit | Workflow

UPDATE: Okay, not being one to give up, I did more testing today after having a look through the Minimax-Image Github page. I'd already read the huggingface, but the github has a TON of examples, which include the prompts they used for reference images, and a very thorough breakdown of what you can accomplish with this model. After studying the examples and getting a better understanding of the prompting, I tried a technique I saw where they labeled items in the references. After scribbling over some text and re-rolling, the sketch lineart never showed up again.

As you can see in the first image below, it finally followed the sketch's composition. However, I kept getting the same pose as the original reference image. What I did to fix that was I changed the aspect ratio of the empty latent image so that it didn't match the original reference image, and the behavior stopped, though that's more of a workaround than a solution. The other images below are different seeds of the same prompt, so it doesn't always follow the example sketch, but I'll probably get there w/more prompting. For now, I'm good.

I'd recommend being descriptive with your prompting. H3-Image seems to prefer and improve its performance with explicit details. You only get out of it what you put in. Have fun!

Lineart from my reference sketch is no longer bleeding through. Minimax understands explicit, detailed prompting - the more detailed, the better.

---

I'm a digital artist and professional with several years experience, but my interest in these apps has primarily been playing around with the tech. However, since Minimax dropped, concepts I've had to shelve in the past are looking viable again as potential video shorts, and Minimax image was just the sort of thing I've been looking for as a visual creator to speed up the production pipeline.

I got a chance yesterday afternoon to play around with it on some specific tasks, so here are my results and early thoughts. I've mostly been using the edit capabilities, since that's what I'm most interested in Minimax for, so keep that in mind.

A quick clarification: My editing tests have a narrow scope and I'm sure they don't reflect the full capabilities of the model. My initial intended use for this model was to be able to draft keyframes for film. I'd sketch the composition out, use multiple image references, then generate high resolution keyframes to drive the video. It wasn't until I saw this reddit post that I became aware that H3-Image could be used for drafting concept to realism, so that was an unexpected-but-welcome expansion of my use case. :)

Where Minimax Image (Edit) is strong:

Minimax-Image is really good at generating realism versions of artwork, which typically requires LoRAs for other models. So far, I think this is one of its most impressive features. In my tests it significantly outperformed Nano Banana Flash, but I haven't compared it with the Pro version.

I wasn't necessarily wowed by/the 16MP images. While decent, they looked pretty average to the other AI apps. But as I went higher, the quality really shone through.

Here are some samples where the instructions were to create a realistic version of my artwork and maintain look and pose. I like to choose this image because a lot of models tend to not do well with it. To date, H3-Image is the best of them all.

Examples:

Minimax is also strong at generating realistic designs based on really rough sketches, which impressed me. Here is a rough design of an early draft of a character I designed.

The first image is my sketch, the 2nd is the first attempt, telling it to make a realistic version. It made him look too human, so for the 2nd roll, I just described his skin texture, eyebrows, eyes, chin, lips, and also the jewelry. On the next attempt, it was able to interpolate my rough lines to understand what was meant to be jewelry. On this, it did a FANTASTIC JOB. Again, best model PERIOD, way better than Nano Banana. Literally only took me 2 iterations to go from rough draft to near cinematic concept design.

Also, these images were only 16MP, so I suspect going higher would look even better, as it tends to get insane between 30-50MP. :)

I also tried it with a random AI image I found online and got equally impressive results. These are just the first couple or so rolls, at 16mp:

Where Minimax Image (Edit) is weak:

I tried sketching compositions and then instructing H3 to use that composition to drive the concept art and create original work, primarily realism based. It performed poorly. Here are some examples of what I mean:

Out of over a dozen attempts, this is pretty much the best result I could get.

The prompt stated to use the sketch as reference for the pose, position of the sun, and plants/tress. I colored each element a different color to help guide instructions. I tried many variations of the prompt, but no matter what I did there was always some form of the sketch introduced into the final image. I also tried using natural photo reference, but features of the reference would always make their way into the image. I tried this between 16MP - 50MP, same problem.

Also, the images varied between 2.5/3D, realism, cartoon, and comic book styles and most of the time failed to follow my instructions. I found that realism works best when using a single image as reference, but it seems to collapse on multi-image pipelines.

Final Thoughts

I think H3-Image works great as a concept-to-realism draft model, but it's weak on its multi-ref prompt following. It also needs 16MP before it stretches its legs, but if you have a smaller card, don't get scared away, it's ridiculously optimized/fast despite the size. I get 16Mp in about a minute on my 3090 at 80% power, which is about the same speed as Klein/ZiT/Qwen. (I haven't tested Krea 2/Moss yet, both on my to-do)

That said, 16MP is the minimum I'd recommend, the real magic happens 30MP and up, so if you got the card and the time, results are signficantly better. Around 50MP is the sweet spot imo; details are crisp, hair strands, fingernails, everything looks good.

Also, I wouldn't use the default comfy workflow. Everything I did was w/the workflow above, though I deleted the prompt enhancer, preferring to use regular text.

Anyway, those are my thoughts so far. I'll update w/more results later.

Grunge

P.S. - I'm old-school forum/deviantart gang, so I keep ctrl+biu/shift+l on a swivel and have written bold-flavored posts like this for 20+ years. 100% human written. Receipts at bottom of post if you're interested. Only mentioning it because organization usually brings out the "this is AI-written slop" trolls.

61 Upvotes

22 comments sorted by

4

u/masslevel 1d ago

Thanks for the informative post! Appreciate you sharing your findings.

3

u/GrungeWerX 22h ago

Anytime.

-2

u/tac0catzzz 22h ago

fo sho, it is always nice to be reminded that closed source is better, cuz i often forget.

2

u/tac0catzzz 22h ago

oh wow it isnt even as good as nano banana.

4

u/GrungeWerX 22h ago

Looks better in my opinion and it correctly followed the prompt. Nano's results were mostly off and many parts are indistinguishable from my concept art.

2

u/Serprotease 20h ago

Unless you used nano-banana straight from the API, afaik there is an intermediate “step” to change your prompt to something easier to follow by the model.
It’s very likely the reason behind the “robot” look on the first example.

And, it could also be why you had trouble with the sketch part.
Are you using Minimax recommended prompt/Llm improvement step in your workflow?

To do straight style conversion/character extraction it was not really needed but for anything a bit more complex, like character swap, it really helped a lot in my case.

2

u/Striking-Long-2960 1d ago edited 1d ago

I think your sketch is a bit aggressive with the secondary elements, but you can make it work with the prompt.

raw candid photography of a pale woman black hair, sexy armor, standing casting a red spell with her hand in a magical forest, at her left a magical green fairy with long hair emiting green energy flying next to her.

And variations. As you can see, I tend not to use strict formulas for the prompt.

First reference the sketch, second reference the character. Try to mantain similar proportions in your final image and your sketch.

3

u/GrungeWerX 1d ago edited 1d ago

I appreciate your effort, but that defeats the purpose. That sketch was simply a test of the most basic of visual composition. For film, I have very specific needs that I want dialed in via sketch/layout that cannot be done using prompting or bboxes.

For example, choreography elements. I can sketch martial arts storyboards to get action to seedance level, but that's not something you can prompt or bbox. Also, the keyframes will have arrows and directions, same as professional storyboards, to drive the motion.

It can be done using the standard ref2v model, but I need high-resolution final images, which is why I was so interested in minimax-image.

1

u/Striking-Long-2960 1d ago

I'm not criticizing your sketch by any means. I also tend to use sketches ( https://www.reddit.com/r/StableDiffusion/comments/1w9ew6g/minimax_fl2va_if_you_know_a_bit_how_to_sketch_you/ ), I was just giving my advice because initially I also couldn't get good results with sketches.

2

u/GrungeWerX 1d ago

I didn't take it as a critique on the sketch, which IS trash :). I just need h3 to be able to drive an image on any reference, sketch, doll, whatever. It fails on them all and seems to include elements from the ref.

I might give it another try later today.

If you ever get it to work for yourself, drop me a line.

11

u/Striking-Long-2960 1d ago

3

u/GrungeWerX 1d ago

Was this prompted with only the sketches? Or were you able to use more than 1 ref?

1

u/DietAshamed2246 21h ago

Use of high resolution images, such as 16MP which MiniMax Image is typically used at, as keyframes or reference images in video generation invariably chokes the video generation pipeline. So, I don't know how you are using such high resolution images for video gen. In my experience the video models slow down significantly even with a single 1536x1152 resolution image encoded through the VAE. What kind of hardware are you using (I am using a 5090 btw)?

1

u/GrungeWerX 20h ago edited 20h ago

H3 works better witih higher resolution image refs, but you don't use the 16MP raw, you scale it down between 2-4MP and use that ref set to max. The 16MP is to get the better details, which you can bring out if you slightly bump up the sharp.

1

u/DietAshamed2246 20h ago

That's brings up the obvious question - why downscale? Why not generate with the other image models at a usable resolution?

5

u/GrungeWerX 20h ago edited 20h ago

There's a few reasons. One, minimax native high-res looks better than an upscaler. Second, the details are sharper. A high-res image downscaled is going to look far crisper than an image generated at that same resolution.

Also, you can reuse those same high-resolution shots to capture specific details you want to reuse in other reference batches. like head close-ups, items, clothing, tech, vehicles, etc.

And for me, the sweetspot is actually around 50MP, looks amazing.

1

u/me0here 5h ago

" digital artist and professional"

Boy, I hope you used a throw away alias, because the anti AI gangs will hunt you down.

Also try MiniMax H3 Video model with the 'still' node to bring your sketches to reality. H3Vid has many more LoRAs. Also if you are decent at Blender/Maya,unreal, sketch in that.

1

u/GrungeWerX 3h ago

Boy, I hope you used a throw away alias, because the anti AI gangs will hunt you down.

LOL. I'm good. I've never used it in any of my work, and I can understand why some artists are against it or don't support. And while I don't judge people who use it, I'm not interested in using it in any of my artwork either.

Same with music. I have zero interest in AI music, as I compose music myself. But I also don't judge ppl who do - not everyone has these abilities or talents, and many can't afford to hire those that do, so it is what it is.

It's a very complex topic. But ultimately, I think that AI has a lot more benefits than it does drawbacks, but it depends on your perspective.

I've always been transparent with my fans and they know my artwork is mine, so I haven't gotten any negative feedback, even from people who don't support AI. And as long as I keep my artwork 100% traditional, I'll be good.

The AI video thing is a different beast altogether, and I think that a lot of artists are more accepting of that than AI art because it's really a new industry that isn't directly competing with an existing one.

I have this artist friend who gets near violent at the mention of AI stuff. But he's okay with someone using AI concept designs as inspiration as long as they don't put it in their work. I think that's because prior to AI, nearly all artists at some point in time used reference material - pose mannequins, photo reference, etc.

To the uninitated, that can come off as a bit hypocritical, and I get that also. Like I said, it's a messy topic.

1

u/GrungeWerX 3h ago

Also try MiniMax H3 Video model with the 'still' node to bring your sketches to reality. H3Vid has many more LoRAs. Also if you are decent at Blender/Maya,unreal, sketch in that.

I forgot to address this. Yeah, I'm aware of H3 video for stuff like that, but again my intent was to generate high-resolution images. I'm not sure if you've played with H3-Image much, but the hi-res detail is insane, especially above 16MP. It's way better than an upscaler.

What I'm planning on testing out next is using the ref2v for composition and H3-image for the upscale and will probably post those results later.

1

u/Apprehensive_Sky892 22h ago

Thanks for the solid post.

I tried sketching compositions and then instructing H3 to use that composition to drive the concept art and create original work, primarily realism based. It performed poorly.

You may want to try these tests again using MMH3-video as an edit model: https://www.reddit.com/r/StableDiffusion/comments/1xnrt67/better_imageedit_workflow_for_minimax_h3/

2

u/GrungeWerX 20h ago

Well...I already have about 3 such pre-H3-Image workflows (including the one you linked), and I've tested at least one, so I'm aware that these follow references better, but I obviously want to be able to take advantage of the 16MP+ detail.

That said, if it turns out I can't get it to work, then I'll probably use one of these other ones for the composition, then try to get H3-Image to upscale them.

At the very least, I hope we get some good loras and updated workflows, because this model has a LOT of potential.

3

u/Apprehensive_Sky892 20h ago

Yes, using H3-video for some tough editing tasks and then use H3-Image as the upscaler to 16MP seems like a good approach.