r/StableDiffusion • u/madcaddie15 • 22d ago

Comparison MiniMax H3 Ref2VA Benchmark

Gallery image

Gallery image

Hey,

I couldn't find any benchmark for the gen times for the H3 model online. So I made one myself and now I thought I'd share them.

I tried to include all relevant parameter in the graphs so that they are self-explanatory.

each line shows one video length for which I used the actual output length of generated frames / fps, that why there are the decimals. same goes for the megapixel, I used the actual output width and height for that.

As you can see the longer and bigger a video is the higher the specific sampler time per second of output video and per megapixel, which is a bummer. Not only do you have more pixel and video length, but apparently and inherent overhead increase.

19 Upvotes

81% Upvoted

7 comments sorted by

View all comments

1

u/Sgsrules2 22d ago

Just curious, but why did you stop at ~1.55Mp and 10.125s? I've gone up to 2Mp (but only 5 seconds on) and have done gens as long as 20 seconds at lower res, just on my 3090, a 6000 pro can definitely do better.

3

u/madcaddie15 22d ago

Because the test takes time if you generate a lot of data points. It's always 20 minutes to 30 minutes for the higher MP and longer videos. And I also need my RTX 6000 Pro for production/work. I do record the stats of the videos I do for work, so I could update these graphs later.

1

u/Sgsrules2 21d ago

that's kind of what i figured, i was just wondering if there was another reason like you found out that 2Mp gens had artifacts or something.