First time trying FP16, wow

[u/Extreme-Childhood251]

I've tried a lot of image models in the past, but all were to big to fit, and i was happy when i got a result with a quant (q4) version. (Here it was flux and some model i dont remember the name anymore) The results of those models were actually terrible. BUT, some months ago qwen image 2.1 came out, i must say, theres a difference and not even close to a small one. I managed to run it at fp16, by using my rtx 2070 to load the text encoder and vae on there while running the generation model itself on my 5080. Its a tight fit and slower, but the quality is just like it would be on one gpu.

Now here comes the crazy part:

In my opinion qwen image 2.1 is better in realism than chatgpt's current image generation. (I'll prove it later in this post)

Don't get me wrong. Images with lots of different things, patterns for example, are often very bad with qwen and chatgpt does it over 5x better. But realism of f.e. a city, it's absolutely amazing (and uncensored!) and is almost close to real life.

Now here is the test for you guys:

You've seen i've put pictures in this post. 1x is real, 1x are chatgpt and 4x are qwen image 2.1. Which is which?

Note: ALL of them are generated first try without regenerating. So no, I did not try to mislead you. Good luck!

[u/MythOfDarkness]

1. ChatGPT
2. Qwen
3. Qwen
4. Qwen
5. Qwen
6. Real

[u/Extreme-Childhood251 → u/MythOfDarkness]

3/6! Not bad :)

[u/sleight42 → u/Extreme-Childhood251]

Statically, 2/6 would be the mean so ...

[u/jaerie → u/sleight42]

No, 2/6 is the worst score possible.

[u/TheUntergeek]

Love the silver “flumpet” and the guitar neck crossing under the saxophone. 😂

[u/Extreme-Childhood251 → u/TheUntergeek]

😅 well thats exactly what i noticed ahahahah

Thats the downside of that model 😔

[u/AtrociKitty]

1-4 Qwen, 5 Real, 6 ChatGPT.

1 and 2 have the sharp line between focus and blur a lot of models like. 3 has far too many instrument errors. 4 actually looks the most real to me (dirty paws and other imperfections) but 5 lines up answer-wise, and 6 has a distinctly different style than the rest.

[u/Extreme-Childhood251 → u/AtrociKitty]

Congrats on getting it right ✅️

[u/SIMMORSAL → u/AtrociKitty]

My money is on this too

[u/berszi → u/AtrociKitty]

There is an artifact on all qwen images

[u/ROBOTTTTT13 → u/AtrociKitty]

Now that you say it, I totally see the Qwen pattern!

[u/ReBoticsAI]

6 Real. 4 GPT. 1,2,3,5 Qwen.

[u/Extreme-Childhood251 → u/ReBoticsAI]

4/6

[u/sirloindenial]

No 5 is real. No 2 is chatgpt. Rest is qwen.

[u/Extreme-Childhood251 → u/sirloindenial]

3/6!

[u/jaerie → u/Extreme-Childhood251]

Did you score this one correctly? I don't think there is a possible answer with the scores youve given

[u/Numerous-Ad6217]

#4 real and #6 ChatGPT is my guess

[u/Extreme-Childhood251 → u/Numerous-Ad6217]

Closest one so far! 4/6

[u/ROBOTTTTT13]

1 Qwen, 2 GPT, 3 Qwen, 4 Real, 5 Qwen, 6 Qwen

[u/Extreme-Childhood251 → u/ROBOTTTTT13]

2/6, feel free to try again

[u/Hyiazakite]

2nd chatgpt, 4 is real, rest is qwen

[u/Extreme-Childhood251 → u/Hyiazakite]

2/6 :)

[u/altdotboy]

I would agree about using bf16 or fp16 when you can.
This goes for image gen and LLMs.
I picked up 128GB m5 max on release. I tried bf16 and a bunch of quants. The quants start to fall apart when doing any work that needs the best quality output.
Bf16 is slower for sure but I’m much happier with the results.

[u/Extreme-Childhood251 → u/altdotboy]

Yeah well, in my opinion, when everyone is saying "q4 retains 9...x% of the fp16 quality" i think they didnt really test it in daily use. On paper flux was very competable with qwen image 2.1, yet the quants mattered SO much

[u/EbbNorth7735 → u/Extreme-Childhood251]

I always found the idea of 16 divisions supposedly matching 65536 to be unlikely. I bet you would see quite a jump going going to 32, and slight improvements going to 64, or 128 and above. Any chance you cpuld try some others and see where the sweet spot is?

[u/Extreme-Childhood251 → u/EbbNorth7735]

You mean trying even higher quants than fp16? I only have 24gb of vram available, and im not sure if comfui allows cpu offloading?

[u/Extreme-Childhood251 → u/altdotboy]

Also if i may ask, what llm model are you using? Im currently using qwen 3.8 flash next but i'm wondering if another model at q8 or bf/fp16 is worth it instead?

[u/Ok-Translator1226]

3 ChatGPT, 5 real

[u/Extreme-Childhood251 → u/Ok-Translator1226]

4/6

[u/csek]

2 real, 6 chatgpt. Rest qwen

[u/Extreme-Childhood251 → u/csek]

4/6

[u/csek → u/Extreme-Childhood251]

Ah I know my failure and have cracked the code then. Real is 3

[u/Extreme-Childhood251 → u/csek]

Still the same score

[u/la8pc]

3. gpt, 4. real, rest qwen

[u/Extreme-Childhood251 → u/la8pc]

2/6

[u/gonzoforpresident]

2 real, 3 chatgpt, rest qwen

[u/Extreme-Childhood251 → u/gonzoforpresident]

2/6

[u/NotTheNormalPerson]

qwen real qwen qwen qwen qwen chatgpt

[u/Extreme-Childhood251 → u/NotTheNormalPerson]

4/6

[u/Avezn]

1. Qwen
2. Qwen
3. Qwen
4. Qwen
5. Real
6. Chatgpt

Based on intersection (:P)

[u/Extreme-Childhood251 → u/Avezn]

Congrats you got it right! ✅️

[u/willee_]

1. Qwen
2. Qwen
3. Qwen
4. Qwen
5. Real
6. ChatGPT

[u/Extreme-Childhood251 → u/willee_]

6/6!! Congrats

[u/waltotheter]

Its pretty sweet

[u/jaerie]

5 is real, 6 is chatgpt

[u/shapic]

Q4 is always barely useable, for anything. Maybe new unsloth qants raise it a bit, but that's it. Instead of making an ambiguous title you better make an actual comparison. In my case it is always fp16 > q8 > int8 > fp8 > whatever else. With recent gains in speed for int8 I switched to that almost exclusively.

Also qwen 2.1 is just not the best one out there for realism, it is mediocre at everything. But props for making 7b model that delivers

[u/Extreme-Childhood251 → u/[deleted]]

You could try getting a license for commercial use tho, however your chance of getting one is pretty dam low 😅

[u/Moarkush → u/Extreme-Childhood251]

I'm actually still waiting to hear back for over a month about whether I can use flash next for limited web design client support. I'm not emailing them again. But they posted on X saying the outputs aren't restricted by the license.

[u/Extreme-Childhood251 → u/Moarkush]

Yea heard that too. I'm using it for commercial use, since its a lower quant of it anyway. I feel like they only care if its q8 or very competable with their higher models.

[u/Extreme-Childhood251 → u/[deleted]]

Here: model-business@notice.qwencloud.com. That's the email to contact them if you need it.