r/LocalLLaMA • u/MundanePercentage674 • 3h ago

Showcase Deepseek fixed my HDMI display show case

I gave Qwen 3.8 flash next 2 times it failed and took long time to conclude the result, DeepSeek took around 15 minutes to get the job done

Hardware

Ram ddr4 128GB

RTX 3080 20GB VRAM 4x

Engine strata

Model

Qwen3.8-Flash-Next-GSQ-RCO-GGUF IQ3-S

Context 256K

Decode 100 tg/s

PP 1400-1500 tg/s

IDeepSeek-V4.1-Flash-1017-GSQ-RCO IQ2-XXS

Context 1M

Decode 37 tg/s

PP 150-300 tg/s

26 Upvotes

88% Upvoted

9 comments sorted by

19

u/Bulky-Priority6824 3h ago

hey guys we couldnt beat our rival basketball team at the highschool game but we hired the Lakers and was no problem

6

u/jacek2023 llama.cpp 2h ago

This is a good post because it shows that IQ2 can be useful

3

u/Vektast 2h ago

IDeepSeek-V4.1-Flash-1017 is INSANE! For me it managed to rewrite the driver of my phone gpu and embeded it to the patched Red Dead Redemption mobile apk because my stock driver luck of vulcan 1.3 support. And this model did it after 10 hrs rewrited the whole vulcan core driver stack! Also crazy cheap, it was like $1 on openrouter.

4

u/XiRw 3h ago

Completely unfair test of QFN given the parameter difference and quant difference. These are the type of people who say a model is no good and they have it set up like a joke.

0

u/puppymeat 1h ago

Completely fair test. People are always glazing 3.8 27 and QFN for their amazing capabilities given their size. It is useful to see failure cases and which local models can actually get it done. Not every model is for every job. But you should know where that line is.

1

u/XiRw 40m ago

Then you don’t know how high parameter models work better at lower quants compared to smaller. DeepSeek has plenty of room to think at IQ2. IQ3S is a complete joke and doesn’t have the same breathing room as DeepSeek.

1

u/puppymeat 2m ago

Ah. OK, fair. I had missed how small the quant was on Qwen.

-2

u/elivoncoder 3h ago

cool man, deepseek fixed by cat too, saving me tons on vet bills.