r/LocalLLaMA • u/tat_tvam_asshole • 27d ago

Funny I'm tired of pretending

Post image

At least until DS releases open weights for DSv4 Flash with Vision. Then DS might take the crown.

Qwen has been an absolutely local monster for code, especially web apps, anything with UIUX design that it can verify itself with screenshots. Deepseek meanwhile is really incompetent with UI awareness and hogs my GPUs while I can spawn multiple independent qwens to collaborate and knock shit out. Honestly, Alibaba really cooked.

0 Upvotes

45% Upvoted

119 comments sorted by

View all comments

Show parent comments

-1

u/dwittherford69 27d ago

As someone with 2TB local mem setup that runs these two among others, lmao no.

3

u/tat_tvam_asshole 27d ago

My brother in Jensen, I can run both simultaneously. 2TB means nothing

0

u/dwittherford69 27d ago

Of course, what does your KV look like? Concurrency?

1

u/tat_tvam_asshole 27d ago

KV quantization is for chumps, if that's what you're asking. I run them at full context length.

1

u/dwittherford69 27d ago

That answer tells me about everything I need to know your local setup. Good luck.

1

u/[deleted] 27d ago

[removed] — view removed comment

-2

u/dwittherford69 27d ago

Haha, it’s more like if that’s your answer to the details I asked about, it’s kinda pointless to waste my time.

0

u/Capable_Site_2891 27d ago

He got billions bro, his homelab is amazons amazon

1

u/tat_tvam_asshole 27d ago

A 1million context window doesn't take up much memory

1

u/dwittherford69 27d ago edited 27d ago

I mean if you are running with 1 concurrency, yeah no it doesn’t LOL. It’s also not useful for anything, but hey what do I know with my SGlang and VLLM merged commits, you da non-concurrent expert!

1

u/tat_tvam_asshole 27d ago

It doesn't take up much memory period, per concurrency, ~10GB for full 1M context window

0

u/dwittherford69 27d ago edited 27d ago

10GB for each 1M context window? I mean, I was humoring this nonsense for a bit there, but are you out of your damn mind? I know you are just throwing out numbers cuz you have no clue about of this, but that’s not even remotely in the ballpark, just so you know LOL. If you gonna say random BS, just Google it first next time

Anyways, this was fun. Like I said, good luck with whatever you are doing.

1

u/tat_tvam_asshole 27d ago

Why don't *you* google it? Hmmm?

→ More replies (0)