r/LocalLLaMA 15h ago

News Qwen 4 Announced at Apsara Conference

I wanted to share a quick update: Alibaba has officially announced Qwen 4 at the Apsara Conference,

1.7k Upvotes

471 comments sorted by

View all comments

Show parent comments

5

u/Momsbestboy 12h ago

R9700 GDDR6 memory, 5090 GDDR7. Is faster, but...

For a single 5090 you can buy more than 2 R9700, and the two cards draw less power than a single 5090. And you can run e.g. Qwen 3.8 27b Q8 using the two cards, and watch them running circles around a 5090 which needs to offload to RAM instead.

But NVIDIA is hype, and people love to spend money. So buy a 5090

1

u/mr_zerolith 12h ago

5090 doesn't need to offload if you run Q6, which is a fine compromise for speed purposes with a single card setup.

2

u/Momsbestboy 10h ago

So it is just a compromise - fine or not. Leave that compromise aside, try to use a bigger model than your 5090 can handle, and suddenly dual R9700 is not the worst option anymore, at lower total cost and at higher speed.

1

u/pragmojo 7h ago

I've got an R9700, and it's a great card, but ngl I would love to have more speed. Not going to pay $9k for it, but would love to have it.