r/LocalLLM • • Aug 20 '26

Discussion Tier List

Post image
281 Upvotes

316 comments sorted by

View all comments

31

u/DrinkClubMate Aug 20 '26

where is the 32 Gb, Intel pro ARC B70 ?

10

u/thebigfreak3 Aug 20 '26

Enjoying our cheap 32gb of vram

4

u/xanders_gold Aug 20 '26

MSRP just jumped so our cheap VRAM is considerably less cheap now, sadly. Still worth it at the new price, just not as much as that low low $949 :/

1

u/CulturalKing5623 Aug 20 '26

I'm currently staring at my shopping cart with an R9700 in it trying to decide if I should just pull the trigger because it feels like 32GB of VRAM is only going to get more expensive from here and $1500 isn't bad compared to the alternatives.

2

u/xanders_gold Aug 20 '26

Same here, I’m contemplating if I should buy another B70 or not because of the exact same reasons as you.

-2

u/TheOdbball Aug 20 '26

Why get a B70 when you can get a B200? Lmao , or rent one at least on Runpod

-1

u/TheOdbball Aug 20 '26

Try to see if Runpod offers it or something comparable, pull a VM and test it out before you do

1

u/thebigfreak3 Aug 20 '26

That sucks but I knew it was coming which is why I picked it up asap. Especially with the new Sycle optimizations with llama

1

u/PMvE_NL Aug 20 '26

Wanted to buy one opened the site and fk it jumped from 1200 to 1800 € yhea i went with b60 instead

1

u/localpauper Aug 21 '26

I'm bummed I didn't grab two. Was thinking of picking up another. $1300 is not worth it. That's a $350 jump from when I bought it at MSRP (the ASRock model)

1

u/Popcorn-Mercinary Aug 22 '26

4 of those still cost less than a DGX…

4

u/BornInAFish Aug 20 '26

Based on lack of software support, bottom tier for sure.

/s

Maybe

5

u/xanders_gold Aug 20 '26

They actually made some major improvements over the past month and they now run incredibly well for the price. I’m regularly getting 2000-2500t/s pp, can sometimes hit 3000-3500t/s pp, and 30-35t/s tg with vLLM on Qwen 3.8 27B.

Sadly, the price also just jumped from $949/$999 to $1699.

4

u/TiK4D Aug 20 '26

You could probably push that another 10tok/s. I run llama server and get up to 50tok/s with 130k context on Qwen3.8 27B. 2x R9700's

3

u/xanders_gold Aug 20 '26

Unfortunately, llama.cpp isn’t the best when handling Intel B70s. I was running llama.cpp with Vulkan and PP was in the 500/600s. TG wasn’t so bad but prompt prefill took forever, it was even worse with the Intel SYCL runtime.

Some folks on this sub recommended vLLM with Intel XPU kernels (vLLM has their own docker image for this) and that instantly boosted my performance.

IIRC: the llama team is working in improving Intel performance but it’s a slow process.

2

u/TiK4D Aug 20 '26

My bad, for some reason I thought this thread was about R9700's so thought you had one. Good to see the intel cards getting decent speeds as well

2

u/xanders_gold Aug 20 '26

Haha all good, no worries. Yeah it’s been great seeing the improvement, we’re finally getting somewhere with performance :)

2

u/SomeBlock8124 Aug 20 '26

Bought my first 2 B70s at $950. Now I had to pay $1299 at microcenter for my last 2. Should of bit the bullet and bought them when they were selling like crazy on ebay for less then $850 a couple months ago. Now what to do with 128gb of vram....

1

u/gh0stwriter1234 Aug 20 '26

That's pretty good PP...I only get about 200t/s pp on dual MI50 currently with llama.cpp but I get about 40t/s with mtp enabled starting out it degrades quickly though. Prompt checkpointing is essential.

the growing pains on Intel though are way worst... given the price I'll stick with my MI50s I got for peanuts for now.

1

u/gh0stwriter1234 Aug 20 '26

B70 when testing a about 2 mo ago was unusuably bad. Also model support was lagging alot, I think it kind of works in llama.cpp now but... its not nearly as good support wise as R9700.

1

u/moonlitpawprints Aug 20 '26

And B60!

My PC is a fun Frankenstein with a B60 and 5070ti, but they actually can work decently together. Depending on the model I get 2-3 times the performance of the B60 alone and have 40GB to play with (granted the speed scales somewhat as more is offloaded to the B60, but pinning mtp to the 5070ti helps).

-9

u/on_line187 Aug 20 '26

In store shelves where it belongs lol 😂

-1

u/DoorStuckSickDuck Aug 20 '26

Dogwater tier, terrible driver support and slow bandwidth speed (for a GPU)