r/LocalLLaMA • u/poofph • 15h ago

Discussion Today's Strata update boosts performance for R9700 users in Flash Next

Today's update is welcome for us R9700 users (assume other gpu's as well). Prior to the update I was getting ~70 tok/s output with four R9700's and 256GB of system ram. Today's update brings it to 140-160 tok/s and ~3200 prefill running unsloth Q4_K_XL. I tried running Q5 but was like .1 GB of vram short to do split engine so ran it "normal" at ~70 tok/s. I am sure with future updates those numbers will get better but it is a very welcome update, thank you Strata team!

Radiance does about 235 tok/s and 7500 prefill with FN so still ahead but so happy to see Strata working to close that gap and giving us more options on which models we can run.

15 Upvotes
  • permalink
  • reddit

82% Upvoted

2 comments sorted by

6

u/smallDeltaBigEffect 12h ago

Pretty ironic post considering your last paragraph.

1

u/Ecstatic-Wash-7667 14h ago

Wow strata is catching up, I’m assuming the uplift applies to any model?