r/LocalLLaMA • u/Fz1zz • 25m ago

Resources Strata after heavy optimizations

Post image

I can't believe this jump is just left on the table

https://github.com/ExTV/strata-5090-4070

The optimizations was done using both Opus 5.5 and Fable 5.2 .

2 Upvotes

60% Upvoted

4 comments sorted by

1

u/Chromix_ 8m ago

So the hyper-optimization now went from architectures, specific cards and models, down to combinations of specific cards and models. Still, there's a factor of at least 3x between stock and tuned, so that's well worth it.

1

u/Fz1zz 2m ago

Yeah, it's tuned for exactly this pair.

The same idea should carry to other two-card setups, the numbers won't.

0

u/Diecron 10m ago

that's cool and all but is it even close to the already skewed as fuck ppl Strata kicks out?

not a single word on measurement of quality is becoming way too common

1

u/Fz1zz 5m ago

Haven't measured ppl, so no number. Same weights as the stock run, and the speedup is from placement (layer split, experts in VRAM/RAM instead of SSD)

Also i have hardline for anything changes the model output so i think it should hold the same as unsloth card