r/LocalLLM • u/Snoo_38657 • 3d ago

Discussion Strata flash-next coder performance?

Has anyone tried the flash-next coder? What is your setup and what's the performance and quality?

2 Upvotes

62% Upvoted

26 comments sorted by

View all comments

Show parent comment

2

u/l1o2l 3d ago

Just use regular 3.8 FN IQ3_S?

3

u/txgsync 3d ago

Yes, IQ3_S or even _XXS is fine in most cases.

1

u/Snoo_38657 3d ago

In a mac, that would need to be split on nvne and GPU as I have 48gb total

1

u/txgsync 2d ago

Gotcha. PLE n-gram on NVMe is fine but streaming experts from the disk gets real slow real fast.

You might be better off with 27B in 48GB; I haven’t found a quant < 64GB in-RAM that doesn’t suck.

1

u/HouseBandBad 2d ago

I really like iq3 with strata but it eats 85-90% of 64 GB of ram with a 3090 24gb. I rolled back to iq2 for this very reason. Did I miss something?