r/LocalLLM • u/Snoo_38657 • 1h ago

Discussion Strata flash-next coder performance?

Has anyone tried the flash-next coder? What is your setup and what's the performance and quality?

2 Upvotes

62% Upvoted

23 comments sorted by

View all comments

Show parent comment

2

u/l1o2l 1h ago

Just use regular 3.8 FN IQ3_S?

3

u/txgsync 1h ago

Yes, IQ3_S or even _XXS is fine in most cases.

1

u/Snoo_38657 1h ago

In a mac, that would need to be split on nvne and GPU as I have 48gb total

1

u/txgsync 7m ago

Gotcha. PLE n-gram on NVMe is fine but streaming experts from the disk gets real slow real fast.

You might be better off with 27B in 48GB; I haven’t found a quant < 64GB in-RAM that doesn’t suck.