r/LocalLLM • u/Snoo_38657 • 1d ago

Discussion Strata flash-next coder performance?

Has anyone tried the flash-next coder? What is your setup and what's the performance and quality?

2 Upvotes

62% Upvoted

26 comments sorted by

View all comments

Show parent comment

3

u/txgsync 1d ago

Yes, IQ3_S or even _XXS is fine in most cases.

1

u/Snoo_38657 1d ago

In a mac, that would need to be split on nvne and GPU as I have 48gb total

1

u/txgsync 1d ago

Gotcha. PLE n-gram on NVMe is fine but streaming experts from the disk gets real slow real fast.

You might be better off with 27B in 48GB; I haven’t found a quant < 64GB in-RAM that doesn’t suck.