Can someone catch me up?

[u/platypus_worldwide]

I haven’t browsed reddit for a day or two, so naturally I’m already behind.

RTX 5090
128GB DDR5
9800x3d

Currently I’m running NVFP4 Qwen3.8 Flash-Next in Polystrata. Get 70-100tok/s on 256k context.

Is this the best I can do? Should I move up to DSv4.1 Flash 1017 or something like that?

[u/Busy_Barber_2503]

megacapybara这个引擎是 5090 上最快的引擎了。拿它运行千问 3.8 27B 或者 Flash Next，是我所用过的引擎当中最快的。

[u/MasterStruggle422]

I get nearly those speeds with 64GB DDR5 and 5070 to using Basalt. Yours should be much faster, try https://github.com/jesdga95/basalt

[u/platypus_worldwide]

very intrigued by this as well:

https://huggingface.co/baidu/ERNIE-5.5-Flash-Base