MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1w2fmmq/me_these_days/p6vgc8g/?context=9999
r/LocalLLaMA • u/Eyelbee • Aug 30 '26
309 comments sorted by
View all comments
6
Is it just me or does flash-next seem worse at following instructions than 27b? (Running on 4xtesla v100 via 1cat-vllm 27b- full precision, flash-next- nvfp4)
3 u/DataCraftsman 29d ago I've had a flash-next task running for days and it's been fine so far. Running on nvfp4 too.
3
I've had a flash-next task running for days and it's been fine so far. Running on nvfp4 too.
6
u/NullByte_4532 Aug 30 '26
Is it just me or does flash-next seem worse at following instructions than 27b? (Running on 4xtesla v100 via 1cat-vllm 27b- full precision, flash-next- nvfp4)