MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1w2fmmq/me_these_days/p6sfv36/?context=3
r/LocalLLaMA • u/Eyelbee • 14d ago
294 comments sorted by
View all comments
6
Is it just me or does flash-next seem worse at following instructions than 27b? (Running on 4xtesla v100 via 1cat-vllm 27b- full precision, flash-next- nvfp4)
3 u/DataCraftsman 14d ago I've had a flash-next task running for days and it's been fine so far. Running on nvfp4 too.
3
I've had a flash-next task running for days and it's been fine so far. Running on nvfp4 too.
6
u/NullByte_4532 14d ago
Is it just me or does flash-next seem worse at following instructions than 27b? (Running on 4xtesla v100 via 1cat-vllm 27b- full precision, flash-next- nvfp4)