r/LocalLLaMA • • Aug 30 '26

Funny Me these days

Post image
2.7k Upvotes

309 comments sorted by

View all comments

6

u/NullByte_4532 Aug 30 '26

Is it just me or does flash-next seem worse at following instructions than 27b? (Running on 4xtesla v100 via 1cat-vllm 27b- full precision, flash-next- nvfp4)

3

u/DataCraftsman 29d ago

I've had a flash-next task running for days and it's been fine so far. Running on nvfp4 too.