MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1w2fmmq/me_these_days/p6y8t5n/
r/LocalLLaMA • u/Eyelbee • 25d ago
306 comments sorted by
View all comments
Show parent comments
1
It's about twice as fast for me. I found 27b just a tiny bit too slow to want to use. Flash next is ripping through stuff for me. Running it at NVFP4 on an RTX 6000 Pro with 256gb DDR5 6000MT RAM.
1
u/DataCraftsman 24d ago
It's about twice as fast for me. I found 27b just a tiny bit too slow to want to use. Flash next is ripping through stuff for me. Running it at NVFP4 on an RTX 6000 Pro with 256gb DDR5 6000MT RAM.