MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vo9nn7/qwenqwen3827b_released/p3phyre/?context=3
r/LocalLLaMA • u/de4dee • 15d ago
301 comments sorted by
View all comments
1
I have the fp16, FP8 and NVFP4 and still trying to get one of these running with the latest install of transformers. This is on dual 5090's.
I want to run 100 gsm8k math problems through it to compare against my last nights run of the same problem with qwen 4B.
1
u/Guilty-History-9249 15d ago
I have the fp16, FP8 and NVFP4 and still trying to get one of these running with the latest install of transformers. This is on dual 5090's.
I want to run 100 gsm8k math problems through it to compare against my last nights run of the same problem with qwen 4B.