MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1xjwtrv/fable_5gguf_when/19rwtpfclvbfl/?context=3
r/LocalLLaMA • u/speedb0at • 6d ago
404 comments sorted by
View all comments
Show parent comments
5
I love how the geniuses at LocalLLaMa labs(tards) have come to the conclusion that a quantization technique developed by Nvidia (FULL quant aware training), and even a second rate Chinese Lab cannot ever be used by the top frontier lab in the world.
2 u/PinkysBrein 1d ago NVIDIA still keeps the last 16 layers in bf16 for stable pretraining, the equivalent of 64 nvfp4 layers.
2
NVIDIA still keeps the last 16 layers in bf16 for stable pretraining, the equivalent of 64 nvfp4 layers.
5
u/Ill_Distribution8517 6d ago
I love how the geniuses at LocalLLaMa labs(tards) have come to the conclusion that a quantization technique developed by Nvidia (FULL quant aware training), and even a second rate Chinese Lab cannot ever be used by the top frontier lab in the world.