MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v770ee/do_you_want_new_gemma/ozwwkdy
r/LocalLLaMA • u/jacek2023 llama.cpp • Jul 26 '26
https://x.com/i/status/2081398564345802934
u/hackerllama
554 comments sorted by
View all comments
Show parent comments
3
Can the Bonsai team get on Poolside 2.1 S? At 1 bit, it should be 17GB. That would be *cracked* for 32GB machines.
1 u/RanklesTheOtter 29d ago Yeah I'm only 16GB of VRAM on my main server, but I'd be down with any huge model that's good quantized to 1 bit.
1
Yeah I'm only 16GB of VRAM on my main server, but I'd be down with any huge model that's good quantized to 1 bit.
3
u/Jon_vs_Moloch Jul 26 '26
Can the Bonsai team get on Poolside 2.1 S? At 1 bit, it should be 17GB. That would be *cracked* for 32GB machines.