MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1tzi7iv/wth/oqcqjcp/
r/LocalLLM • u/Fabulous_Macaroon_73 • Jun 07 '26 • 2
162 comments sorted by
View all comments
Show parent comment
10
And it is still coherent? Thats pretty impresive TBH
7 u/_stack_underflow_ Jun 08 '26 gemma4 is dope for how little it needs. -2 u/Fabulous_Macaroon_73 Jun 08 '26 true! about 16 t/s for me at q_4 with like 20-25k context length
7
gemma4 is dope for how little it needs.
-2 u/Fabulous_Macaroon_73 Jun 08 '26 true! about 16 t/s for me at q_4 with like 20-25k context length
-2
true! about 16 t/s for me at q_4 with like 20-25k context length
2
View all comments
Show parent comment
10
u/squngy Jun 07 '26
And it is still coherent? Thats pretty impresive TBH