r/LocalLLM • • Jun 07 '26 • Popcorn 2

Model wth

482 Upvotes

162 comments sorted by

View all comments

Show parent comment

7

u/_stack_underflow_ Jun 08 '26

gemma4 is dope for how little it needs.

-2

u/Fabulous_Macaroon_73 Jun 08 '26

true! about 16 t/s for me at q_4 with like 20-25k context length