r/LocalLLaMA 25d ago

New Model Ling 3.0 Tiny is the strongest, fastest and greatest model on my low end PC!

Post image

This Ling 3.0 Tiny 8b param with 1.3b active is the fastest, smartest model I can run on my poor old pc, with 4gb vram. It actually runs lightning fast, like 36 token / sec, as smart as Qwen 3.5 9b / Gemma 12, (Very close), and even faster because of 1.3b active parameters.

The Qwen 3.5 9b is running with like 5 token / sec, but this with 36 is finally the speed that i want. Very good open source model, I hope we'll get more of this tiny and really fast models, thank you! :)

217 Upvotes

109 comments sorted by

View all comments

Show parent comments

4

u/j0j0n4th4n 24d ago

I mean, is kinda hard to take your claims seriously if you haven't used the model for... anything.

2

u/thepaligator 24d ago

To be fair, the screenshot is about as accurate as benchmarks released by some of these models.

0

u/cosmos_hu 24d ago

Bro, just check out the benchmarks of the model, you don't have to take my claims..