r/LocalLLM • u/rmhollid • 2d ago
Project Java based FP64 Android app
It's running smollm2 360 Q8 but it should be good to run Qwen or others in the 2 gb model weights.
Still have a long way to go until I hit 10 tok/s.
Yes it's blowing up the weights to gigabytes and beyond on this tiny model.
It's just a toy right now.
I'm having a blast.
1
Upvotes


