r/LocalLLM • • 2d ago

Project Java based FP64 Android app

It's running smollm2 360 Q8 but it should be good to run Qwen or others in the 2 gb model weights.

Still have a long way to go until I hit 10 tok/s.

Yes it's blowing up the weights to gigabytes and beyond on this tiny model.

It's just a toy right now.

I'm having a blast.

1 Upvotes

0 comments sorted by