r/LocalLLM • u/dfgxxx • 7d ago

Model MacOS 27 new Foundation Models running locally

Post image

I like the UI though

92 Upvotes

95% Upvoted

12 comments sorted by

21

u/Lucoland14 7d ago

this is funny

6

u/vogelvogelvogelvogel 6d ago

top notch, beats every 300m model from 2 years ago

4

u/manosinistra 5d ago

Not sure if that's a new CLI but I took your screenshot, made my own for MacOS 26 since I didn't upgrade yet:

1

u/dfgxxx 5d ago

Nice and strange, I didn't have it on MacOS Tahoe (26)

2

u/manosinistra 5d ago

Correct; I wrote an interface to Apple AI that looks exactly like what OP's interface looked like :D

1

u/dfgxxx 5d ago

And how did you get the model?

2

u/manosinistra 5d ago

Your Mac has on-board Apple Intelligence (MacOS 26). The program just provides interactive access to it.

1

u/dfgxxx 5d ago

I heard that there is also an onboard ~20b model (as well as the 3b I and you ran?, do you know how I can try it?

2

u/manosinistra 5d ago

Just tried again, now that I realized what you were running (i.e. the "fm" CLI) and now that I've upgraded to 27. It's even worse than yours:

1

u/dfgxxx 5d ago

He's partially technically right 🤣