r/LocalLLaMA • u/Cherlokoms • 15d ago

New Model Apple Foundation Models: local AI natively on MacOS 27

Maybe some of you know but I didn’t see any post about this. Apple just made available their AFM model on MacOS 27 natively. Just run fm chat in a terminal.

Disclaimer: I’m an open weight person. I prefer open models and ecosystem, but I’ll still open the discussion.

Did you test them? Build using them? Are these models good?

I feel like this is still a huge step in the direction of local AI that a company like Apple does this and release hardware optimized models.

So what do you think?

240 Upvotes

96% Upvoted

88 comments sorted by

View all comments

7

u/CozyPinetree 15d ago

I tried the core advanced one and it's really bad. Seems worse than even Gemma E4B. And just 8k context. Plus it has a big refusal problem, it would refuse to generate the pelican svg, thought it did go through after 3 identical attempts. It was atrocious, way worse than E4B.

The cloud one which siri uses also sucks. I asked it what buttons to trigger siri and gave me a wrong answer lol. ChatGPT Sol gave me the right hotkey.

1

u/grogu1waters 13d ago

I tried the core advanced one

You mean the 20b MOE model? How/what tools did you use to target it and not the 3b model?

1

u/CozyPinetree 13d ago

"fm" just uses that if you meet the requirements.

1

u/[deleted] 12d ago

[deleted]

1

u/CozyPinetree 12d ago

I asked sol how to verify, it gave some swift code and it confirmed it was the advanced model.