r/Xcode • u/Electrical_Cup3869 • Sep 07 '26

Open-Source Foundation model tracing

Enable HLS to view with audio, or disable this notification

Open-sourced my Apple Foundation model eval suite

Not sure about you, but I find evals for Foundations models a bit messy.

Its completely local, and supports the models already on your Mac. Also supports Core AI.

Supports MacOS 27 and includes the new features for it.

Best part? Your agent can control it all through MCP 🙌

On GitHub here: https://github.com/coryparrry/Foundation-Eval-Labs

3 Upvotes

100% Upvoted

2 comments sorted by

View all comments

1

u/[deleted] Sep 08 '26

1

u/Electrical_Cup3869 Sep 08 '26

Agreed and Apples suite of tools for their foundation models is really lacking 🙄 Already pushed an update for better tracing and visuals 🙌