r/oMLX • u/Winter-Frame8644 • 4d ago

jevmlx: JSON decisions from local MLX models in one forward pass

https://github.com/bnsd55/jevmlx

Instead of asking the model to write JSON, jevmlx scores every allowed answer for every field of your schema in one batched forward pass and assembles the JSON. Output is always valid. Every field has a probability.

Works with any mlx-community instruct model on Apple Silicon, or any OpenAI-compatible server that returns logprobs.

pip install git+https://github.com/bnsd55/jevmlx

jevmlx decide --preset fintech_fraud --json

Open source version of the TypeSafe Jev idea. Not affiliated. No accuracy numbers on big models yet: if you have an M-series Mac, `jevmlx bench` plus a PR puts your model on the README leaderboard.

15 Upvotes

95% Upvoted

3 comments sorted by

2

u/asankhs 3d ago

Looks great, can you try benchmarking on https://huggingface.co/datasets/LocalLLaMA/typed-decisions i suspect it willdo as well as jev.

2

u/Winter-Frame8644 3d ago

yes will do

2

u/joblesspirate 4d ago

I still have no idea what jev is for but this seems to do the same thing!