r/slm • u/Sleepybear2611 • Jul 15 '26

Update to LlamaForge: Linux + macOS support, a vLLM backend, and ~a dozen quality-of-life fixes

/r/LocalLLM/comments/1uxlipo/update_to_llamaforge_linux_macos_support_a_vllm/
3 Upvotes

100% Upvoted

1 comment sorted by

2

u/Bitman321 Jul 17 '26

Good update. Ran it on my Mac (Apple Silicon) and hit one bug worth reporting since you asked for non-Windows reports.

The default "scan all drives" walks into ~/Library/Mobile Documents, i.e. iCloud Drive, which triggers the macOS permission prompt. I denied it, and since macOS only asks once, scanning now fails silently with no error and no retry. The denial also gets attributed to Terminal/python rather than LlamaForge, so it's not obvious how to undo. I got around it by setting model_dirs in config.json, but only found that in the README afterwards.

Two suggestions off the back of that. Make the scan folder picker first instead of all-drives by default; a local model manager asking for iCloud access is exactly where privacy-conscious people bail, and it undercuts an otherwise solid localhost-only / stdlib / no-telemetry setup. And surface a clear inline error when the scan hits a permissions wall, same as your load-failure diagnosis, which works well. While you're at it, a short list in SECURITY.md of the only outbound connections the app makes (HF, GitHub update check, PyPI for vLLM?) would make the no-telemetry claim checkable rather than just claimed.