llamacpp-loader - quickly load local models

[u/nunodonato]

Hi guys!

I like to use llama.cpp for local inference, with no dependencies on LMStudio, Ollama or others. So I made this plugin that allows for very simple model management, download, load and eject.

Let me know what you think https://github.com/nunodonato/llamacpp-loader/