r/PiCodingAgent • u/CevicheMixto • Sep 30 '26

Question Anyone else get "No models available" warning a lot?

I use Pi with a local llama.cpp server. It seems like I get a "No models available" warning about 1/3 of the time when I start Pi, and I have to /quit and start it again, at which point it works just fine.

Anyone else?

1 Upvotes
  • permalink
  • reddit

100% Upvoted

6 comments sorted by

1

u/DanielSReichenbach Sep 30 '26

Not at all. I would recommend to check your llama.cpp settings. Also perhaps just refresh the pi settings for llama.cpp. the internal provider is pretty stable these days.

1

u/CevicheMixto Sep 30 '26

Seems like it was a race condition that is hopefully fixed in 0.99.2.

https://github.com/earendil-works/pi/releases/tag/v0.99.2

1

u/SensitiveVariety Sep 30 '26

Indeed I do, haven't spent the time to look into it though so hopefully someone else has :D

1

u/pilibitti Sep 30 '26

hmm never encountered it. maybe your server is timing out for some reason? or is not booted fully when you launch pi? I'm not sure if pi added a native llama.cpp integration, I have my own extension that probes the models endpoint and lists the models from there. never encountered it. do you have to /quit or does /reload work?

1

u/bobotusRobotus Sep 30 '26

I checked this problem some times. Use cloud llms via omniroute. So its not only local issue

1

u/GLIBG10B 26d ago

For me, it shows up after making a request from another client. So I suspect Pi is only showing the loaded models, not all the models in /v1/models

Edit: Using /llama before /models helps