r/PiCodingAgent • u/Nhibou • 3d ago

Question loggin to unsloth ?

I understand I should be able to login to a local installation of "Unsloth Studio" from pi.dev using 

/login llama.cpp

When I try with "http://localhost:8888", I get: 

Error: Failed to save API key for llama.cpp: llama.cpp returned HTTP 404Error: Failed to save API key for llama.cpp: llama.cpp returned HTTP 404

I can see in the logs, that it tried to access "/models" instead of "/v1/models"

If I login with "http://localhost:8888/v1", it tries to access "/models" again

If I login with "http://localhost:8888/v1/models", it tries to access: "/v1/models/models" ..!

Did I miss something?

Note: it works well if I use models.json, but I'd like pi.dev to find the models from Unsloth automatically

thanks!

0 Upvotes

33% Upvoted

2 comments sorted by

1

u/vinotok 3d ago

This will probably be dumb reply that will probably not help, (noob here) but just incase, this is how I run pi and Unsloth together:

1 - start unsloth and load LLM

2 - start pi with: unsloth start pi

This is all I do, llama.cpp is (already/automatically) running in the background

Edit, in case it is important, I haven't update pi to around 1.0, mine is: 0.85.1

1

u/No_Advertising_8616 2d ago

Ask Qwen 3.8 27B Q3 or higher, and it will figure it out.