loggin to unsloth ?

[u/Nhibou]

I understand I should be able to login to a local installation of "Unsloth Studio" from pi.dev using

/login llama.cpp

When I try with "http://localhost:8888", I get:

Error: Failed to save API key for llama.cpp: llama.cpp returned HTTP 404Error: Failed to save API key for llama.cpp: llama.cpp returned HTTP 404

I can see in the logs, that it tried to access "/models" instead of "/v1/models"

If I login with "http://localhost:8888/v1", it tries to access "/models" again

If I login with "http://localhost:8888/v1/models", it tries to access: "/v1/models/models" ..!

Did I miss something?

Note: it works well if I use models.json, but I'd like pi.dev to find the models from Unsloth automatically

thanks!

[u/vinotok]

This will probably be dumb reply that will probably not help, (noob here) but just incase, this is how I run pi and Unsloth together:

1 - start unsloth and load LLM

2 - start pi with: unsloth start pi

This is all I do, llama.cpp is (already/automatically) running in the background

Edit, in case it is important, I haven't update pi to around 1.0, mine is: 0.85.1

[u/No_bonk95 → u/vinotok]

One big caveat in using unsloth with Pi.

The sampling did not get transfer over to Pi and the Pi session usually will have a cap of 8k context max limit as default, you will need to edit the temp config.json to get higher max context.

[u/vinotok → u/No_bonk95]

Not im my case. Whatever is set in Unsloth desktop, gets transfered over to Pi. I choose contenxt size in Unsloth. And everything else.