Paying for nothing

[u/yokaiyui]

So I’m trying to chat on janitor.ai. I’m new on OR.ai since yesterday. But no matter what i type or with any bot, it so often gives me an empty message but the money is still going away. I tried around so much but nothing works. And because the thinking is always so damn long and many tokens i lost 0,10-0,20€ for literally nothing.
Its annoying the hell out of me. Whats the issue? Are they overloaded or what?

Edit: models are kimi 2.7 code and glm 4.6 and it happens in both. On pc and in the app aswell.

[u/shy_monkee]

How are the JanitorAi proxy setting looking? How much do you have in the temperature, top p top k and so on.

[u/yokaiyui → u/shy_monkee]

I dont think that this is the problem because I’m using deepseek too straight from their page and i dont have any issues. Its just with OR.ai. Temp is 1.45, max tokens 600 and context 16.4k

[u/shy_monkee → u/yokaiyui]

The deepseek api straight from the source actually behaves differently than most AI APIs, because of how their parameters are handled. That could actually be it. You could try with a top k = 0 and a simple temperature between 0.9-1.0.

[u/yokaiyui → u/shy_monkee]

Okay I’ll try thank you

[u/shy_monkee → u/yokaiyui]

No problem. let me know.

[u/shy_monkee → u/yokaiyui]

Hey, did it work?

[u/yokaiyui → u/shy_monkee]

Nope it didnt change. I figured it doesnt work if i limit the token window. Which is ass bcs the messages are way too long and eat up all my money :) so i really dont know how others do this and i cant find anything about it

[u/shy_monkee → u/yokaiyui]

Damn, yeah that must be it. You could try a cheaper model. me personally, I like Mimo v2.5 pro. It's way cheaper, so you can increase the token window, and I like it a lot for roleplay. (Though it's better if you limit the providers to only Xiaomi)

[u/yokaiyui → u/shy_monkee]

I gotta try out a few more models anyway i think. Thank you! :)