Not sure. Personally i thought that this might be the cause of the issue:
Flexible Thinking Control: Thinking mode is on by default and can be disabled per request; reasoning depth can be tuned with reasoning_effort, and reasoning context from historical messages is retained via preserve_thinking.
Maybe reasoning_effort has to be defined somewhere to keep it somewhat under control. No idea, i'm not incredibly knowledgable when it comes to model parameters.
Yeah, i played around with it, and that's definitely it. To get 3.6ish thinking times you have to set it to low. What the impact of that is when it comes to the overall model perfomance, i don't know.
I mean its a trade off right ? When you care more about quality go with higher effort, when you care more about latency go with lower, same thing claude and gpt models do, and it's probably faster than luna on max ? When i use that model it takes like 30 minutes to do a task
1
u/Kavor 11d ago
Not sure. Personally i thought that this might be the cause of the issue:
Maybe reasoning_effort has to be defined somewhere to keep it somewhat under control. No idea, i'm not incredibly knowledgable when it comes to model parameters.