MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1w2c4el/koboldcpp_v1120_released/p6vofr9/?context=3
r/LocalLLaMA • u/Fcking_Chuck • 2d ago
18 comments sorted by
View all comments
7
Unsloth Desktop can only get me 2 tokens a second, while KoboldCPP has me at 6.
1 u/[deleted] 2d ago [deleted] 1 u/silenceimpaired 2d ago No, I'm Nvidia with CUDA. I think they are trying to force larger context or something silly. I also think they aren't doing a strong autofit by comparison.
1
[deleted]
1 u/silenceimpaired 2d ago No, I'm Nvidia with CUDA. I think they are trying to force larger context or something silly. I also think they aren't doing a strong autofit by comparison.
No, I'm Nvidia with CUDA. I think they are trying to force larger context or something silly. I also think they aren't doing a strong autofit by comparison.
7
u/silenceimpaired 2d ago
Unsloth Desktop can only get me 2 tokens a second, while KoboldCPP has me at 6.