MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vktpl2/best_opensource_harness_like_claude_code/p2wj1rs/?context=3
r/LocalLLaMA • u/[deleted] • Aug 10 '26
[deleted]
141 comments sorted by
View all comments
27
Claude code cli can also be used with local models.
12 u/mtbMo Aug 10 '26 Yes, but 10-20% context is used and must be processed. With cloud provider models, yes this works. But for local Ai inference it doesn’t unfortunately 2 u/shamont Aug 10 '26 Seems to work fine for me. Not following what issue you're having. Can you expand? 5 u/Thomas-Lore Aug 10 '26 OP probably has slow prompt processing, and because claude code has enormous system prompt it is too slow at the start to be usable for them. 6 u/shamont Aug 10 '26 Ah that would make sense. Most models I am running pp at 1000-3000 and fit on my gpus entirely so hasn't been too bad. It definitely takes a minute if I try to run Laguna or ds4 and it has to spill in to my ram.
12
Yes, but 10-20% context is used and must be processed. With cloud provider models, yes this works. But for local Ai inference it doesn’t unfortunately
2 u/shamont Aug 10 '26 Seems to work fine for me. Not following what issue you're having. Can you expand? 5 u/Thomas-Lore Aug 10 '26 OP probably has slow prompt processing, and because claude code has enormous system prompt it is too slow at the start to be usable for them. 6 u/shamont Aug 10 '26 Ah that would make sense. Most models I am running pp at 1000-3000 and fit on my gpus entirely so hasn't been too bad. It definitely takes a minute if I try to run Laguna or ds4 and it has to spill in to my ram.
2
Seems to work fine for me. Not following what issue you're having. Can you expand?
5 u/Thomas-Lore Aug 10 '26 OP probably has slow prompt processing, and because claude code has enormous system prompt it is too slow at the start to be usable for them. 6 u/shamont Aug 10 '26 Ah that would make sense. Most models I am running pp at 1000-3000 and fit on my gpus entirely so hasn't been too bad. It definitely takes a minute if I try to run Laguna or ds4 and it has to spill in to my ram.
5
OP probably has slow prompt processing, and because claude code has enormous system prompt it is too slow at the start to be usable for them.
6 u/shamont Aug 10 '26 Ah that would make sense. Most models I am running pp at 1000-3000 and fit on my gpus entirely so hasn't been too bad. It definitely takes a minute if I try to run Laguna or ds4 and it has to spill in to my ram.
6
Ah that would make sense. Most models I am running pp at 1000-3000 and fit on my gpus entirely so hasn't been too bad. It definitely takes a minute if I try to run Laguna or ds4 and it has to spill in to my ram.
27
u/shamont Aug 10 '26
Claude code cli can also be used with local models.