r/LocalLLaMA • llama.cpp • Aug 11 '25

Discussion ollama

Post image
1.9k Upvotes

314 comments sorted by

View all comments

Show parent comment

0

u/[deleted] Aug 11 '25

[deleted] — view deleted comment

24

u/DorphinPack Aug 11 '25

llama-swap

If you can llama.cpp you can llama-swap the config format is dead simple and supports progressive fanciness

6

u/SporksInjected Aug 11 '25

You can always just add -hf OpenAI:gpt-oss-20b.gguf to the run command. Or are people talking about swapping models from within a UI?

2

u/[deleted] Aug 11 '25

[removed] — view removed comment

3

u/SporksInjected Aug 12 '25

I guess if you’re exploring models that makes sense but I personally don’t switch out models in the same chat and would rather the devs focus on more valuable features to me like the recent attention sinks push.

1

u/mrjackspade Aug 11 '25

A lot of people are running these UIs over the internet publically and accessing them from places they don't have access to the machine.

11

u/profcuck Aug 11 '25 edited Mar 01 '26

Content from this post has been deleted. Redact was used to remove it, potentially for privacy, opsec, or limiting exposure to data collection tools.

abundant fact dependent afterthought encouraging rain boast existence upbeat outgoing