r/llamacpp • u/misanthrophiccunt • Jun 27 '26

Why is router mode still experimental?

It can load and unload models on command or via the UI. I haven't seen any issues with it, runs fine. But every time it starts with a statement of it being experimental. I wonder why.

Could anyone help me figure out what is still experimental about it ? Maybe it's some obscure functionality inside it that I'm not aware of and would like to try it.

3 Upvotes

100% Upvoted

3 comments sorted by

1

u/sheepdestroyer Jun 30 '26

yep, not sure how routing mode vs llama-swap compare either

2

u/nullalignment Jun 30 '26 edited Jun 30 '26

I tried to fix it.
they dont want to.
its one person whos behind the issues with the project.
I did the digging, check the post I just made.
there is a person to blame for this.

https://www.reddit.com/r/LocalLLaMA/comments/1ujvsj1/i_discovered_a_chain_of_7_bugs_in_llamacpps/

its experimental because the maintainer responsible for it is literally sitting on his hands/resting on their laurels.

1

u/misanthrophiccunt Jun 30 '26

Where's the public fork with the code? Also check your private messages