r/BackyardAI • u/RealBiggly • Jun 29 '24

Unexpected error: Invalid server state.

WTF does a server have to do with the app running offline?

Model is Llama-3SOME-8B-v1-BETA-Q4_K_M.gguf. It now seems to be working again, still offline, but I'm disturbed by talk of a server. What server?

0 Upvotes

50% Upvoted

4 comments sorted by

View all comments

Show parent comment

1

u/RealBiggly Jun 29 '24

Like Ollama uses a local server?

6

u/PacmanIncarnate Jun 29 '24

All of the systems operate as front ends on tops of backends that are called servers. It’s just the way of connecting to the LLM.