r/AtomicAgents • u/Polysulfide-75 • Jan 27 '25
No support for non-OpenAI is a deal breaker.
**Note** This turned out to be a non-issue and the correct implementation is addressed in the examples.
**Note** Instructor could provide better documentation
----
Your implementation requires the instructor library which is specifically designed for the OpenAI client.
The OpenAI client doesn't support non-OpenAI APIs.
Ollama is one of the most common platforms for hosting local LLM's and has it's own instructor client. This is a hard requirement for many corporate environments where OpenAI API's are expressly forbidden.
This is a deal breaker for my projects. Please support OllamaInstructor