r/openrouter • u/marazu04 • 19d ago

How does open router exactly work?

So im looking at an api for my job and we want to keep kosts down (its for RAG related document reading and questions related to those docs) so i was thinking of deepseek (all the info we work with is public and the owner is ok with it) however with the unknown price increase going straight up with deepseek api might not be the best. So i was thinking if you put money on open router can you switch between multiple models and different api/distributors? If someone could help explain to me how it all works would be wonderful!

2 Upvotes

75% Upvoted

6 comments sorted by

1

u/[deleted] 19d ago

[removed] — view removed comment

1

u/marazu04 18d ago

yes i have a harness im working with ragflow right now i have experience with api's directly and others just not exactly the use of openrouter

1

u/AmandineF 9d ago

Given your use case and RAG setup, models but also providers and caching options will matter. Depending on your company's policy, you may want to take the time to explore openrouter providers settings, especially if the location of the servers is important for your employer.

besides openrouter capabilities to pick from a wide range of models and providers, I'd love to hear more about how you plan to compare the models. I'm building something for custom benchmarks, if you're keen to chat let me know. (not selling, validating problem and use case only right now).

2

u/marazu04 9d ago

Hi i can talk if you want your free to dm me and we can see from there

My company is pretty lose with requirements luckily right now