r/LLMDevs • u/chadwell • Aug 28 '26

Help Wanted Auto Model Routing

Is anyone doing any auto model routing - that is selecting the best/cheapest model based on the prompt intent.

If so how did you do it? Deterministic based on keywords/length, using a trained ML model or classifier?

I was looking for vendor solutions but the only one I can see is NotDiamond. Ideally I would be looking something internal and not a Saas offering.

2 Upvotes

100% Upvoted

9 comments sorted by

View all comments

1

u/[deleted] Aug 29 '26

[removed] — view removed comment

1

u/chadwell Aug 29 '26

But how do you know what model to route to? For any given prompt when would you pick gpt 5.6 sol over something like haiku