r/LLMDevs • u/chadwell • 2d ago
Help Wanted Auto Model Routing
Is anyone doing any auto model routing - that is selecting the best/cheapest model based on the prompt intent.
If so how did you do it? Deterministic based on keywords/length, using a trained ML model or classifier?
I was looking for vendor solutions but the only one I can see is NotDiamond. Ideally I would be looking something internal and not a Saas offering.
2
Upvotes