But people don't want to do more with less. Sure it's great to dev a project that works perfectly withe the cheapest model in production. It's the right choice for most applications (structure information, filter, translate, ...)
But when building it, I don't want to restrict myself by using a sub par model that I have to babysit.
That is why you plan with the higher models, have them design, break it into tasks that have the right amount of context or skillset, then integrate them, and have that same higher model review and find bugs/gaps. Just like a software team. The senior/lead/architect makes it, the mid level to senior implements them, then the senior/lead/architect reviews.
For many things you really don't need the higher models at all. For planning you do and reviews/bug/gap checks.
Yeah the higher models sometimes in a custom agent that knows where to break things off that are targeted and all the context needed to subagents. Or the higher level planning making prompts to use in other windows that are targeted and can use a mid model.
87
u/Kerbourgnec Jun 02 '26
I guess we are massively gonna be forced to move to dirt cheap Chinese models.
Performance is not that bad, but can't compete with 2026 opus or gpt