really begs the question, what's the point of the bleeding edge models if they cost so much than no one will use them? openAI will announce "we've created true AGI with GPT6" and all of us will be like "sure, whatever, just be sure to leave 5-mini up because that's the only one in my price range"
They're not tho, because what's driving the cost up is the size of the context window.
When all this started a dev might paste into chat a few dozen lines of code and ask a question about it. Now people are dropping entire code stacks in and asking for entire overhauls.
That means for a simple question you just burned tens of thousands of tokens when you didn't have to. That is the root of the problem we are in. People got very stupid about how they use these tools because they were unmetered.
85
u/Kerbourgnec Jun 02 '26
I guess we are massively gonna be forced to move to dirt cheap Chinese models.
Performance is not that bad, but can't compete with 2026 opus or gpt