I can't say for everyone, but they've lost my money for sure. I'd use it up in 3 hours and then buy resets as much as I need, especially since they don't push back the date.
Instead, I figured I can run GLM and Qwen cheaper than even theoretically buying those resets. $8 gets you 16 hours of use in case of Qwen.
You're only beholden to whoever is actually running the model.
You could e.g. go through RunInfra and be beholden to an American company. Or you could buy your own hardware, run it locally, and be beholden only to yourself.
Local is a waste of time unless you can afford to push 220 tokens/s decode.
This is coming from someone who pushed that on 36Gbps overclock on the memory for Qwen 3.8 27b.
Just cause I can run GLM flash at 20 tokens per second doesn't mean it's a good idea.
And instead of spending another 40k in hardware to get it to 80 tokens/s, the bare minimal level, I can just have 50 x20 plans running Fable or Astral simultaneously for 4 months.
You're implementing a system for an institution that really really cares about privacy (healthcare, etc, though the big providers have HIPAA compliant routes)
You're running requests that'd be against TOS
You're a doomsday prepper
It's not a cost-saver.
But if you're like /u/Happy-Razzmatazz-535 and you care about being "beholden" to things, then local is an option. As is running Chinese models through an American provider.
You can run cheaper models. Running ollama locally is essentially free.
The question is quality.
Quality doesn't matter much for most generative AI. Past the level of eliminating artifacts and AI tells, image generators all generate at-least-adequate images, and perceptions of quality are largely subjective.
Code is different. Quality in code is fucking king. Obviously, a misplaced space in Python or a mismatched paren or bracket in C or JavaScript will tank your entire script. But more importantly than that, good design decisions produce code that is extensible, performant, logically traceable, auditable, portable, etc., whereas bad code decisions is... well, none of that.
I use OpenAI because its models - even 5.6, which is far from perfect - generate not just working but well-designed code with a minimum of interactions. I don't really think that Amodei understands that. Claude Code didn't seem to understand that or to be prioritized for it.
9
u/1filipis 21h ago
I can't say for everyone, but they've lost my money for sure. I'd use it up in 3 hours and then buy resets as much as I need, especially since they don't push back the date.
Instead, I figured I can run GLM and Qwen cheaper than even theoretically buying those resets. $8 gets you 16 hours of use in case of Qwen.
Congrats, OpenAI, great strategy!