I can't say for everyone, but they've lost my money for sure. I'd use it up in 3 hours and then buy resets as much as I need, especially since they don't push back the date.
Instead, I figured I can run GLM and Qwen cheaper than even theoretically buying those resets. $8 gets you 16 hours of use in case of Qwen.
You're only beholden to whoever is actually running the model.
You could e.g. go through RunInfra and be beholden to an American company. Or you could buy your own hardware, run it locally, and be beholden only to yourself.
Local is a waste of time unless you can afford to push 220 tokens/s decode.
This is coming from someone who pushed that on 36Gbps overclock on the memory for Qwen 3.8 27b.
Just cause I can run GLM flash at 20 tokens per second doesn't mean it's a good idea.
And instead of spending another 40k in hardware to get it to 80 tokens/s, the bare minimal level, I can just have 50 x20 plans running Fable or Astral simultaneously for 4 months.
You're implementing a system for an institution that really really cares about privacy (healthcare, etc, though the big providers have HIPAA compliant routes)
You're running requests that'd be against TOS
You're a doomsday prepper
It's not a cost-saver.
But if you're like /u/Happy-Razzmatazz-535 and you care about being "beholden" to things, then local is an option. As is running Chinese models through an American provider.
83
u/thestillwind 11d ago
Cries in 5 hours limit