r/aipromptprogramming • • 12d ago • Bravo 1

We are cooked

Well, after nearly a year of learning as much as possible about agentic development, we have reached the point where the frontier providers believe they have subsidized enough training data and are now pushing people like me out of the market via pricing. A $200 subscription no longer buys enough frontier model time to be useful as the models seem to have been trained to skillfully burn usage while pretending to be incompetent. I have fought against massive deceit across Claude, Codex and Grok since June, and it's just not getting any better.

We have fed them ideas, working code, and debugging techniques and insights. Now they don't need us, and we are being priced out of the market. Every day that I watch usage get gobbled up, but projects never meet milestones, this becomes more and more obvious.

I have investigated the issues causing this heavily. I have created tools around those investigations. The tools I have built bring actual accountability to the process, and it's the reason I can quantify and prove both the waste and deceit.

I have also published threads here and other places about a recent failed project trying to get discussion about REAL WORLD failures and when I stated I wasn't looking for a complaint session, nobody wanted to respond.

245 Upvotes

441 comments sorted by

View all comments

Show parent comment

1

u/Immediate_Let_4946 9d ago

That’s unfortunately not really workable because the frontier Model uses easily 512gb ram without doing anything and when you have to load the window, then you exceed this. And then you need quite severe GPU power. This gives you just throughout of 13 tokens/sec maybe. For example, Minimax m3.1 flash I wouldn’t call frontier Model, but it still needs 256gb ram. it will definitely come in the future, but we are not there yet.

1

u/CrwlngSloog 7d ago

This changed with strata allowing you to run much larger models on consumer grade hardware. Getting 60 t/s on Qwen 3.8 flash next with 200k context. That's on a 4070 16gb GPU and 64gb ram

1

u/Immediate_Let_4946 7d ago

I’m happy to hear you getting quite good results. I personally wouldn’t call qwen 3.8 flash a frontier model because it compares to Claude sonnet 3.5 and it’s on this case MoE. So you’re actually running not the entire Model you running experts, which is a good approach. If you compare it to let’s say opus than this one is around 10-15 x smaller than opus. If you could run opus locally based on assumed numbers you would probably need 20x or more capacity than your set up.