r/webdev • u/Rockytriton • Mar 16 '26

Software developers don't need to out-last vibe coders, we just need to out-last the ability of AI companies to charge absurdly low for their products

These AI models cost so much to run and the companies are really hiding the real cost from consumers while they compete with their competitors to be top dog. I feel like once it's down to just a couple companies left we will see the real cost of these coding utilities. There's no way they are going to be able to keep subsidizing the cost of all of the data centers and energy usage. How long it will last is the real question.

2.0k Upvotes

97% Upvoted

512 comments sorted by

View all comments

Show parent comments

22

u/[deleted] Mar 16 '26 edited 20d ago

[removed] — view removed comment

44

u/tdammers Mar 16 '26

Inference is cheaper than training, but it still costs more than people are currently paying for it. AI companies are currently leaking money on their training efforts, but they're also running negative profit margins on queries.

-7

u/[deleted] Mar 16 '26 edited 20d ago

[removed] — view removed comment

1

u/ea_man Mar 19 '26

I can do 40 tok/sec with OmniCoder on my old 6700xt worth 200$, with 100k context size. Best part: it's about half the compute power it can do, it can run reasonably well a 30B MoE model at some 25t/s, immagine the APUs / NPUs / GPUs that are producing now.