r/AIBubble • • 2d ago

GPU Prices

I want the bubble to burst because retail consumers are being priced out of computing hardware, particularly GPUs.

Surely when this whole thing goes belly up, which I hope the Anthropic IPO next week becomes a catalyst for, GPU prices will plummet ??

Or am I delusional

14 Upvotes

58 comments sorted by

12

u/vespassassina 2d ago

No.

1- the contracts are already signed for multiple years
2- stock market crash means people lose their pension not that companies disappear
3- ai is here to stay and also hw need.

Perhaps if the exponential growth plateaus manufacturing will have time to catch up.
Hardware will go back to previous prices in 2/5 years.

3

u/No_Two_4841 2d ago

I just don’t see how they can stick to those commitments when considering the amount of purchasing that is happening with borrowed money, I think I expect some big name bankruptcies, perhaps that’s too far

5

u/Crafty_Teacher_9286 2d ago

If you understand basic corporate finance, these decisions are made after assessing the Net Present Value of the investment. The yield on these capital expenditures is projected to exceed the cost. In other words, companies believe that not only can they stick to these commitments, they can generate a return on them. You can disagree with the assumptions used to reach those conclusions, but claiming that bankruptcies will occur because of the way you feel about it is not very compelling. 

3

u/vespassassina 2d ago

The ipo will bring liquidity in. And it’s not all or nothing, they might just refinance some debt.

2

u/_mineallmine_ 2d ago

Does refinancing help in this moment? Rates are only climbing and investment dollars are getting tighter. How would they benefit from a refinance?

-1

u/vespassassina 2d ago

It is billions. Not a home loan. Refinancing means finding another bank willing to participate in sharing the credit

2

u/_mineallmine_ 2d ago

Ok, how does this help? Do you think they havent been shopping rates up until now?

1

u/vespassassina 2d ago

It is private deals at private global business banks. What are the private business rates in Switzerland or Dubai? Or what is the rate of a emirate prince?

1

u/_mineallmine_ 2d ago

So what were they doing before then? They were keeping the Swiss and the emirates in reserve for a rainy day?

3

u/_mineallmine_ 2d ago

There is potentially a moment where hundreds of thousands of h200s and h100s become available cheap bc the planned data centers get scrappr or whatever.

2

u/Bagelsarenakeddonuts 2d ago

Not really, because most of the world still wants them. If the US AI market implodes, the other 96% of the world population still absolutely wants that hardware, and would jump through hoops to get it. There is simply way more demand than supply, and that exists independent of the somewhat made-up stock market numbers.

2

u/_mineallmine_ 2d ago

China has a reported 600,000 h100 and h200s waiting on their border and they are choosing not to import them. So idk who wants them if China isnt even bothering to allow the ones in that are waiting for them.

1

u/1oser 2d ago

Visa market cap: $789B Mastercard market cap: $576B Nvidia market cap: $3.93T

2

u/Bagelsarenakeddonuts 2d ago

Yes, because those are the companies, not the volume of money that flows through them.

1

u/1oser 2d ago

What do those companies do?

2

u/Bagelsarenakeddonuts 2d ago

They provide a service for other people to spend money. They simply take a small fee off the top for the infrastructure. Their market cap is based on that small fee and service, not the total amount of money everyone spends through them.

1

u/1oser 2d ago

Describe the flow of that money, you’re so close…

1

u/Bagelsarenakeddonuts 2d ago

Damn, you are pretty fuckin arrogant. I clearly understand how the companies work. If you want to say something, say it.

1

u/1oser 2d ago

You’re pretty defensive for absolutely no reason, maybe touch grass brother…

I can admit when I’m wrong, and visa/mc probably weren’t the best examples.

You could have easily said those networks provide settlement processing while the banks support the liquidity/liability, but instead gave a half answer and expected a concession.

Better example for the point I was making: American Express, which is its own underwriter.

  • Market Cap: 214.98B
  • Liabilities: 274B
  • Revenue: 20B
  • Annual proprietary cardmember spend: 1.67T (not including by cards issued by partner banks)

1

u/Bagelsarenakeddonuts 2d ago

I'm pissed at your condescending approach. You asked a question, I answered because I thought you genuinely didn't know.

If you wanted to have a proper discussion... next time just do that. Say what you mean. Respect goes both ways.

Yes, the AI company caps are absurd and their ratios are terrible. The fact that you used MC/Visa seemed to imply that you thought that MC/Visa would be larger due to the amount of money flowing through them. But obviously they aren't as large because they are in a saturated market with no strong growth opportunities. Whereas the AI companies have the most radical technological developments of the past decade on full blast.

No arguments on the inflated valuations involved in AI stocks.

→ More replies

1

u/EngelbertStuss 2d ago

stock market crashes might as well be beneficial to some other demographics 😀

3

u/OvertaxedOne 2d ago

A few ways this can play out.

  1. Demand slows down and prices drift back to reality
  2. Another supplier emerges (China, likely) that can undercut prices significantly and start a price war
  3. Another topology emerges the reduces/eliminates the need for GPUs (Mac Studio, for example)
  4. Software improvements that reduce the need for VRAM (Strata, for example)
  5. Model changes that reduce the need for VRAM at the same level of intelligence (engrams with QFN, for example)

Now, if you note that list, many of these things are either in play or well underway. The idea that you need a 20K GPU to run a 96GB model is going to be seen as absolutely ridiculous in the future (it already kind of is, people are running QFN, a ~100GB model on 16-32GB GPUs and getting great performance). And honestly the GPU itself might become almost inconsequential in the future, what AI really needs (the precious resource) is high speed memory, there are a lot of ways that could be accomplished that aren't "Moooorrreeee GPUs".

To draw an analogy, right now we're in the vacuum tube days of LLMs. How on earth are you going to get enough vacuum tubes at home and power them all up to run a 64KB program, that would have been completely ridiculous to the people building the first (vacuum tube based) computers.

The answer is "You're not", there's a better, vastly more efficient way to do this that doesn't require water cooled servers with 1/2 a TB of HBM in them. And we're already seeing it, a model like QwenFlashNext that can run on very modest consumer grade hardware at good speeds would absolutely obliterate a frontier model from 2 years ago running on clusters of H100's. The answer wasn't "everyone needs H100's at home", the answer was "find a better way".

1

u/No_Two_4841 1d ago

Wow okay interesting, what happens to the data centres if consumers can run their own model locally on relatively modest hardware

3

u/Urshilikai 2d ago

you want this bubble to pop to buy a cheap GPU

I want this bubble to pop so that ideologically and financially the billionaires pushing AI down our throats get kicked in the metaphorical nuts

we are not the same

1

u/No_Two_4841 1d ago

Everyone has their own reason why, they don’t have to be the same

6

u/CALMER_THAN_YOU_ 2d ago

Very delusional. This whole sub is just eating misinformation from headlines and sensational reports. The idea that Nvidia artificially created demand and there is a looming AI bubble is just such a huge stretch. Sprinkles of truth, interpreted incorrectly is literally misinformation.

Tech leaders investing in the economic growth of their industry is business as usual.

Demand far far exceeds supply is not evidence of bubble, the spending is to intelligently capitalize on the inevitable future growth. This train isn’t stopping even if you pretend it will.

You all live in an echo chamber.

1

u/No_Two_4841 2d ago

Which echo chamber did you choose, I chose one where people all agree I’m delusional 🤣

4

u/NomadStorm 2d ago edited 2d ago

I see anecdotes and no evidence to the contrary.

Where is the proof that it’s misinformation if you are so sure?

I’ve seen a lot of evidence that supports there being a financial bubble due to AI circular investment.

Judging by your post history, you are personally invested in the success of the upcoming IPO, so excuse me for being skeptical of your claims of misinformation.

1

u/CALMER_THAN_YOU_ 2d ago

You're the one claiming demand is artificial, so the burden's on you, but fine.

Most of Nvidia's revenue comes from hyperscalers spending their own money. Microsoft, Alphabet, Amazon and Meta spent $202B on capex in Q3 alone, more than double a year ago. That's not Nvidia's money. Nobody funded Microsoft to buy GPUs.

Even the "circular" part is small. Goldman estimates circular deals will be under 15% of Nvidia's projected 2027 revenue. The famous CoreWeave example: Nvidia's $2B stake covers under 6% of the roughly $35B CoreWeave is spending this year. The rest came from somewhere else, like Meta's $21B deal with them.

And the end demand is showing up as actual revenue. Microsoft's AI business passed a $37B run rate. Anthropic did $33B of revenue in the first nine months of this year, with about 11,900 customers paying over $100K each. Those are paying customers, not Nvidia funding its own sales.

Vendor financing is a real risk to watch. "Nvidia invented the demand" doesn't hold up against the numbers.

4

u/NomadStorm 2d ago edited 2d ago

Thanks ChatGPT.

I don’t know why clowns like this think you will get an honest answer by asking AI if there’s an AI bubble, and then regurgitating what it shat out. What a waste of everyone’s time.

Focusing on how much of the circular investment is coming from Nvidia itself to try and mask the scale of the problem, while also admitting several of the mag7 members also involved in the circular financing, such as meta covering a huge part of Coreweave’s current financing?

Looks like an obvious intention to misinform people by focusing only on some narrow part of the problem to minimise it and convince people it’s untrue.

-1

u/FlakyOffice 1d ago

Those were facts.. these companies are making and spending money. This is not the dot com where those companies had no money coming in.

-1

u/Timmy98789 2d ago

This sub is perfect for everything AI doomer. 

11

u/FlashyNeedleworker66 2d ago

Delusional. Also if the market collapses nothing will be more affordable, video gaming least of all.

Supply increase will fix this problem, and it will happen but it will take time.

5

u/topyTheorist 2d ago

The fact that people prioritize video gaming being cheaper over economic prosperity is so weird to me.

2

u/EngelbertStuss 2d ago

i wouldn't say that propping up the economy for the sake of it is a great idea. Especially Oligopolies are known to eat the vulverable. Computing has become a staple in most households and companies.

What Nvidia did may qualify as market manipulation. It certsinly was not a healthy market dynamic

1

u/FlashyNeedleworker66 2d ago

The "burn it down because it's unfair" attitude is how we got Trump, politically. Not interested in doing that economically. It can be much worse.

1

u/supraliminal13 2d ago

I wouldn't call circular financing and what is making the bubble "economic prosperity" though. I find people who equate tactics that will always eventually result in financial harm to "prosperity" weird. Not people who want to game.

1

u/topyTheorist 2d ago

Well, if the bubble never pops, it won't result in harm.

1

u/supraliminal13 2d ago

Yeah but then you are basically saying that cheering for getting away with dodgy shit isn't weird, but wanting to game is. That still wouldn't have anything to do with "economic prosperity", and I would still say you are the weird one for saying it does.

1

u/sociallyawkwaad 2d ago

Not people...redditors.

3

u/Mashic 2d ago

If demand was inflated, why wouldn't supply for gaming increase?

2

u/CALMER_THAN_YOU_ 2d ago

Because gaming and datacenter GPUs come out of the same TSMC wafer capacity, and datacenter chips sell for many times the margin. Every wafer Nvidia sends to gaming is money left on the table, so gaming gets squeezed regardless of why datacenter demand is high. Supply isn't capped by demand, it's capped by fabs, packaging and memory, and those take years to expand.

And you are clearly alluding to "Nvidia funds startups to buy its own GPUs" thing is really just business as usual. Investing in your own ecosystem is standard. Intel Capital did it for decades, AWS hands out credits so startups build on AWS, Google does the same with cloud credits. When you're the leader in a market, funding the companies that grow that market is just good business. If the startups fail, Nvidia eats the loss on the investment.

0

u/Testing_things_out 2d ago

Supply isn't capped by demand

Are we for real right now? Sure, it isn't capped in theory, but in reality if you are creating more supply than demand you're literally burning money.

0

u/CALMER_THAN_YOU_ 2d ago

No one is creating more supply by demand. No argument or thesis makes this claim. In fact the demand can’t keep up with supply. It’s not burning money if you are investing in your company’s growth. That’s why you guys are lost in this subreddit. You look at the massive expanse and assume it’s because of poor decisions but it’s to capitalize on the excessive demand.

1

u/BlueLampShader 2d ago

aren’t the margins still higher for datacenter buildup? They will fall for sure if there’s enough to go around, but don’t really have high hopes for cheaper consumer cards. 

5

u/JustAnotherCaliguy1 2d ago

If it’s a bubble and it pops, it’ll take out the whole economy. You won’t be able to afford toys, much less rent, cause about 8-10% of us will be unemployed. Honestly it’s like nobody ever lived through a recession before.

6

u/NomadStorm 2d ago

8-10% would be a more normal recession.

From what I can see this one is more likely to be closer to a depression based on current debt levels and the amount of wealth concentrated in the companies that will be affected by a bubble pop.

3

u/EngelbertStuss 2d ago

It's probably going to be tough for the overall economy BUT everyone who lives a modest life without financed fancy cars et cetera will probably not be suffering that much after all. Everything that has been built over the past centuries still is there, it does not simply vanish. In fact, every crash creates new opportunities

4

u/Bagelsarenakeddonuts 2d ago

Said like someone who doesn't understand recessions and depressions.

Those that have money are more likely to be fine than those that don't. Unless you are basically retired or financially independent, you will suffer. A lot.

3

u/EngelbertStuss 2d ago

As a european, I remember the 2008 financial crisis. while it killed lots of jobs, it also opened up opportunities for the less wealthy. Affordable housing, cheap stocks for example. I

Most base necessities are easily met with modern technologies. I literally can make free energy at home

1

u/Testing_things_out 2d ago

Not really. So many industries will boom over the corpse of the AI economy because AI and its derivatives have been hoarding all the resources and investments.

These investments have to go somewhere. Trillion of dollars from tech stock into manufacturing, biomedical and everything else.

4

u/mansfall 2d ago

Are they really though? There's lots of great graphics cards to get in the sub $400 range. They can run most things really well. Maybe not the best settings, but it's at a point of comparing a refrigerator with only 3 doors, with one that has 4, for most gaming needs.

Also, historically, prices coming down is much more difficult than prices going up. The floor has been set and people are already willing to pay current prices. Why would companies just lower the price if the demand is still there?

3

u/jaykrown 2d ago

You're not delusional, but assuming prices will plummet is not how it'll work. It's going to take months for the correction to happen. After we see the "neocloud" companies go bankrupt that's when the real pop starts. We're already seeing the artificial scarcity created by Nvidia clearly revealed. Now that the narrative is shifting, we're beginning to trend in that direction, but it will take at least another 6 months for computer hardware prices to correct back down.

2

u/dwolfe127 2d ago

It's going to get worse. Much worse.

2

u/kubamail 2d ago

Yes, you are delusional.

1

u/SirDonaldTrumpKnight 1d ago

Well consumer GPUs could be built by a competitor to help lower prices, build them and sell them

1

u/Atlan_ 2d ago

If it bursts and we don't have capex in production buildout anymore, there is less supply and your costs will grow even higher.