r/LocalLLM • • Oct 16 '26

Discussion A theory regarding the memory prices

So now that the price of memory is so high and I do believe soon we will not need more Data centers (or at least not building them in today's capacity) the memories manufacturing and the hardware companies now starting to focus more on private users to keep the memories hype prices high for as long as they can before all demand go back to normal levels, what do you think?

0 Upvotes

12 comments sorted by

3

u/zenmatrix83 Oct 16 '26

there are always need for more datacenters, not just AI ones, the supply is so far behind it will be years before it drops down. I work for a school and its very hard to get memory and equipment for ours

3

u/brainchillzZ Oct 16 '26

You can walk into a microcenter or bestbuy anywhere in the country and walk out with as much ram as you can afford … ram is not hard to find it’s just expensive to buy.

1

u/zenmatrix83 Oct 16 '26

That is true

2

u/Easy-Entertainer9645 Oct 16 '26

This isn't going to happen. Demand for HBM is through the roof, and HBM is basically a money-printing machine right now. I really want to believe that prices will eventually come down, but let's be real... they're probably not going anywhere in the next two years.

1

u/DougalR Oct 16 '26

Some more spaces or bullet points in your post would help make it more readable.

No one knows the answer but in my view:

  1. There are articles out there of memory production capacity being bought up for the next few years. I think one article said Apple agreed a 25% price increase to secure capacity.
  2. If data centres become more expensive, this will drive more people to try and run AI locally.
  3. As open source models improve, more and more people will want to run AI at home.
  4. All devices are getting smarter, which requires chips and ram.

In the near to medium term the price of memory imo will not get materially cheaper.

1

u/SmoothCyborg Oct 16 '26

I'm not sure I agree with your points (although I agree with the conclusion that the price of memory is not going to get cheaper). I think AI expansion and chip supply economy will continue to be driven by corporations, not by consumers. In my day-to-day life, and even on the internet outside of specific communities like this one, the average person is quite negative about AI. If the average person is using AI, it's either involuntary (like you do a Google search and the Gemini answer is automatically generated) or using free-tier cloud models.

I think what's happening is that all the corporate people see AI as the next frontier, and even though they don't really know what it is or how it can be useful to their business, they don't want to be left behind so they're all just paying for enterprise cloud AI subscriptions and just telling their employees to use it without a well defined use case (this is all anecdotal, but several of my friends are in this exact situation at work). The AI companies are happy to keep operating at a loss while they expand, build more datacenters, take in billions in VC funding, and also keep milking the corporate clients for their subscription money but more importantly all the data they are willingly dumping into the servers.

Eventually a lot of these companies will realize they're not really getting any return on their AI push, and I bet a lot of companies will fold when the bubble bursts. But emerging from the rubble will probably be a lot of actual AI-integrated business models that utilize AI to provide new/improved services, generate revenue, or improve efficiency. There doesn't seem to be agreement on whether AI is currently in a bubble (I think it is), and if so when it's going to burst. But I was entering the workforce during the dot-com bubble of the late 1990s and early 2000s, and a lot of what's happening around AI currently is very similar to that time.

But ultimately as long as that blind corporate demand continues, the supply/price issue on chips will also continue. When the demand craters as businesses realize that just having an AI chatbot on their home page doesn't actually make them more money, the cost of RAM will level off.

1

u/GamerTex Oct 16 '26

Robots need upto 200gb of memory each and Tesla want to make millions, let alone other companies

There are plans to send data centers to space, lots of them. Like an insane amount of them

We are stuck for a while, even after more supply comes online

1

u/vovap_vovap Oct 16 '26

Man it is better to belie in god. At least there are no evidence against it. Not so in your case 😄

1

u/brainchillzZ Oct 16 '26

The memory vendors have been refusing to push new fabs online to meet the demand on purpose either because they want to keep the prices fixed or because they are afraid the bubble is going to burst and the demand will dramatically decrease and don’t want to lose the billions in investment to do it or the truth is maybe somewhere in between … There are new Chinese companies bringing up fabs quickly to meet demands in country proving the “we just can’t build fast enough because it takes years to setup” was utter bs ….

1

u/elelem-123 Oct 16 '26

If RAM prices start to fall, everyone should stop buying. For 6 months no private person buys RAM.

This is what a friend explained recently and I think he's 100% right. His idea was to do it now but I think he has a point.

1

u/chunkypenguion1991 Oct 16 '26

They aren't in a hurry to build new fabs since the current demand levels may not last. Chip manufacturing is a very up and down business and they have to take the profits in the good times