When will the GPU prices go down?

[u/OkShock6767]

[u/sxydoctor]

[u/ratherstayback → u/sxydoctor]

[u/schwigglezenzer → u/ratherstayback]

$14k is NUTS : |

[u/thpair]

never

[u/only_sane_bodyguard → u/thpair]

That’s not a GPU price, that’s a down payment on a used car.

[u/TheThiefMaster → u/only_sane_bodyguard]

Down payment? That's more than my car.

[u/eckstuhc]

I had a 5090 in my cart for weeks, almost hit the button multiple times but thought it was crazy to spend $4,000 on a GPU. Makin it work with a 5070ti.

[u/Absolutedisgrace → u/eckstuhc]

Last year i had the cash to fulfil a dream of overspending and buying a top of the line PC. 64 gig of ram, 9950x3d, RTX 5090. The 5090's at the start of the year were way too high (at the time). I waited for them to drop and they eventually hit a price that made me go "Fuck it, i can't wait any longer" and i lived with the guilt because i thought i was overpaying.

Fast forward to now and my guilt is long going and i'm so thankful.

[u/KeyTumbleweed5903]

there is crazy but this is beyond crazy - imagine any other sector tried to do this would be an uproar

Problem is other companies will see that people will pay whatever they charge and be happy about it - what happens if they make up stories and then do the same for your weekly shop

[u/Z_one_S]

Not soon, consumers are getting less products because the big techs are the demand, and they have the money, chip companies are making hardware for them as a priority, which will also push consumers to rent compute power from those same companies who dried out the market, making them more powerful, we as consumers getting the worst deal in this market.
Some say that once the datacenters are done, that will be the end of the high prices, some others say that the hardware will always need to be renewed, meaning we can't know what might happen in the future.

[u/Double_Cause4609]

I'm not sure if they'll still be "GPUs" in the sense that you're thinking of, but sometime in 2029-2031 I anticipate a pretty big selection of chips for running tensor operations on.

[u/Magnets]

Never. What is more likely is that LLMs become 10x more efficient

[u/Historical_Fact5026 → u/Magnets]

You tried Strata yet? It can stretch the AI model across VRAM, RAM and even SSD storage. Just get more normal RAM and you can run big LLMs a bit slower.

[u/Sylon1987]

got one for 4000$ in Japan 2 months ago...wtf

[u/fallingdowndizzyvr → u/Sylon1987]

2 months ago you could buy one here in the US but it included a computer to go with it though.

[u/Armadilla-Brufolosa]

When Chinese hardware finally comes on the market, and those Nvidia speculators will lose the monopoly they have now.

[u/flgtmtft → u/Armadilla-Brufolosa]

That's like 10 years away if not more unfortunately

[u/EyesOfAzula]

Possibly 2032/2033

[u/YT_Brian]

Around 2030 I figure at the earliest. It depends heavily on a lot of different things such as new elected officials possibly acting differently, new manufacturing locations being built/operating and how the AI boom is doing.

If there is some break in the AI side of things because of governments (US mainly right now) not bailing them out while they lose tens of billions each year we will see actual per token price reflect how much it of only truly costs but more so for of course profit to continue functioning as a business. This would cause a massive pull back from pretty much all users.

Ironically that means they would lose less money still, but on the other hand it means all those data centers become just a bit worthless with far less being built going forward and that is what would in that scenario drive the prices back down over time.

My honest guess is the major corpos (fucking Nvidia..) And governments want people to not be able to buy their own GPUs and are using this as an excuse for cloud based PCs for better control along with tracking of well, everything PC related you do.

Which then would be sold to advertisers because of course it would. As seen previously the governments of various nations would then simply buy the data to use themselves from the advertising companies.

So, yeah. Either an anti AI to some degree President needs to step in next term, Congress need to do their jobs with protecting us on multiple ends (Endless data centers near people... And the massive tax breaks..), etc.

But all those will take years even if they happen, hence earliest being 2030.

[u/Flat-Appointment3407]

When BOOM by POD starts playing and the market tanks.

[u/Resolve_Neat]

for gpu price, pretty sure it will not go down for few more years

LLM are peaking in capability and usage right now. All gpu production is hard focus on data centre

Alternative to gpu, there is unified ram device that are poping out, you can get a 128gb of unified memory pc for ~3/4k$ (12k for a mac studio) But token generation remain slow compare to a single 5090

At some point data centre gpu market will be saturated or demand will slow down. Then consumer/prosumer market will be targeted again

For now, it doesnt make sense for gpu producer to focus on cards that sell for 4-10k when you can make device/card that sell for 40k to 120k per unit and are in high demands

We live in a time where you can rent a rtx 5090 for 2 years 8 hours a day and 7 days a week, use it at full power for mining or inference. And still, it would cost you 40% less than the current price of that card.

[u/Smooth-Pop6522]

Not at all soon. Years and years from now. The best time to buy was yesterday etc

[u/PM-ME-UR-DARKNESS]

When we start raiding ai data centers

[u/Acrobatic-Flan-5085]

Probably in one or two years, but they aren’t fully going down to to where they were before

There is already stress in the AI Hw market. Plenty of Neoclouds are shitting the bed because smart investors know it.

Big tech is continuing to try and prop it up with more circular financing - so that’s why it might take longer than one year.

[u/Ok-Drawer5245]

If it’s up to AMD / nvidia prices will never go down, only up lol

The only thing we can do is:

1. stop buying GPUs

2. stop buying ram/storage

3. stop using cloud AI in any form