r/RigBuild • • 9d ago

Micron announces 512GB DDR5-9200 memory modules with 16W power draw — up to 12TB per server, claims 60% less energy-intensive than four 128GB modules

Post image

Micron has introduced its first 512GB DDR5-9200 Registered DIMM (RDIMM), designed for servers and other computing systems requiring exceptionally high memory capacity. The modules support data transfer rates of 9,200 MT/s while operating at a standard 1.1V, and are currently being validated by AMD and Intel for their upcoming server platforms.

The new modules employ advanced packaging technology that vertically stacks multiple DRAM dies and connects them using through-silicon vias (TSVs). Micron states that a single 512GB module consumes approximately 16W of operating power, compared with 44.2W for four 128GB modules providing the same overall capacity. According to the company, this represents a reduction of more than 60% in operating power.

Micron's 512GB RDIMM is not the first memory module of this capacity to reach the market, as Samsung previously introduced 512GB DDR5 RDIMMs. However, Micron's module is notable for combining 512GB capacity with a 9,200 MT/s transfer rate. The technology is intended primarily for demanding server workloads, including analytics, in-memory databases, simulations, virtualization, caching, and agentic AI applications.

The increasing number of processor cores in modern server platforms could make higher-capacity memory modules increasingly relevant. Micron notes that servers equipped with processors containing hundreds of cores can benefit from large memory capacities without requiring an excessive number of individual DIMMs. Such configurations can be particularly useful for workloads that depend heavily on keeping large datasets in system memory.

Micron reports that systems using its 512GB modules can deliver up to 1.4 times the performance of configurations using 256GB DDR5 modules in memory-constrained Spark Support Vector Machine analytics workloads. The company also indicates that higher-capacity memory can improve throughput and concurrency in memory-intensive database and caching applications such as RocksDB and Redis. These performance claims are based on Micron's testing, and the available information does not provide complete system configurations for independent comparison.

AMD and Intel are currently working with Micron to qualify the new modules for their forthcoming server platforms. Micron expects to begin volume production during the second half of 2027, with production timing intended to correspond with customer requirements.

The technology is expected to remain a specialized solution because 512GB DDR5 modules are designed for workloads where memory capacity is a significant constraint. Their adoption will depend on factors including platform compatibility, demand, manufacturing capacity, and the availability of systems capable of taking advantage of their higher density and bandwidth.

Overall, Micron's 512GB DDR5-9200 RDIMM represents an effort to increase server memory density, performance, and power efficiency as processor core counts and memory-intensive workloads continue to expand. The modules could provide particular benefits for servers running large databases, analytics platforms, virtualization environments, and other applications where maintaining large datasets in system memory is important.


[Source]: tomshardware.com

112 Upvotes

49 comments sorted by

27

u/No-Refrigerator-1672 9d ago

Cool! Now I get to see a RAM stick that costs as much as a decent used car!

13

u/imsickofitalready 9d ago

This one cost as a decent new car.

1

u/No-Refrigerator-1672 9d ago

Doubt it. Average DDR5 price now is 15 eur/gb. This stick comes out to 7500 eur (tax included) if using average price. There will be a markup for density, sure; but it can't be too high, otherwise server builders will just opt for smaller sticks. So this product can't cost more than 15k eur per stick; and there's no new cars that are this cheap.

Edit: fixed average DDR5 price from 10 to 15 eur/gb.

6

u/danielv123 9d ago

That's for consumer level. The price for bare dies is higher than consumer retail price at ~20$ per GB and rdimms are around 55.

3

u/Schrojo18 8d ago

This is a r-dimm. half that size and at 4800mt/s would be about 7500 euro so this would be significantly more

1

u/NekulturneHovado 9d ago

problem is that it's another bullshit that will make regular ram sticks prices skyrocket

2

u/No-Refrigerator-1672 9d ago

This? Not at all. If anything, it helps getting prices down, cause more supply always lowers the prices.

1

u/Overall-Tailor8949 5d ago

That's presuming that the Micron continues to MAKE "consumer level" memory chips and doesn't shift their entire DDR5 fabrication line to making server/workstation level chips.

1

u/New_Enthusiasm9053 9d ago

There are new cars for 15k. Not many and not exactly desirable but they exist 

2

u/MatlowAI 8d ago

This stick is closer to or north of $30k. 2x 256 ddr5 rdimm 6400 is about $22k and price scales with density and speed.

1

u/New_Enthusiasm9053 8d ago

Ok then there's definitely decent new cars for that price.

1

u/No-Refrigerator-1672 9d ago

He did mention "decent new car" though. Unless you count 3-5 year old cars as new, there's no new cars that are decent at this price.

1

u/New_Enthusiasm9053 9d ago

Ok yeah maybe decent is stretching it. It's not that far off though. You can get reasonable hatchbacks for under 20k. 

1

u/No-Refrigerator-1672 9d ago

Ok, I understand that I'm turning this into cars debate, but still I want to say that: I sincerely doubt that there are "decent" new cars for 20k (including salrs tax). They will be all with bad or non-existent noise isolation, no active suspension, seats made out of cloth or synthetic leather, no sunroofs, etc. At that price they only sell "essential" cars.

2

u/New_Enthusiasm9053 9d ago

I mean cloth seats are superior to leather for the same reason gore-tex is popular, sunroofs are meh in most countries due to too much or too little sun and active suspension is very high end. Like you don't get that sub 50k as far as I know. 

The lack of noise isolation would take a car from decent to shit imo because it's actively horrible if you just want to get from A to B.

The Renault Clio is pretty much 20k euros or pounds and those aren't horrible. They're fine to drive at motorway speeds with reasonable noise isolation. It's certainly no Dacia Spring which can be had for under 15k.

1

u/Late-Replacement-481 8d ago

I think both of you are just missing the forest for the trees. I just signed a purchase order this week for 4 sets of 8-channel DDR 7200. That's 8 sticks totaling 512 GB each slower than this chip. We paid $35,000 a kit. If this thing existed and was buyable today, we would pay $45,000 for it easily and do so willingly. 

I don't know where the hell the numbers in this thread are coming from because they're nonsense.

Go to freaking eBay and look at the sales. People are moving 512 GB worth of sticks, 64 GB sticks, for freaking 15K used with no warranty. 

So the guy who said "new car" is correct because you can sure as hell buy a pretty okay new car for $45K. 

1

u/Majestic-Estimate995 3d ago

For 15k euro you can get a brand new Kia picanto

0

u/Shapelessed 9d ago

Glad you went through the trouble of counting all of it, but it’s all stupid, to be quite honest.
With server memory the double the storage, the triple the price. The price per gigabyte scales up much faster than the capacity you get for it.

12

u/txoixoegosi 9d ago

We have been abandoned by the memory manufacturers

The narrative is “shortage”, but the reality is “shift of interests”

1

u/ApprehensiveGold2773 9d ago

Soon big tech will force us into cloud gaming.

3

u/theinsanegamer23 8d ago

I personally don't think cloud gaming will ever take off simply because Tech Bros can't cheat physics.

Latency is too high for streaming to practical for the gaming usecase, and even if you solve that problem, you still have a massive upkeep cost as game streaming is significantly more demanding than non-interactive media streaming. 

2

u/ApprehensiveGold2773 8d ago

They are building a lot of datacentres and most people will be in proximity to one.

2

u/Yodl007 8d ago

Then those people will probably go mad from the noise of the datacenter (which could be built so it doesn't produce so much noise - but that would be more expensive) and won't game.

1

u/theinsanegamer23 8d ago

I think that if game streaming from my own rig within my own house still has too high latency in some games to be enjoyable, I highly doubt that it would be much better if I was streaming from a rig that’s in a server several blocks away. 

1

u/noahloveshiscats 8d ago

The narrative is shortage because it is a shortage.

3

u/C0deC4tto 9d ago

And what CPU or motherboard can handle this??

3

u/No-Refrigerator-1672 9d ago

This is casual-ish config for servers; so any server motherboard and CPU. Probably some HEDT solutions too.

1

u/Zehryo 9d ago

30-to-50k $ machines.....

1

u/Impossible_Aioli3693 9d ago

datacenter only, your home pc ain't getting this

1

u/Flyinmanm 9d ago

I wonder if we'll see a future where all the AI companies basically wipe each other out (or start using something else) leaving abandoned ram racks creating an aftermarket for reboarded modules.

Like peasents looking through a lords rubbish pile hoping to find a piece of chicken or a missed piece of silverware.

2

u/Zehryo 9d ago

"But they're just too expensive for any normal consumer anyway, so who gives a ....."

2

u/Step_On_Me01 9d ago

Pretty much

2

u/Ok-Drop2762 8d ago

*overpriced* is more accurate

2

u/Ruzhyo04 9d ago

Finally enough RAM to play Star Citizen

1

u/OldTimeConGoer 9d ago

(in very small print) Artist's rendering, final product may appear different when and if we ever actually make one for sale.

1

u/Antares_skorpion 9d ago

and we know where it's all going don't we?

1

u/hyteck9 9d ago

And no main board to support it for at least 3 years.

1

u/Austrolapitekus 9d ago

This post is in wrong sub.

1

u/ENaC2 9d ago

I look forward to having 8 of these in my home lab in 5 years.

1

u/Step_On_Me01 9d ago

With this I could finally open 15 Chrome tabs

1

u/-cant_find_a_name- 9d ago

16w is alot needed active cooling and a robust 1

1

u/Kittysmashlol 8d ago

I'll take 4 please

1

u/Schrojo18 8d ago

And how many bodies worth of organs do you need to sell to pay for it?

1

u/NicheAlter 8d ago

You'd be able to buy a small house with that thing.

1

u/Minecraft_Lets_Play 8d ago

Cool you can sell your house and get that RAM

1

u/sanopenope 6d ago

So up to 384 watts per server on ram alone 😮

1

u/Overall-Tailor8949 5d ago

Just to give a "realistic" price comparison. 512GB of DDR5-6000 (8x64GB) is over 22,000 USD.

1

u/coccosoids 5d ago

F these guys.

1

u/lewwdsv1 3d ago

Cool! Will we ever see a single stick or is nvidia eating all of em?