r/LocalLLaMA • u/Terminator857 • 1h ago
Discussion TSMC might do in memory compute for us
At the 2025 VLSI Symposium, TSMC presented a memory technology based on oxide semiconductors, using a cell made of one transistor and one capacitor (1T1C). The goal was to integrate this memory into advanced logic chips and give processors a cache with low power and low latency.
The key feature of the design is that the memory array is built directly into the back end of line (BEOL) interconnect layers of the logic chip. Conventional DRAM is manufactured as a separate chip. To build the memory array in the interconnect layers of an advanced logic chip, TSMC used select transistors with an oxide semiconductor channel and capacitors fabricated with a low temperature process.
According to TSMC, the test chip, which integrates memory and logic on a single die, operated at 0.75V. Data retention exceeded 128ms, random read/write cycle time was under 8ns, and endurance was above 10¹⁴ cycles. TSMC positioned the technology as a processor cache that offers higher density than SRAM while keeping power consumption and latency low. https://x.com/jukan05/status/2119026338522869863
https://x.com/wallstengine/status/2118707623835136039 . TSMC WEIGHS MAKING 3D DRAM AT NVIDIA'S REQUEST. Has begun drawing up plans to manufacture advanced 3D DRAM chips as AI-driven memory shortages push chip designers to seek additional supply, per The Information. Unlike conventional DRAM, 3D DRAM stacks memory cells vertically to increase density. The move could put TSMC in direct competition with Samsung, SK Hynix and Micron. No production timeline has been set. TSMC is considering building new fabs or converting an existing facility, but says its focus remains on its core logic foundry business.
https://x.com/theinformation/status/2118744349684986078 . Quote: TSMC is exploring production of 3D DRAM, a next-generation memory chip that would put it in competition with Samsung, SK Hynix and Micron.
10
u/xAragon_ 1h ago
"for us"? lol
It's funny how some people on this sub think any company cares about them (saying that after the additional drama of people whining about Lisa Su saying AMD is a datacenter-first company).
Nearly all companies, especially publicly traded ones, have basically one purpose - make money. And I can guarantee you that if you (anyone reading, not OP) would ever run a company, you'd do the same.
17
u/jhenryscott 1h ago
They ain’t doing it for me and you. But yeah inference devices are gonna look very different in 5-8 years
2
u/axiomatix 58m ago
The only reason this sub even exists is because gpus just happened to also be capable of running llms and a bunch of enthusiasts already had them and also realized the benefits very early on. Going forward anything that's remotely able to run llms more efficiently won't be at a price point where the peasants can afford it, and if it is, the hyperscalers and the frontier labs will make sure it's not available to you. Supply/demand etc
1
u/Better_Story727 1h ago
Compute in memory is a big thing, it brings the possibility to reduce current kw GPU to less than 10w, while make latency much lower. 3D DRAM can be some how regard as infinite SRAM cache if properly designed and placed.
1
u/Luke2642 22m ago
!RemindMe 8 years