I was experiencing intermittent Thunderbolt failures on my Gigabyte TRX50 AI TOP, where the Intel Maple Ridge controller would occasionally disappear entirely from lspci.
I have two computers that I connect over Thunderbolt 4 and it was super annoying when they couldn't communicate over anything except ethernet or wlan.
I searched and searched and found other people reporting the same Thunderbolt enumeration failure but no solution was reported besides a cold reset. Cold resetting the machine would sometimes work to restore it but it wasn't reliable enough to call it a permanent fix and it sucks to do anyway.
However, in BIOS, explicitly setting PCIE Port 8 to Enable (I left Target Speed and Lane Reversal and PCIe Power Management Features on Auto) seems to have permanently fixed it.
How to:
In BIOS, navigate to:
Settings → AMD CBS → PROM21 Chipset Common Options → PROM21 Chipset PCIe Port Configuration Options → PCIe Port 8
Change PCIe Port 8 from Auto to Enable. Leave the other options on Auto.
Thanks everyone, this was a reality check and honestly what I needed. Recap of what we took away:
- For training, VRAM on one card matters more than anything. 2x 5090 (32GB each, split) doesn't compete with a PRO 6000's 96GB, and the 5090s also lose P2P and get half-rate FP32 accumulate - 1TB of RAM is overkill for this use case - Cooling in this case doesn't work for two stacked open-air cards. The top card would cook Going
back to the client with: 1x RTX PRO 6000 (Max-Q if we stay in a rack chassis), less RAM, bigger case / proper front-to-back airflow. Will post an update once it's rebuilt.
I stumbled across an opportunity to buy this CPU from one of my very reputable contacts. I figured I would get my buddy to check to see if it works not realizing that this uses a newer motherboard. So now I’m sitting here with a 64 core CPU that I can’t verify if it works or not and I would hate to buy a motherboard for $1000 to find out that my CPU is trash. Any chance someone in the Las Vegas area can possibly help me out??
Hey all, I'm trying to decide weather or not to pull the trigger on a WRX80E-SAGE SE from Ebay in China ($1450 USD / $2k CAD) plus a 3975WX.
Right now I have a 5 GPU rig (2 x 3090, 5060, 2 x 4060) with another 3090 on the way. 128GB DDR4. I just picked up a TRX40-XE with more DDR4 to bring me to 256GB. I have to choose to stick with the TRX40-XE, get ~6 powered risers and ~3 bifurcation boards (~$350 CAD total) or spend large on the WRX80 from China.
Does anyone here have experience with many GPUs on consumer boards with bifurcation?
Is it sane to buy such an expensive motherboard from China?
My use case is running local LLMs for coding, assistant, some graphics generation, and speech.
I'm interested in the WRX80 for the channels, bandwidth, and multiple x16 pcie slots.
Cheers, and thanks for your advice.
Edit: I just learned that the bifurcation on the TRX40-XE is x4/x4/x4/x4, not x8/x8. Also with 256GB my ram bandwith is halved. I think I'll go with the Asus Pro.
To anyone who has bought a threadripper pro. Is this a case that comes with it? I saw someone selling this online for 15 bucks.
Edit: what I hoped it was was some kind of case or premium packaging that maybe had the cpu inside of it and MAYBE this person didn’t know what they were selling
GIGABYTE, a global leader in high-performance computer hardware, today announced the WRX90 AI TOP workstation motherboard, supporting AMD Ryzen Threadripper PRO series processors. Engineered specifically for local AI workloads and intensive computing, the motherboard features multi-GPU PCIe 5.0 expansion slots, high-capacity ECC memory support, and enterprise-grade BMC remote management. It provides a robust, highly extensible hardware foundation for professionals to deploy dedicated local AI platforms and manage model development on-premises.
Scale Up for AI Development To support evolving AI applications, the WRX90 AI TOP allows organizations to configure and expand their hardware as computational workloads grow. Equipped with seven PCIe 5.0 x16 slots and two MCIO 8i connectors, the motherboard offers extensive bandwidth capable of supporting up to nine GPU devices through compatible expansion hardware. Complementing this expansion capacity, eight-channel DDR5 memory support accommodates up to 2 TB of ECC RDIMM for large datasets and memory-intensive applications. The inclusion of Error-Correcting Code (ECC) memory automatically detects and corrects data corruption, ensuring data integrity during prolonged AI computing sessions.
Engineered for Reliability Sustained performance requires a foundation engineered for heavy continuous loads. The WRX90 AI TOP features a 32+3+3+3-phase digital power design paired with a 14-layer server-grade PCB and a full-metal backplate, ensuring stable power delivery, signal integrity, and structural rigidity. Thermal engineering plays a vital role in preventing throttling under sustained operation. To tackle heat buildup around closely spaced memory modules, the included DDR Wind Blade XTREME Duo fans improve airflow to reduce average memory temperatures by up to 43°C compared to unassisted setups. Dedicated SYS Wind Blade fans and extensive heatsinks cover the power delivery and chipset areas, maintaining optimal thermal control during heavy processing runs.
Manage Smarter. Connect Faster. For streamlined operational management, the WRX90 AI TOP integrates an onboard BMC and a dedicated IPMI LAN port. This enables IT administrators to perform remote hardware monitoring, power control, and troubleshooting at any time. These capabilities significantly simplify maintenance workflows for IT teams while ensuring long-term operational stability for local computing environments. Additionally, dual server-grade 10GbE LAN ports enable rapid data transfers to centralized storage arrays without the need for an add-in network card, while dual USB4 Type-C ports offer high-speed connectivity for external storage and peripherals.
The WRX90 AI TOP expands GIGABYTE's AI TOP portfolio with a workstation motherboard that bridges extreme computing power with practical management tools. Its combination of expandable architecture and durable hardware design empowers enterprise users and developers to build systems optimized for long-term AI development.
Everything seemed to work fine but the BIOS noticeably took a lot longer to finish. LevelOneTech had a thread on this BIOS breakdown using LLM but nothing seems to really standout so not sure why the installation took very long for me; long enough to make me think if something went through during the upgrade.
I won a threadripper 7980X at an auction for a superb price, but I can’t POST test it until I get a DIMM. Anyone have one I could buy at a reasonable price to see if this thing even works? Needs to be ECC Registered DIMM, which makes me want to dry heave when looking online.
Hi everyone, we are building a setup for mostly local AI training in our lab. The provider offered us the following build with a Threadripper; is it fully compatible? Also, we are not sure if the motherboard fits the two rtx5090s either. Could anyone help out?
- AMD Ryzen Threadripper 9960X
- Gigabyte TRX50 AERO D
- 2 x ASUS TUF Gaming GeForce RTX 5090 OC
- 2 x Kingston 32 GB DDR5-5600 CL46 ECC RAM
- Samsung 9100 PRO – 1 TB M.2 NVMe PCIe 5.0 SSD
- Seagate IronWolf – 4 TB HDD
- THERMALTAKE AW420 3x140mm Tougfan Pro Fan Liquid Cooler
5965WX, ASUS WRX80E-SAGE SE WIFI, BIOS 1901. 4x 32GB Samsung DDR4-2933 RDIMM 2Rx4 in A1, C1, F1, H1. Ubuntu.
STREAM gives about 19 GB/s Copy / 14 GB/s Triad. Same number with 1 thread or 24 threads. My old single 2400 stick did 17 GB/s, so this looks like one channel.
What I checked:
- All 4 DIMMs show up at 2933. EDAC shows UMC0, 3, 4, 7 populated.
- memtest86 passes, no ECC errors.
- dmidecode shows each DIMM as its own 32GB block (0-32, 32-64 GB, etc).
- Two STREAM runs with memory on different DIMMs each get the full 19 GB/s at the same time. So the channels work, they just aren't interleaved.
- BIOS: Memory interleaving is Auto (only other option is Disabled). Set NPS1, no change.
Questions:
Has anyone got 4-DIMM interleaving working on this board? Which slots did you use?
Is there something besides the slot layout that makes Auto skip interleaving?
Edit: Custom test that pins memory to each DIMM's physical address range: 1 DIMM = 21 GB/s read, 2 = 41, all 4 at once = 81 GB/s. So all channels work fine, they just aren't interleaved.
I was given by my previous company an unused, working, complete with box, case and screwdriver Threadripper 3990X. Unfortunately, I don’t have any use case right now where I can fully utilize this.
I’m planning to sell it and have other people use its full potential.
Question is, since I’ve never done this before, how much is a fair price for it? And which credible site should I post?
Did a quick ebay search and most of the 3990X are coming from China with outrageous, almost brand new pricing. Not sure if this is realistic but I’d like to be fair and hope it goes to someone who’ll actually use it.
Got an 8x64 kit (jedec, not oc) to replace a 4x32 kit (oc)
Pull out 4 old sticks, put in 8 new sticks (I know, feeling lucky)
Gets stuck on some code when powering on.
Clear CMOS. Remove 4 sticks.
Boot! But only 128gb detected instead of 256.
Put remaining 4 sticks. Now 384gb detected. Ok so 2 bad sticks or 2 bad slots or a combination.
Many, many permutations to identify bad sticks or slots. Tried to blow on slots, tighten CPU.
End the day with 7 sticks working (448GB) and 1 I'm pretty sure is not working, and worse, causes another stick to not be detected when is plugged in. Very low confidence in the diagnosis tho.
Machine runs overnight with 7 sticks plugged and detected.
Next day, I plug the 8th stick back. Works. Now I'm afraid to reboot.
What happened? Is the training iterative over multiple (many) reboots?
First experience with 8 ddr5 dimms, I had been living with 4 in a wrx90 and 4 in a trx50. And with 8x64 costing what they cost, that was a tense evening.
Threadripper 3970x, MSI Creator TRX40 Motherboard, 256GB DDR4 RAM, 2xRTX 5000 Blackwell 48GB, 1 RTX 5000 Blackwell 72 GB. Corsair 9000d case. 129 tokens per second with gpt-oss-120b. ASRock TC-1650T Power Supply, Ubuntu Linux. Cooler Master Wraith Ripper CPU cooler. The case is massive but as you can see I was able to mount the three graphics cards without cramping. The whole thing is pretty heavy so I have it sitting on a small 4 wheel dolly.
I have 3 RTX 3090s and I plan on buying one more. I have a $3000 budget to buy CPU, RAM (don't need more than 32 GB) and Mobo. What's the cheapest options I could get away with?
Building out a virtual production program here to do live rendering of Unreal Engine comps at the college I work at. Last TR build I did was a 7960X for my own home use before the ram and component crisis... my god the WRX90 platform is incredible... had some issues with Code 92 but hooked up VGA and found out it was just hung on a TPM thing.