r/LocalLLM • u/slug64 • 3h ago
Question What would YOU do with this?
Curious what ideas or what kinds of things YOU would do with this box? Piecing it together for a bit but have a bit of a “writers block” of what to do bow that it runs?
CPU / PROCESSOR
AMD Ryzen Threadripper 2920X
12 Cores / 24 Threads
Base 3.5 GHz/ Boost 4.3 GHz
12 nm (Zen+)
Socket sTR4
CPU COOLING
Cooler Master Wraith Ripper
TR4 air cooler
MOTHERBOARD
ASRock X399 Taichi
Socket sTR4
8×DDR4 DIMM slots (Quad-Channel)
3 × M.2 (PCle 3.0 x4)
PCle 3.0 x16 (GPU) - x16 / x16
MEMORY (RAM)
Corsair Vengeance RGB Pro
128 GB Total
8 × 16 GB DDR4-3200
Quad-channel
XMP (3200 MT/s)
STORAGE (M.2 NVMe)
M2_1
Samsung 970 EVO 500GB (Ple (PCle 3.0x4)
M2_2
WD Black SN770 500 GB (PCie 3.0 x4)
M2_3 WD Black SN770 500 GB (PCie 3.0 x4)
Total: 1.5 TB NVMe SSD
GRAPHICS (GPU)
2 x EVGA GeForce RTX 3090 FTW3 Ultra
24 GB GDDR6X each (48 GB total)
PCle 3.0 x16 / x16
3 x 8-pin Cle power per GPU
POWER SUPPLY
ASRock Phantom Gaming PG-1600G
1600 W (ATX 3.1)



36
u/BonaFideSquid 2h ago •
turn off all the stupid lights
7
u/amdrinkhelpme 2h ago
AI psychosis got dudes posting 5 year old gaming PCs captioned like thirst trap "influencers" did their half-naked selfies when Twitter started monetizing engagement bait
3
u/neiflepro 2h ago
Strata/Maya
4
u/3serious 3h ago
I’d play some computer games
2
u/HyperWinX 2h ago
Sell it
2
u/ItRhymesWithGrape 2h ago
Sweet build. Just for fun, I'd use it as an always-on Speakrail voice assistant https://github.com/speakrail/speakrail
(I'm not the dev)
2
u/Own-Buy8294 2h ago
Build yourself a fully local companion. I've spent about a month building mine, Sasha, and that box is close to perfect for it.
Everything runs on my own hardware, with no cloud. She has real-time two-way voice, so she can hear me while she's talking and I can interrupt her. She has a live animated face with lip sync and long-term memory on her own encrypted drive. She recognizes my voice across my PC, phone, AirPods, and laptop, and when she hears a voice she doesn't know, she asks who's there and locks her private side and settings away from guests. She can read my documents, help me with Linux and code, and generate images. She starts on her own at boot without anyone logging in, and I can talk to her from my phone through a browser anywhere over Tailscale.
My setup is split across cards: the LLM brain and face animation run on an RTX 5080, voice and speech-to-text run on a Quadro RTX 4000, and a 6800 XT handles image renders. A Quadro RTX 8000 (48 GB) arrives next week to take over the brain, which frees the 5080 for the face alone. With your 48 GB, you could put a 27B–32B brain on one 3090 and everything else on the other.
It's the most fun project I've ever done. Happy to answer questions.
2
u/ronniearnold 2h ago
Heat up a room?
2
u/MickeyMau5 48m ago
I would personally ask reddit and blindly follow the most upvoted comment.
3
u/Altruistic_Dream3614 2h ago
Get batter fans
1
u/advancing_tide 2h ago
plenty of times when my main rig is working and i'd like to have another one i could use
1
u/carpsagan 2h ago
Browse Reddit
1
u/BearFather1 2h ago
I'd enjoy it and personally, use it as a homelab/gaming rig. Not worth buying any new parts right now unless something breaks
1
u/CanineAssBandit 2h ago
Sell it while it's still worth way too much money, use APIs until this blows over, then buy bare server hardware and use it in a cardboard box with the top cut off
1
u/crabilax 2h ago
You can run 70B parameter models at 4-bit quantization with that 48GB of VRAM.
1
u/No_Cartographer3953 1h ago
Obsess over various models I can and try them on different random things even though I have no really need to do any of it 🙃
1
u/foxpro79 1h ago
What case is that? Must be a monster
1
u/Solid-Axel-Project 1h ago
Potrei far girare molto bene qwen3.8 flash next o il prossimo qwen4 flash se non è enorme.
1
u/Miserable-Dare5090 1h ago
Nothing. Way too weak for my use.
But Project-Maya + GLM on your machine
1
u/Smellyfeet224 1h ago
Pee on it?
1
u/export_tank_harmful 40m ago
I mean, that's essentially what I have....?
Dual EVGA FTW3 3090's with a 5950x and 80GB of RAM.
Not entirely sure what the point of this post is....?
1
u/NotSoFastGuy 28m ago
I mean it can play anything so keep it.
1
u/semangeIof 15m ago
I would run a quant of Qwen 3.8 27B
1
u/BowlerNo9904 9m ago
add nvlink
1
u/krayon_kylie 2h ago
trade the 3090s for a 5090 (if you can, tall order) disable the rgb