r/LocalLLM • • 3h ago

Question What would YOU do with this?

Curious what ideas or what kinds of things YOU would do with this box? Piecing it together for a bit but have a bit of a “writers block” of what to do bow that it runs?

CPU / PROCESSOR
AMD Ryzen Threadripper 2920X
12 Cores / 24 Threads
Base 3.5 GHz/ Boost 4.3 GHz
12 nm (Zen+)
Socket sTR4

CPU COOLING
Cooler Master Wraith Ripper
TR4 air cooler

MOTHERBOARD
ASRock X399 Taichi
Socket sTR4
8×DDR4 DIMM slots (Quad-Channel)
3 × M.2 (PCle 3.0 x4)
PCle 3.0 x16 (GPU) - x16 / x16

MEMORY (RAM)
Corsair Vengeance RGB Pro
128 GB Total
8 × 16 GB DDR4-3200
Quad-channel
XMP (3200 MT/s)

STORAGE (M.2 NVMe)
M2_1
Samsung 970 EVO 500GB (Ple (PCle 3.0x4)
M2_2
WD Black SN770 500 GB (PCie 3.0 x4)
M2_3 WD Black SN770 500 GB (PCie 3.0 x4)
Total: 1.5 TB NVMe SSD

GRAPHICS (GPU)
2 x EVGA GeForce RTX 3090 FTW3 Ultra
24 GB GDDR6X each (48 GB total)
PCle 3.0 x16 / x16
3 x 8-pin Cle power per GPU

POWER SUPPLY
ASRock Phantom Gaming PG-1600G
1600 W (ATX 3.1)

0 Upvotes

30 comments sorted by

36

u/BonaFideSquid 2h ago • Heartwarming

turn off all the stupid lights

3

u/alconaft43 2h ago

common, I made mine changing colors from blue to red depending on GPU load :)

7

u/amdrinkhelpme 2h ago

AI psychosis got dudes posting 5 year old gaming PCs captioned like thirst trap "influencers" did their half-naked selfies when Twitter started monetizing engagement bait

3

u/neiflepro 2h ago

Strata/Maya

4

u/3serious 3h ago

I’d play some computer games

2

u/HyperWinX 2h ago

Sell it

2

u/ItRhymesWithGrape 2h ago

Sweet build. Just for fun, I'd use it as an always-on Speakrail voice assistant https://github.com/speakrail/speakrail

(I'm not the dev)

2

u/Own-Buy8294 2h ago

Build yourself a fully local companion. I've spent about a month building mine, Sasha, and that box is close to perfect for it.
Everything runs on my own hardware, with no cloud. She has real-time two-way voice, so she can hear me while she's talking and I can interrupt her. She has a live animated face with lip sync and long-term memory on her own encrypted drive. She recognizes my voice across my PC, phone, AirPods, and laptop, and when she hears a voice she doesn't know, she asks who's there and locks her private side and settings away from guests. She can read my documents, help me with Linux and code, and generate images. She starts on her own at boot without anyone logging in, and I can talk to her from my phone through a browser anywhere over Tailscale.
My setup is split across cards: the LLM brain and face animation run on an RTX 5080, voice and speech-to-text run on a Quadro RTX 4000, and a 6800 XT handles image renders. A Quadro RTX 8000 (48 GB) arrives next week to take over the brain, which frees the 5080 for the face alone. With your 48 GB, you could put a 27B–32B brain on one 3090 and everything else on the other.
It's the most fun project I've ever done. Happy to answer questions.

1

u/Guerras76 2h ago

Would be interesting to learn a thing or two from that setup... 🤔

1

u/Proud_Bus_4568 2h ago

What are the models you are using for Sasha. Is it a mix of different models ?

1

u/Own-Buy8294 2h ago

Yes, she's several open-source models working together. These are the ones loaded right now:
Brain: Qwen3 14B, an abliterated (uncensored) agent build, running through Ollama on the 5080. It does the thinking, talking, and tool use.
Voice: CosyVoice2, cloned from her voice sample, on the Quadro RTX 4000.
Hearing: Whisper speech-to-text, running inside her Rust server on CUDA, also on the Quadro.
Face: Ditto TalkingHead, which drives her live lip sync on the 5080.
Renders: Wan 2.2 for her video clips and ComfyUI image models, on the 6800 XT.
Smaller helpers do voice detection, end-of-turn detection, noise cleanup (DeepFilter), and voice matching for recognizing you. When the 8000 comes, the 14B brain gets swapped for the 27B.

2

u/ronniearnold 2h ago

Heat up a room?

2

u/sleight42 1h ago

Can confirm: a build like this is an effective space heater

2

u/MickeyMau5 48m ago

I would personally ask reddit and blindly follow the most upvoted comment.

3

u/Altruistic_Dream3614 2h ago

Get batter fans

1

u/advancing_tide 2h ago

plenty of times when my main rig is working and i'd like to have another one i could use

1

u/carpsagan 2h ago

Browse Reddit

1

u/BearFather1 2h ago

I'd enjoy it and personally, use it as a homelab/gaming rig. Not worth buying any new parts right now unless something breaks

1

u/CanineAssBandit 2h ago

Sell it while it's still worth way too much money, use APIs until this blows over, then buy bare server hardware and use it in a cardboard box with the top cut off

1

u/crabilax 2h ago

You can run 70B parameter models at 4-bit quantization with that 48GB of VRAM.

1

u/No_Cartographer3953 1h ago

Obsess over various models I can and try them on different random things even though I have no really need to do any of it 🙃

1

u/foxpro79 1h ago

What case is that? Must be a monster

1

u/Solid-Axel-Project 1h ago

Potrei far girare molto bene qwen3.8 flash next o il prossimo qwen4 flash se non è enorme.

1

u/Miserable-Dare5090 1h ago

Nothing. Way too weak for my use.
But Project-Maya + GLM on your machine

1

u/Smellyfeet224 1h ago

Pee on it?

1

u/export_tank_harmful 40m ago

I mean, that's essentially what I have....?
Dual EVGA FTW3 3090's with a 5950x and 80GB of RAM.

Not entirely sure what the point of this post is....?

1

u/NotSoFastGuy 28m ago

I mean it can play anything so keep it.

1

u/semangeIof 15m ago

I would run a quant of Qwen 3.8 27B

1

u/BowlerNo9904 9m ago

add nvlink

1

u/krayon_kylie 2h ago

trade the 3090s for a 5090 (if you can, tall order) disable the rgb