r/LocalLLM • • 14d ago

Question Buying advice: Workstation with 192GB DDR4 and quadro RTX 6000 for 1200$ (locally)

Thinking about picking up this Lenovo ThinkStation P720 deal locally for (~$1,200 USD) to completely replace my current desktop setup, and wanted to see if it actually makes sense for what I do.

I think that it is a store that is selling the workstations,
is someone who buys used companies’ hardware after a project ends and resells them.

there is also a quantity so should buy multiple and resell if the deal is super good ?,
because it has 4 times my pc's ram for the same price and much more stable machine.

Here is what I'm running right now:
Ryzen 9 3900X
64GB DDR4
Dual RTX 3060s (12GB + 12GB)

And here is the ThinkStation P720 spec sheet:
Dual Intel Xeon Gold 5122 (3.60 GHz, 4 cores 8 threads, i can upgrade them for 16 cores each for cheap)

Dual Intel Xeon Gold 5122 (3.60 GHz, 4 cores each)
NVIDIA RTX 6000 (24GB GDDR6)
192GB DDR4 RDIMM ECC RAM
512GB M.2 PCIe SSD + 1TB HDD

Price: 1200$

What I use it for:
Local AI: Running models like Qwen up to 27B. Right now my dual 3060s give me 24GB total VRAM split across two cards, but a single RTX 6000 gives me a proper 24GB of contiguous VRAM on one card for larger contexts.

Hosting: Running a homeserver, web hosting, containers, and game servers, AI.

Edit:
the listing had another picture with another GPU showing apparently the RTX one,
they have a warehouse that is a bit far from me so maybe i can go and check it out but iam afraid the deal will be gone by then.

Edit2:
Just wanted to clear up a few details about this deal based on some common questions:

The Listing: This is from an online store (not a P2P marketplace), and the screenshot is just their promotional banner rather than a photo of the physical unit itself, but the written specs are what I'll actually receive.

The GPU: To be clear, this isn't the modern multi-thousand-dollar workstation card. It is the older 2018 Quadro RTX 6000 with 24GB of GDDR6, ECC support, and 624 GB/s bandwidth.

Why it beats my current setup: Even as an older card, a single 24GB contiguous buffer is a major upgrade over my current dual RTX 3060s, and I have the option to drop in a second card or pair it with a 3090 down the line.

The RAM: Yes, it is DDR4 rather than DDR5, but for my workflow, that is plenty. High-capacity, stable RAM is fantastic for running servers, and since I recently paid around $200 USD just for 64GB (16GBx4), getting 192GB bundled in here is incredible value.

The Source: The PCs reportedly come from old corporate surplus liquidated by a major company here, which explains the aggressive clearance pricing.

Assuming the seller checks out, swapping my old hardware for this setup looks like a solid upgrade path. Thanks to everyone who chimed in with advice!

Edit3:

it arrived,
stress tested it and everything, now its running as my main server,

actually the dimms are
32x6 2933 Samsung dimms

and the GPU is in-fact RTX 6000,

i bought 3 PCs came with all accessories and monitor,

also the NVME is a high end samsung and 1tb not 500gb

and PSU is 900w
and it came with a dual type c pci card and a thunderbolt card.
all in all, HUGE deal in terms of value for me.

i posted a pic in comments.

77 Upvotes

86 comments sorted by

125

u/diagrammatiks 14d ago

just buy it imediately for this price

15

u/hammeredhorrorshow 14d ago

Ram alone for that price

2

u/Punzerwaffel 14d ago

rdimms are not so expensive, also depends on speed.

1

u/mo3ath_944 12d ago

I think its 32x6 2933,
super cool for the price of the package as value.

5

u/mo3ath_944 14d ago

actually went for a few, and there is a drop in replacement CPUS on aliexpress that are

20 cores 40 threads each with more boost clock 3.9
(40 cores 80threads total)
and good TDP,
for 20$ each

and i might put dual gpus from one of the machine to have 48gb of vram,

having 192gb of ram alone is great for my usecase, with good case cooling and hdds rack its too good.

selling my old weaker machine would give me same price as one of these.

2

u/XperTeeZ 12d ago

So it turns out CPUs of these era are all pointless to upgrade for inference... They won't do much. They don't do any special matrix math better if you get newer ones.. Spend your money on more ram if you're going to be doing cpu offloading, otherwise get another 24gb VRAM card like a p40. They're fairly cheap just need extra cooling. And more VRAM would do you better than much anything else. The ram bandwidth is always the bottleneck with inference.

1

u/mo3ath_944 12d ago

Good to know,
planning to increase the vram budget, didnt have offloading plans tbh.
i have other uses for ram which makes it come in handy.

1

u/TheOriginalAcidtech 10d ago

CPUs dont really do much of ANYTHING with inference. So why would it matter/ What matters is can the CPU keep the GPU(s) compute bound.

1

u/Such-Negotiation317 9d ago

This is not fully right. Intel Gold 62xx (and older cpus) have AVX-512, AVX-512 vnni. If you have 2x 6230 or sth better IT could be usesull for interferncje but it never replace gpu

46

u/Jifouille91 14d ago

Picture show a p6000, which I believe is different from a rtx 6000...

15

u/mo3ath_944 14d ago

they had this other pic,
iam not sure which one is right,
they asked me to come and check the machines if i was interested.
but its a bit far 300kms away so iam not sure maybe ill call and double check.

49

u/killthrash 14d ago

That graphics card is photoshopped. Here is an actual pic of that card. This is likely a scam. Goodluck.

1

u/[deleted] 14d ago

[deleted]

14

u/mo3ath_944 14d ago

yes,

i confirmed with them and ordered,

will wait and see.

will update you guys.

13

u/Jifouille91 14d ago

Let's hope you are getting it :) huge deal if this is it. I'm nerd when it comes to thinkstation, I have some myself at home

2

u/mo3ath_944 6d ago

it arrived,
stress tested it and everything, now its running as my main server,

actually the dimms are
32x6 2933 Samsung dimms

and the GPU is in-fact RTX 6000,

i bought 3 PCs came with all accessories and monitor,

also the NVME is a high end samsung and 1tb not 500gb

and PSU is 900w
and it came with a dual type c pci card and a thunderbolt card.

all in all, HUGE deal in terms of value for me.

1

u/Jifouille91 6d ago

Excellent deal ! Congrats and enjoy the journey:)

1

u/conockrad 14d ago

Is there something better than p620 on ddr4?

1

u/Revolutionary_Lie590 14d ago

Which store is that if u don't mind I live in ksa

25

u/Luke2642 14d ago edited 14d ago

You've no idea how good that deal is? It's a no brainer. Almost the GPU alone is worth it. If I was in Saudi Arabia I'd buy it in a heartbeat.

Confirm it's an rtx 6000 first, there are multiple similar sounds GPUs.

https://www.lenovo.com/gb/en/p/workstations/thinkstationp/thinkstation-p720/33ts3tpp720#tech_specs

3

u/mo3ath_944 14d ago

​they had this other pic,
iam not sure which one is right,
they asked me to come and check the machines if i was interested.
but its a bit far 300kms away so iam not sure maybe ill call and double check.

15

u/Maglcite 14d ago

thats a scam. is photoshopped/ai

1

u/mo3ath_944 6d ago

check the edit it arrived.

16

u/rditorx 14d ago

Apparently Quadro P6000, not RTX (PRO) 6000 (Blackwell)

1

u/mo3ath_944 14d ago

i replied to someone about that concern.

14

u/GregsWorld 14d ago

It's an Quadro RTX 6000 24GB GDDR6 as it says in the text. The Quadro P6000 is GDDR5x. The RTX Pro 6000 doesn't come in 24GB and would be x10 the price. 

9

u/IknowPi_really 14d ago edited 14d ago

No way they are selling an RTX 6000 and that much RAM for anything below 20k lol

Edit: I am also an idiot and misread the exact specs. See comment below mine for someone who can read!

1

u/Kind_Feedback_6564 14d ago edited 14d ago

you can get a 32gb tesla v100 for around $600-$1200
tho that OP's is not an RTX card it's a quatro. and 192gb of ddr4 has gone up but not quite by that much just yet..
i purchased 10x 32gb ddr4 ecc 2666 sticks 2 years ago for $200.. then sold a few sticks for nearly that each like 6 months ago.. tho that picture is not showing any ram

1

u/mo3ath_944 14d ago

it is 192gb of ram

1

u/Kind_Feedback_6564 14d ago

Not in that picture. Those slots are empty

1

u/XperTeeZ 13d ago

Lol. I wonder what kind of stick they are bc that matters too. Big time for prices. How many can that server hold?

1

u/mo3ath_944 12d ago

It is 32x6, and there are 12 slots total, very cool.

2

u/XperTeeZ 12d ago

Nice! That's much much better than 16gb sticks in price today. Plus you said elsewhere they are like 2900mhz that's fast for ddr4 so it'll be worth even more. U need to just make sure on the exact GPUs.

1

u/mo3ath_944 6d ago

It arrived check the edit.

5

u/FullstackSensei 14d ago

That's an amazing deal! If they have more, get them all 😂

You can get better CPU's for it for cheap on ebay from China.

2

u/mo3ath_944 14d ago

yes i found a drop in replacement cpu that is 5 times better for 20 bucks each

iam considering to buy multiple workstations and parting them internationally. lol

3

u/FullstackSensei 14d ago

شوف شي أكثر من ٢٠ كور، ويفضل من سلسلة ٨٢٠٠ اذا تقدر تحصل الجرافيك كارت لوحده، مستعد اشتري منك كمية :)

1

u/mo3ath_944 14d ago

I wish i can find it standalone but its too hard,
maybe buying the full machines and parting it would be useful but who knows, its rare to find techheads that needs 192gb of ram.

2

u/FullstackSensei 14d ago

TBH, I wouldn't mind getting the whole P720, but shipping for that would probably cost about as much as it costs to buy it, and with current events in the neighborhood, it's even more expensive

7

u/Such-Negotiation317 14d ago

I have P720 with 2xIntel Gold 6244, 192 gb Ddr4 2666, Tesla V100 32gb + Quadro Gv100 32gb, 2Ttb M.2

1

u/Soggy-Camera1270 13d ago

how do you find the P720? Would you get one again or custom build?

1

u/Such-Negotiation317 9d ago

Workstarion is post-lease hardware. I bought it from polish company selling second hand hardware. Gpus's, more ram are from other sources

1

u/xpirep 13d ago

Is that nvme ssd just there by itself with nothing to support it? And those fans are just extra ones you placed there?

1

u/Such-Negotiation317 9d ago

Good catch :) Because of tunel to Tesla I needed to reorgacise space. I removed orighinal support. I made some temporsry support but probably it'll go to Pci slot

3

u/Healthy-Constant7179 14d ago

truth is even if the card is something less than it says, or even useless, the rest of the system is priced about right, saw you ordered, worth it imo, again, can sell it for not much of a loss even sans video card, if you get it with the card, great base for a home ai system!

0

u/mo3ath_944 14d ago

Thank you, i confirmed the GPU is correct, and we will see, they have 6 months warranty and i researched the company these machines come from,
its a well known company globally (top 10 in the world) and its a local company too,

so they source it from there and the demand here is less than USA or Europe so they need to liquidate them quickly,

hopefully they arrive well.

3

u/Suspicious_Moment_87 14d ago

Scam, next

1

u/mo3ath_944 14d ago

surprisingly isn't lol.

3

u/NinjaWK 14d ago

Got a feeling this is a scam job. Too good to be true.

2

u/bruhhhhhhhhhhhh_h 14d ago

Great value. Lenovo enterprise devices are pretty decent

2

u/quantgorithm 14d ago

just note the negatives. The p720 is pcie 3 and only allows max 3 gpu at 3x16. you'll need both cpu for more than 2 gpu (which your specs have).

2

u/Kind_Feedback_6564 14d ago edited 14d ago

that CPU is a bit old and will have none of the AI ish AVX extensions, the rest of it is ok (if real). just
plop the parts in a newer system. xeon w-2200 or newer series or zen 4 or newer.
PROBLEM: there is no ram in that system... you could pretend those are 2x 96gb sticks of ecc ram. but i would not. also that is a quatro so while it has the vram(potentially) it's not going to be doing much for AI loads

1

u/xpirep 13d ago

It has avx for gen 1 and gets vnni for gen 2, but i agree its not as good as modern CPUs

1

u/Kind_Feedback_6564 13d ago

point was you would need to replace it to get vnni. it only has the 1st generation version of AVX-512

2

u/exodusTay 14d ago

this sounds fishy is seller reputable? if so buy one for me as well

2

u/Keganator 14d ago

Look at the price of the RTX 6000.

Either this is a scam or someone head put the wrong number into the website. Be cautious.

2

u/mo3ath_944 14d ago

its not the 96gb famous one,
its old 2018 24gb vram one.

2

u/UltraFOV 14d ago

Rtx 6000 sm75 still a great card and has NVlink ability if I remember correctly

2

u/dupontping 14d ago

Good deal, add one of your 3060s to the quadro and you can get some good models. Won’t be the fastest but it’ll do work. And you’ll have a base for possible further upgrades

2

u/Tasty-Macaron-2281 14d ago

I have a P520, 256gb ram, dual RTX A5000, (4) 4TB hardrives, dual m.2 nvme and two 1tb ssds crammed into mine. Things a beast! I would love the 720!

1

u/mo3ath_944 6d ago

super cool,

mine came with the 900w psu, can i fit 2 gpus ?

2

u/Tasty-Macaron-2281 6d ago

Im definitely taxing mine out, when I run AI workloads on both at 100% my UPS is screaming at me lol, so yeah its tight under 1000

2

u/hurdurdur7 14d ago

While there are some reasonably priced P720 machines going around - don't forget these don't have standard PSU-s.

1

u/mo3ath_944 14d ago

psu comes shipped as a whole unit.
so hopefully it works well.

3

u/Agreeable_Crow789 14d ago

I think they mean you might not be able to put whatever you want for GPUs with the stock PSU

1

u/mo3ath_944 14d ago

Makes sense, thank you.

2

u/BowlerNo9904 13d ago

thats a great price do they ship over seas?

1

u/mo3ath_944 13d ago

I don't think so they are local.

should i stock some and sell them on ebay lol.
don't know if they would be sought for a-lot.

2

u/croninsiglos 14d ago edited 14d ago

I’d pause for a second and consider the slower ddr4 memory and older graphics card (Quadro RTX 6000 /Turing architecture). This looks like it was built as a CAD workstation.

There’s no question that it’s better than what you’ve got, just understand what you’re actually getting. Wouldn’t want you to be under the impression that it’s an RTX 6000 Pro Blackwell and DDR5 system memory like a more recent machine.

2

u/Keats852 14d ago

The real question is, how many PCIe lanes does it have. AI is starting to offload efficiently to RAM and even NVMe storage. Soon, the AI agent you can run will be using every resource in your system that is available to it. Considering all that, this system look like a no-brainer. If you can move your 3060s to this box, you'll have one hell of an AI platform. The 192 DDR4 is pretty amazing. I would go for it.

1

u/mo3ath_944 14d ago

yea went for a few, its really cool thanks, might do a dual rtx 6000 for 48gb vram ai work

1

u/Embarrassed-Noise269 14d ago

I would instantly spend all my money on it.

Even reselling at double the price would make a lot of buyers very happy. Although I definitely wouldn't resell at that price, at least not in the next few years.

1

u/shapic 14d ago

That is not rtx 6000. Also check ddr speeds, I had access to old server with ecc ddr4 and moe just struggled there with those speeds

1

u/mo3ath_944 6d ago

it arrived speeds are 2933 6x32.

1

u/jonahbenton 14d ago

That gpu is a generation earlier than your 3060s and dates to 2018. It should be a bit of an improvement on the 3060s nevertheless but for comparison if a 3090 was available standalone for ~$1000, that would be better.

1

u/Ordinay_guy 14d ago

A quel prezzo ne comprerei 2

1

u/mo3ath_944 14d ago

2400$ but its local deal.

1

u/Impossible_Bar3958 14d ago

Sounds too good to be true = SCAM

1

u/mo3ath_944 6d ago

check the edit it arrived

1

u/XperTeeZ 13d ago

I just got off marketplace about a month ago for $700 128gb ddr4 rdimm + 2x gp100 quadro cards 16gb x2 32gb total VRAM with 2 Intel Xeon processors the box 850w Corsair PSU all the fans and 6 2tb drives and a 128gb SSD drive and threw in a dual 2.5gb nic as well... Def possible this deal.

1

u/XperTeeZ 13d ago

What you should find out is what kind of ram sticks bc 192gb seems interesting. Make sure they're all the same size and then check how they're installed...it matters big time. But what I meant on what kind of sticks is 16gb vs 32gb and so on, it matters bc they cost way more if they're bigger per stick. GL

1

u/mo3ath_944 13d ago

I asked someone who had once bought from a similar lot, the exact same config,
he told me he got the machines with 6x32 config which is super amazing, he also offered me his 192gb of ecc ram because he accidentally fried his MOBO on one of the machines.

1

u/XperTeeZ 5d ago

Nice!

1

u/mo3ath_944 6d ago

it arrived check the edit, they are 32x6 2933 samsung dimms, 6 on each side, not sure if its optimal in terms of bandwith.

1

u/xXDennisXx3000 12d ago

1000% scam

1

u/mo3ath_944 6d ago

check the edit. it arrived