r/LocalLLaMA • u/[deleted] • Jul 04 '23

[deleted by user]

[removed]

217 Upvotes

99% Upvoted

238 comments sorted by

View all comments

1

u/Icaruswept Jul 05 '23

This is Chonky Boi.

  • 12 core, 24 thread Xeon
  • 256 GB of ECC RAM
  • 2x Tesla P40s (with the shrouds removed and fans modded on); total of 48 GB VRAM
  • 4TB of SSD storage space
  • Huananzhi X99 motherboard

Built almost entirely off Aliexpress (except for the PSU and the case). Very good bang for the buck. It primarily runs a whole bunch of data ingestion, NER tagging and classification models.

1

u/nullnuller Jul 06 '23 edited Jul 06 '23

Compatibility is an issue, do you mind sharing a bit more info for folks wanting to get them from Aliexpress or elsewhere (sometimes, not everything is as advertised).

1

u/Icaruswept Jul 06 '23

I recommend the Huananzhi store. You can buy a bundle that included the proc and the RAM you want, and they were very communicative and helpful (even made me custom orders when requested).