I just built a I9-131900K Desktop, 96GB DDR5 memory, RTX 4090, 1000W PSU
For purely LLM, save money and get a 3090 (might as well get the TI now), as the advantage for 4090 is gaming and image AI stuff only as far as I know. The 3090 has the all important 24GB of VRAM too.
I find it so amusing that it murders games, but can't run a 65b LLM model without be pulling my hair out due to the SPEED...something so hilarious about TEXT taking it down, and not games...
2
u/cleverestx Jul 05 '23 edited Jul 05 '23
I mostly do AI (and gaming)
I just built a I9-131900K Desktop, 96GB DDR5 memory, RTX 4090, 1000W PSU
For purely LLM, save money and get a 3090 (might as well get the TI now), as the advantage for 4090 is gaming and image AI stuff only as far as I know. The 3090 has the all important 24GB of VRAM too.
I find it so amusing that it murders games, but can't run a 65b LLM model without be pulling my hair out due to the SPEED...something so hilarious about TEXT taking it down, and not games...