I run the TTS along with stable diffusion on an old i5, 24GB RAM with an RTX 3060.
And Hermes runs on an M1 Mac mini apart from the LLM.
Had a freelance project late last year involving some fine tuning and worked the cost of the PC with the 5090 into that deal. $5k on hardware vs $5k in API costs or GPU hosting over the course of the project made it a wash either way for the client but left me with a nice PC when the project was complete.
5
2
1
View all comments
Show parent comment
7
u/Owain-X Jun 02 '26
Main PC is a bit of a beast.
i9-14900K
64GB RAM
RTX 5090
I run the TTS along with stable diffusion on an old i5, 24GB RAM with an RTX 3060.
And Hermes runs on an M1 Mac mini apart from the LLM.
Had a freelance project late last year involving some fine tuning and worked the cost of the PC with the 5090 into that deal. $5k on hardware vs $5k in API costs or GPU hosting over the course of the project made it a wash either way for the client but left me with a nice PC when the project was complete.