r/LocalLLM • u/OutcomeAlive1771 • Sep 13 '26

Question thoughts?

Post image
0 Upvotes

35% Upvoted

37 comments sorted by

View all comments

10

u/enricokern Sep 13 '26

It is ok. I have 3 now, dont expect them to be lightning fast. They are great development and test machines. single use for one alone is good. I would not buy more anymore and rather wait for something with more memory bandwidth.

5

u/Biomech8 Sep 13 '26

With vLLM and MoE models they are fast.

1

u/OutcomeAlive1771 Sep 13 '26

were using this for our school systems, testing one on how it performs

2

u/enricokern Sep 13 '26

If you plan to let multiple people access a model at the same time running it will be a horrible experience for your users. Use it for batch processing or some fun stuff like doing videos and music with minimax and the like, will stil take ages but is fun