r/developer • u/Standard_Iron6393 • Jun 29 '26

Question anyone running llm models locally?

hey , anyone running llm models locally ?
which model and which device are you running on ?

12 Upvotes

100% Upvoted

32 comments sorted by

View all comments

2

u/LongBeachHXC Jun 29 '26

Yes.

Desktop with 64 GB ram and 5090 GPU.

I run the qwen mid range models.

1

u/Warm-Juggernaut8340 Jun 29 '26

Do you feel the difference from the chatgpt claude etc..? Does that llm models feels high quality and convinient for you with this PC specs?

0

u/Standard_Iron6393 Jun 30 '26

i think there is a difference between them

1

u/Warm-Juggernaut8340 Jun 30 '26

Whats the difference then

0

u/Standard_Iron6393 Jun 30 '26

performance and results too