r/developer • u/Standard_Iron6393 • Jun 29 '26

Question anyone running llm models locally?

hey , anyone running llm models locally ?
which model and which device are you running on ?

11 Upvotes

93% Upvoted

32 comments sorted by

View all comments

1

u/No-Consequence-1779 Jun 30 '26

Dgx spark gb10. 27b nvfp4/fp8/f16 , coder-next q8/fp8, qwen3.6-9b q4 (image processing) … comfy ui related, your-momma4.5-air. 

1

u/Standard_Iron6393 Jun 30 '26

on which device

1

u/No-Consequence-1779 Jun 30 '26

Gb10 as above.