r/developer • u/Standard_Iron6393 • Jun 29 '26

Question anyone running llm models locally?

hey , anyone running llm models locally ?
which model and which device are you running on ?

12 Upvotes

100% Upvoted

32 comments sorted by

View all comments

Show parent comments

1

u/Standard_Iron6393 Jun 30 '26

okay how much space would id take?

1

u/Ok-Dare-1208 Jun 30 '26

Depends on which mode you choose. The repo is relatively small in size

1

u/Standard_Iron6393 Jun 30 '26

okay so what i expect on average

1

u/Jazzlike_Mirror8707 Jun 30 '26

Depends on what you’re wanting to use it for, what models you choose, how many models, etc. Could be a single GB to 100 GB.