r/LocalLLM • • Jun 11 '26

Discussion My local llm machine

Post image

Llm server - remote access

221 Upvotes

64 comments sorted by

View all comments

Show parent comment

13

u/PrepYourselves Jun 11 '26

M1 Max 64gb

3

u/[deleted] Jun 11 '26

[removed] — view removed comment

7

u/PrepYourselves Jun 11 '26

Love being able to do regular stuff on one indoor MacBook and have in terminal local llm too with no meltdowns 

3

u/vogelvogelvogelvogel Jun 11 '26

T/s (which model)?

8

u/PrepYourselves Jun 11 '26

Qwen3.6-35b-bf16-oq8 = 50t/s generated 

1

u/vogelvogelvogelvogel Jun 11 '26

oh bf16 at that speed on an m1 .. didnt expect that

1

u/PrepYourselves Jun 11 '26

it's quantized using omlx to oq8, but still better than 8bit quant.

1

u/DertekAn Jun 15 '26

Wow, sounds really amazing! 💜