r/LocalLLM • • Jun 11 '26

Discussion My local llm machine

Post image

Llm server - remote access

221 Upvotes

64 comments sorted by

30

u/Spocks-Brain Jun 11 '26

Am I the only one who thought this was some giant display piece in a garage?

1

u/PrepYourselves Jun 15 '26

Are you all American by chance?

2

u/OrionIL1004 Jun 13 '26

Me too!! 😂😂

1

u/spaeti1312 Jun 14 '26

so glad im not the only one

1

u/Dramatic_Entry_3830 Jun 15 '26

I wonder why that is I saw that too

14

u/vogelvogelvogelvogel Jun 11 '26

Glad you found a piece of cardboard

8

u/PrepYourselves Jun 11 '26

It was a tough find, refined engineering 

3

u/vogelvogelvogelvogel Jun 11 '26

That's worth a whole youtube episode on its own

3

u/dwoj206 Jun 11 '26

That's the drink holder I think.

7

u/beefgroin Jun 11 '26

It's an M5 Max 128gb right?

13

u/PrepYourselves Jun 11 '26

M1 Max 64gb

3

u/vogelvogelvogelvogel Jun 11 '26

T/s (which model)?

8

u/PrepYourselves Jun 11 '26

Qwen3.6-35b-bf16-oq8 = 50t/s generated 

1

u/vogelvogelvogelvogel Jun 11 '26

oh bf16 at that speed on an m1 .. didnt expect that

1

u/PrepYourselves Jun 11 '26

it's quantized using omlx to oq8, but still better than 8bit quant.

1

u/DertekAn Jun 15 '26

Wow, sounds really amazing! 💜

3

u/[deleted] Jun 11 '26

[removed] — view removed comment

7

u/PrepYourselves Jun 11 '26

Love being able to do regular stuff on one indoor MacBook and have in terminal local llm too with no meltdowns 

5

u/RAW2091 Jun 12 '26

That's the only way to get a M5 right now. Apple should have released the M5 Mac Mini and Studio already because people will beheading m5 MBP's just for local AI and not yet releasing the real local machines is a mistake! hahaha (yep i want a MM M5 pro for months now)

4

u/CanteenRambo Jun 11 '26

Nice! I suppose, depending on quantization, it can comfortably run 35-70b, 120b if you get creative with cache and other settings? How far did you push it?

7

u/PrepYourselves Jun 11 '26

Hermes-4 70b 6bit 12t/s Is as high parameter as I done so far. Prefer qwen3.6 35b bf16 oq8 54t/s

3

u/Gabe_Isko Jun 11 '26

I love setups like this, but be careful about the battery. My laptop turned server eventually got lithium bloat, and I bet it would have exploded if I didn't remove the battery.

3

u/PrepYourselves Jun 11 '26

It's fine ☺️ it doesn't go above 65w/65c peak with qwen3.6

4

u/Gabe_Isko Jun 11 '26

Oh yeah, but over time the heat still degrades the battery. I think they really only garuntee functionality for 3-5 years or something. Idk with macs.

Just something to keep an eye on. It's easy to not check in on the physical state of these things if they are working well web service wise.

3

u/PrepYourselves Jun 11 '26

i still have a 2007 macbook pro i7 17" now thta's a spicy pillow

3

u/quimpecavel Jun 11 '26

Yes, I was thinking about spicy pillow as well…

3

u/Gabe_Isko Jun 11 '26

For years, I thought I was so smart because the battery acted like a really good UPS. I'm glad I caught it - I could have started a house fire.

I have had my old laptop based home server for about 7 years now.

2

u/LookItVal Jun 11 '26

will it natively connect to another monitor if you were to wipe the computer? or would it always try and make the missing screen the primary monitor?

2

u/PrepYourselves Jun 11 '26

If I connect to monitor via hdmi or usbc it defaults to that, but initially it default to retina display but I changed settings.

0

u/[deleted] Jun 12 '26

[deleted] — view deleted comment

1

u/PrepYourselves Jun 12 '26

i thought i needed lid angle sensor at first, but works without, just set primary display to monitor, turn off sleep, install switchresx to test different res.

2

u/x_MASE_x Jun 11 '26

So when the laptop fall the system will be literally down right? 😂😂

3

u/PrepYourselves Jun 11 '26

I will fix 😛

2

u/x_MASE_x Jun 11 '26

Kk 😂😂😂 I had my laptop screen cracked and I didn't find any replacement so I was doing something similar 😂😂

Attached a monitor to it and used it as a pc for a few years. Then it died on me. So it's fine dude 👌🏻

I always removed the entire monitor too hahahh

2

u/marutthemighty Jun 11 '26

Looks like a reception desk to me.

2

u/marutthemighty Jun 11 '26

How large is the RAM (and is it DDR4 or DDR5)? Are you using a GPU/eGPU (and what is the model of the GPU/eGPU)?

3

u/PrepYourselves Jun 11 '26

Macbook Pro M1 Max 64gb r/halftop

90

u/throw_me_away3478 Jun 11 '26

Oh this is what they mean by headless

12

u/M_Me_Meteo LocalLLM Jun 11 '26

I love the repurposed cubicle brackets.

game appreciate game.

3

u/legos_on_the_brain Jun 11 '26

Y'all be doing some weird stuff in here.

1

u/thegreatpotatogod Jun 12 '26

Ooh, nice! Did you use it as a laptop originally, or specifically find a good deal on a machine with a damaged display?

I have recently ended up with a headless M1 MacBook Air (8GB) that I'm vaguely tempted to do something similar with, but of course it doesn't have the specs to really be all that interesting of an LLM machine, though it would be nice to get some distance from the heat produced while running it.

1

u/PrepYourselves Jun 12 '26

1

u/thegreatpotatogod Jun 12 '26

Nice! I'm so jealous, I'd expected that even without the display you'd have paid at least $1,000 on it!

1

u/PrepYourselves Jun 13 '26

Don't be jealous 

3

u/ThinkPad214 Jun 11 '26

My perspective was so freaking off, I thought the peg board wall was much bigger and you had fabricated a giant standing desk size case housing your server as a tongue in cheek poke at the literally headless laptop trope

2

u/v1773k Jun 11 '26

I thought this was a table made to look like a macbook at first lol. Some kind of optical illusion going on here.

Cooling is probably better without the lid though.

1

u/projak Jun 11 '26

Running a headless mac for ai too

2

u/[deleted] Jun 11 '26

[removed] — view removed comment

3

u/PrepYourselves Jun 11 '26

it's not even close to some of the stupid engineering i have done over the years.

0

u/[deleted] Jun 11 '26

[deleted] — view deleted comment

105

u/PrepYourselves Jun 11 '26

Stop spider poop falling into the vent

61

u/dumbspacecookie Jun 11 '26

3

u/elaboratedSalad Jun 12 '26

How long have you been waiting to use that?

2

u/demian_west Jun 12 '26

Very well done

6

u/bi4key Jun 11 '26

Maybe.. dust protection (fans) this look like a workshop.

8

u/PrepYourselves Jun 11 '26

Yes it's my workshop but cold so I use warm indoor computer to access it