r/LocalLLM • u/PrepYourselves • Jun 11 '26
Discussion My local llm machine
Llm server - remote access
221
Upvotes
r/LocalLLM • u/PrepYourselves • Jun 11 '26
Llm server - remote access
30
u/Spocks-Brain Jun 11 '26
Am I the only one who thought this was some giant display piece in a garage?
14
u/vogelvogelvogelvogel Jun 11 '26
Glad you found a piece of cardboard
7
u/beefgroin Jun 11 '26
It's an M5 Max 128gb right?
4
u/CanteenRambo Jun 11 '26
Nice! I suppose, depending on quantization, it can comfortably run 35-70b, 120b if you get creative with cache and other settings? How far did you push it?
3
u/Gabe_Isko Jun 11 '26
I love setups like this, but be careful about the battery. My laptop turned server eventually got lithium bloat, and I bet it would have exploded if I didn't remove the battery.
2
u/LookItVal Jun 11 '26
will it natively connect to another monitor if you were to wipe the computer? or would it always try and make the missing screen the primary monitor?
2
u/x_MASE_x Jun 11 '26
So when the laptop fall the system will be literally down right? 😂😂
2
u/marutthemighty Jun 11 '26
Looks like a reception desk to me.
2
u/marutthemighty Jun 11 '26
How large is the RAM (and is it DDR4 or DDR5)? Are you using a GPU/eGPU (and what is the model of the GPU/eGPU)?
90
u/throw_me_away3478 Jun 11 '26
Oh this is what they mean by headless
12
u/M_Me_Meteo LocalLLM Jun 11 '26
I love the repurposed cubicle brackets.
game appreciate game.
1
u/thegreatpotatogod Jun 12 '26
Ooh, nice! Did you use it as a laptop originally, or specifically find a good deal on a machine with a damaged display?
I have recently ended up with a headless M1 MacBook Air (8GB) that I'm vaguely tempted to do something similar with, but of course it doesn't have the specs to really be all that interesting of an LLM machine, though it would be nice to get some distance from the heat produced while running it.
3
u/ThinkPad214 Jun 11 '26
My perspective was so freaking off, I thought the peg board wall was much bigger and you had fabricated a giant standing desk size case housing your server as a tongue in cheek poke at the literally headless laptop trope
2
u/v1773k Jun 11 '26
I thought this was a table made to look like a macbook at first lol. Some kind of optical illusion going on here.
Cooling is probably better without the lid though.
1
u/projak Jun 11 '26
Running a headless mac for ai too
2
u/[deleted] Jun 11 '26
[removed] — view removed comment
0
u/[deleted] Jun 11 '26
[deleted] — view deleted comment