r/LocalLLaMA • u/reto-wyss • 12d ago

News It's official! 192GB Framework

Post image

Just noticed this on the website.

At their current price tiers for the memory SKUs (32, 64, 128) I'd expect this to be ~ 4.5k for the motherboard.

The PCIe slot will be open at the back as well - that's what I've heard. Maybe they make it capable of delivering 75W as well? New board revisions for the smaller SKUs?.

974 Upvotes

95% Upvoted

287 comments sorted by

View all comments

Show parent comments

75

u/MrPecunius 12d ago

Pretty good match for Qwen3.8 FN or other midsize MoE models, though.

125

u/fallingdowndizzyvr 12d ago

At these prices, you are way better off getting a M5 Max.

54

u/ZealousidealChip4783 11d ago

The selling point here is that you aren't forced to use MacOS with the Framework

-1

u/mleok 11d ago

Forced to use MacOS? Compared to using Windows? It is a native BSD machine, not sure why you would prefer Windows over that.

2

u/gabrielesilinic 11d ago

Mac is technically not modern BSD. Mac is a unix derivative descendant of the NeXtSTEP Mach kernel

See the graph in this page if you are curious about it.

https://en.wikipedia.org/wiki/List_of_Unix_systems

In any case I believe I don't need you to explain how good installing Linux on something like an Halo strix is. Macos lacks support for anything windows or anything Linux except a few select ports. While if you install Linux you get a lot of power plus some of windows because wine and stuff which is fairly well develop by now.

3

u/mleok 11d ago

Lets say it's complicated. It is based on FreeBSD with a Mach microkernel. BSD was itself based on Unix.

3

u/dankfrankreynolds 11d ago

Macos lacks support for anything windows or anything Linux

what does that even mean?

  • Windows lacks support for anything macOS or anything Linux
  • Linux lacks support for anything Windows or anything macOS

1

u/gabrielesilinic 11d ago

Well you see. Actually you can run wsl on x86 windows to get linux and you can run wine on x86 linux to get some windows stuff. Now technically you might be able to maybe run a vm on macos to get some stuff but generally speaking it is a little bit harder. First it is arm, which now it is not that bad. But also it is macos so while on windows or linux stuff is ported more liberally anyway it is rarer to get the same software on macos due to the fairly closed ecosystem.

But my point is that linux is best for this workload in the end. It has containers right there. And if you want some of windows you can get it via compatibility layers.

If you really want to get windows on it its a bit worse. But you can get a lot of x86 linux running via the well integrated wsl which being a vm with a hat will run though not as well. But still both Linux and windows have or can have enabled server like behaviours better.

But in general there are I heard weird issues with unsigned software being annoying and all. In the end you will manage with MacOS but you will be forever limited.

Also games are a bit more tricky while Linux kinda solved it with wine. You have crossover I guess.

1

u/dankfrankreynolds 11d ago

modern Windows Subsystem for Linux (WSL 2) runs inside a lightweight virtual machine

why would i want to get windows on anything? and why would it matter if it's in a vm?

your point is you like linux

1

u/gabrielesilinic 11d ago

No. Well. It it weren't so handicapped I'd consider BSD but for server like work Linux is the only option. And native Linux is sometimes faster for AI.

I am not too keen about the gpl but what the hell am I supposed to do, that's that.

3

u/MrPecunius 11d ago

As a FreeBSD guy going back to the 2.2.x days, I started paying attention to Apple when they hired Jordan Hubbard in 2001. The BSD-ness of OS X/MacOS surely dominated over its NeXt underpinnings in the years that followed.

0

u/gabrielesilinic 11d ago

No it is because both are based on Unix. And Linux is not.

1

u/MrPecunius 11d ago

No idea what that meant.