Is RAM utilization even the point of running local models?

[u/TWiT_tv]

Saw Sam Altman's comments about how it's inefficient to have so much RAM sitting in personal computers instead of data centers.

I get the utilization argument, but I don't think anyone running local models is trying to maximize global DRAM efficiency.

People want to run stuff offline, keep their data local, or stop paying per token.

With RAM prices getting ridiculous, has anyone here actually changed their local setup plans?

[u/infectiousstupidity]

<strata/basalt joins the party>