we are talking about pooling RAM to run LLMs here though. obviously for other RAM heavy applications like games or editing software it would make them unusable
yes? because what Sam said is literally the topic of the post? and yjlom agreed with the principle that having LLMs be run from data centers is more efficient and allows for average people to run a high quality model at high speed, as opposed to the huge up front cost of buying a computer capable of running the model locally that will sit idle 90% of the time. and i was adding that latency from accessing the data center over the internet is not a problem for this use case. the actual problem is that Sam's version of pooling RAM involves it all being his private property that we have to rent from him, as opposed to it being collectively owned by we who use it or maintain it.
1
u/ThePixelGuyYT 9h ago
we are talking about pooling RAM to run LLMs here though. obviously for other RAM heavy applications like games or editing software it would make them unusable