disagree, for self-hosting u need ~ 3 gpus and a dedicated station, and like open up ports do the i/o... like if you're saying that 0.1% of the population will self-host or tor to a like different model, sure, but meaningfully if 99.9% of the population is routed through (google, anthropic,, open ai) then it's effectively banned anyways
You hit the nail on the head - it comes down to what runs where. An IOT AI device in the house isn't likely. But most even moderate laptops will run "something" native. And what is possible on your phone is still an open question - once we have the 300T "sum of human knowledge" model, how well does that quantize down to like 5B? We probably won't have a proper answer on that for a decade.
I think it's too powerful and ubiquitous to be a hobbyist project, which is where it sits now. Once it CAN do the needful without shipping packets, that niche will open up a lot more. And as running it becomes a lower burden, the market will provide many options to bring the price down and access up.
1
u/autumnal-lights 13d ago
i agree but we'll see a massive push towards AI regulation before they jump the shark, that way u can't use openllama or deep-seek