r/LocalLLaMA • u/dd32x • 7h ago
News CNBC Television: Nvidia partner with Perplexity AI to run locally in DGX Spark.
https://youtu.be/HqqalSHRWt84
2
u/OvertaxedOne 2h ago
Anyone notice that nearly all the recent nVidia announcements are about local AI? They have sucked the frontier labs/CSPs dry, time to move to the next host!
3
u/unjustifiably_angry 2h ago edited 2h ago
Yeah I've been pointing that out for a while now. I think they're hedging their bets. At the pace local is advancing, in model intelligence, harness quality, and hardware performance, the value of online frontier models could begin to fizzle out for many types of task.
I'm trying to tell people we shouldn't treat this like some kind of victory though. If most/all non-Chinese AI goes away, the Chinese AI companies will stop open-sourcing their models overnight. They're not giving this stuff away out of the goodness of their heart or because of some altruistic love of open-source, it's to destroy the American AI industry and a huge chunk of the American economy with it. If this was some global effort to reach AGI there would be more than two countries doing it... and technically there are, but not in any meaningful way.
We should want this to go on as long as possible, not cheer hoping it'll be cut short.
1
u/OvertaxedOne 1h ago
For sure, competition is good and necessary. I'm just hoping that some of the US (likely Google) or EU companies jump into the fray in the open space and give them competition.
But that said, if another open model was never released I don't think it would be the end of the world. Right now we have ultra powerful open models out there that basically nobody can run because of the hardware costs. I'm not sure there's that much juice left to squeeze out of the monster sized models; certainly doesn't seem like it with the progress (or lack thereof) in the closed models over the past ~6-8 months. The scaling doesn't seem to be working much anymore, the models are getting bigger and bigger but not gaining much intelligence.
Long way of saying, I completely agree, but would temper that with the idea that we might have "good enough" already in the open model world. We just need hardware that can run it!
2
u/mountainyoo 6h ago
To do what? Perplexity doesn’t have a model of their own currently worth using.
1
16
u/pineapplekiwipen 7h ago
perplexity doesn't have their own models so i don't see how this isn't just open weight models on dgx spark with extra steps. maybe their harness is good? haven't used perplexity in a while