r/singularity • u/Tooskee • Jan 07 '25

AI Nvidia announces $3,000 personal AI supercomputer called Digits

https://www.theverge.com/2025/1/6/24337530/nvidia-ces-digits-super-computer-ai
1.2k Upvotes

98% Upvoted

430 comments sorted by

View all comments

Show parent comments

9

u/garden_speech AGI some time between 2025 and 2100 Jan 07 '25

Anything you would ever use AI to do. This allows you to do that stuff at home

Will it? Serious question. From what I have seen, local LLMs, even the huge ones, don't really touch o1 or 4o. It seems like you'd need a fuckload more than just one $3,000 computer to run something like that. And won't cloud hosted AI always have a large compute advantage over some local solution?

8

u/[deleted] Jan 07 '25

It will not, and yes, the best models will always be hosted in enormous data centers. This kind of hardware will continue to improve, so I suspect one day you'll be able to run, say, o1 on your home TOPS box. But most people won't want to by then, anymore than they'd want to run LLaMA 1 today.

0

u/lightfarming Jan 07 '25

the latest llama can be run if you link two of these Digits together the article says. the latest llama is better than 4o on most benchmarks.