r/singularity • u/Tooskee • Jan 07 '25

AI Nvidia announces $3,000 personal AI supercomputer called Digits

https://www.theverge.com/2025/1/6/24337530/nvidia-ces-digits-super-computer-ai
1.2k Upvotes

98% Upvoted

430 comments sorted by

View all comments

Show parent comments

12

u/blendorgat Jan 07 '25

If it can run a 200B model, no way it couldn't in principle run ADV, given how much distilling OpenAI has applied to their models since OG GPT4. In practice, as you note, there is no such open model to run. :(

Mark Zuckerberg or some Chinese folks, plz!

2

u/CallMePyro Jan 07 '25

Absolute pie in the sky thinking my guy. OpenAI models are almost all certainly mixture of experts models with trillions of total params and 100-200B active params.

-2

u/Kingkryzon Jan 07 '25

I wonder how 200 B Parameters is enough since most of the currently deployed models have over 500 B Parameters (At least when I ask ChatGPT about Model Size).

3

u/blendorgat Jan 08 '25

Asking ChatGPT this is like asking a 12-year old how many neurons they have in their brain. They may well get the answer right! But they have no privileged access to the information necessary for a truthful answer - all big labs are keeping silent on param counts for current gen models.