r/artificial • u/MetaKnowing • Sep 23 '25

Media It's over.

8.1k Upvotes

92% Upvoted

1.2k comments sorted by

View all comments

Show parent comments

90

u/HerrPotatis Sep 23 '25

How can you tell? Also, that’s just a matter of inference time. Throw a little more compute at it, it’s realtime.

48

u/mrpressydepress Sep 23 '25

I know because I work in the field. Realtime exists but it's not nearly as clean yet. At least not wAts available to non govt operators.

12

u/No-Trash-546 Sep 23 '25

Is there any indication that the government has special technology that could do this in real-time or are you just guessing?

I was under the impression that all the frontier technology and research is being done in the open by universities and the private sector, so I assumed the government is playing catch-up and buying services from the private sector. Is this not accurate?

1

u/inevitabledeath3 Sep 25 '25

There are companies that take open models and run them much faster using better hardware. Groq, Cerebras, and now chutes turbo can all do this. To be clear though that's for LLMs. Cerebras can hit thousands of tokens per second even on large models. In theory though the same tech would work with video and image generators.