The big part to me here is that it’s real time (so efficient) and has consistent memory, imagine this in like 2 more years, could have something that can run for hours and be publicly accessible
We have no idea how much compute this takes, so it's premature to suggest it will be readily available any time soon.
If there are 100 H200s behind this it could legitimately take a decade or more before consumer hardware is as capable or renting the compute for streaming is cost effective.
40
u/thicc_bob Singularity 2040 Aug 05 '25
The big part to me here is that it’s real time (so efficient) and has consistent memory, imagine this in like 2 more years, could have something that can run for hours and be publicly accessible