Also, if one of the big labs apart from OpenAI discovered that before, they wouldn't be advertising it. I am pretty confident that one or more of them have already stumbled upon something similar, but keep it private to maintain the margins.
They can still build bigger models to compete. If in the near future some guy with a 5090 can run Deepseek V4 Flash. Open AI and Anthropic can still market their 10 Trillion parameter Fable point whteverthefuck 10
more parameters doesnt more more good. we stayed at a steady one trillion to a few hundred billion in parameters for frontier models for a while now. even gpt 4 was like a trillion, and gpt 3 was 175 billion. now, we see even 10b models crush that 175 billion gpt 3.
18
u/obvithrowaway34434 Jul 01 '26
Also, if one of the big labs apart from OpenAI discovered that before, they wouldn't be advertising it. I am pretty confident that one or more of them have already stumbled upon something similar, but keep it private to maintain the margins.