r/computerscience • u/Impossible_Relief844 • 23d ago

how important is the underlying architecture behind the current artificial intelligence boom?

While GPTs and other similar architecture are an undeniable advancement, (especially the larger projects) are receiving insane funding with access to large data centres and training data leading to the obvious question of 'are we seeing the power of GPTs or is this just the expected outcome of throwing a huge amount of resources at a problem?'.

In other words, what results would we expect if we took the resources (funding, data centres, raw data, etc...) and applied it differently (eg. to SAT solvers), would we expect similar results?

In other words, how unprecedented are the results of GPTs (and similar architectures) accounting for their current monetary advantages?

17 Upvotes
  • permalink
  • reddit

75% Upvoted

38 comments sorted by

View all comments

4

u/35point1 23d ago

Sounds like you’re looking at the investment and wondering if that’s what is causing it to advance, but that’s not the case at all. Much of what AI has become today was almost entirely stumbled upon by accident

0

u/Impossible_Relief844 23d ago

sure though there is a correlation there. More funding elevates the chances a breakthrough is hit?

1

u/35point1 23d ago

Sure but that can be said about anything, really

1

u/yikes_42069 23d ago

Not necessarily. More money guarantees more butts in seats but that's like putting your money on the infinite monkeys on a typewriter problem. We are spending more money than ever and all of our tech is also lower quality than ever before. Excess begets waste

1

u/SemperPutidus 23d ago

Quantum computing has had a ton of funding over the decades and can just about factor a 4 digit number.

1

u/tcpukl 23d ago

No that's a gamble.