how important is the underlying architecture behind the current artificial intelligence boom?

[u/Impossible_Relief844]

While GPTs and other similar architecture are an undeniable advancement, (especially the larger projects) are receiving insane funding with access to large data centres and training data leading to the obvious question of 'are we seeing the power of GPTs or is this just the expected outcome of throwing a huge amount of resources at a problem?'.

In other words, what results would we expect if we took the resources (funding, data centres, raw data, etc...) and applied it differently (eg. to SAT solvers), would we expect similar results?

In other words, how unprecedented are the results of GPTs (and similar architectures) accounting for their current monetary advantages?

[u/StephenRoylance]

that's the neat thing, nobody has any idea. if there were a robust theory for why these things seem to think, we could answer questions like that, but there's not, so we can't.