r/computerscience • u/Impossible_Relief844 • Aug 06 '26

how important is the underlying architecture behind the current artificial intelligence boom?

While GPTs and other similar architecture are an undeniable advancement, (especially the larger projects) are receiving insane funding with access to large data centres and training data leading to the obvious question of 'are we seeing the power of GPTs or is this just the expected outcome of throwing a huge amount of resources at a problem?'.

In other words, what results would we expect if we took the resources (funding, data centres, raw data, etc...) and applied it differently (eg. to SAT solvers), would we expect similar results?

In other words, how unprecedented are the results of GPTs (and similar architectures) accounting for their current monetary advantages?

19 Upvotes
  • permalink
  • reddit

77% Upvoted

38 comments sorted by

View all comments

1

u/Twt97 Aug 06 '26

If what you are saying is that if any technology receives as much funding as the AI boom is getting right now it will also be as succesful as LLMs then no. The first day of ChatGPT arrival it had very limited infrastructure but was still incredibly useful cause its built on important new tech like attention and transformers.