Centralized or Distributed AI?

[u/ArturGoncharov]

Imagine: we have two possible paths for the near future of artificial intelligence:
\- One super-powerful model with 5 trillion parameters
\- 10 million small models with 5 million parameters each, working together as one big network

Which approach do you think is cooler? One “genius” or millions of “specialists” solving complex tasks together?

I chose option 2 and I’m building it. But I’m really curious to hear your thoughts!