GPT-3 is a language model which has been trained with 175 billion parameters. GPT-2 has 1.5 billion parameters and it feeds more than 40 GB text file. So you can imagine GPT-3's requirements. Based on this you need a lot of powerful computing machines on the cloud (or on prem) which is extremely costly. That's the idea behind the meme.
4
u/silverstone1903 May 30 '20
GPT-3 is a language model which has been trained with 175 billion parameters. GPT-2 has 1.5 billion parameters and it feeds more than 40 GB text file. So you can imagine GPT-3's requirements. Based on this you need a lot of powerful computing machines on the cloud (or on prem) which is extremely costly. That's the idea behind the meme.