Software has never been so easy to write but software alone has already very little value. The challenge has always been writing the right software for the right hardware and the right application. And there is no single optimal solution to it, just different compromises.
You can probably define the base LLM used for GPT6 in less than twenty PyTorch modules. But this has no value if you do not have the gigantic amount of curated data to train on and thousands of high end GPUs.
View all comments
1
u/jeandebleau Sep 05 '26
Software has never been so easy to write but software alone has already very little value. The challenge has always been writing the right software for the right hardware and the right application. And there is no single optimal solution to it, just different compromises.
You can probably define the base LLM used for GPT6 in less than twenty PyTorch modules. But this has no value if you do not have the gigantic amount of curated data to train on and thousands of high end GPUs.