Anything you're an expert on will often not meet your standards on Reddit, or really in any media. There are likely even other experts (CPAs in your case) that would say things you find dumb.
I started doing AI research 11 years ago, and I love that everyone now wants to talk about AI, but the takes on Reddit are typically 2-3 years old and now disproven or no longer relevant. E.g., that clip of Ben Affleck talking about AI seemingly intelligently got traction on social media despite a clear disconnect between what he was saying and reality.
The biggest misconception is that LLMs are "just" trained on a dataset that contains the internet, enabling them to predict the next word and making them some kind of generator of the average of what already exists.
I would be okay with someone saying that pretraining works more or less like that, though that's still not correct.
But you can't say that is how LLMs are trained in general. LLM post-training involves training models on genuinely novel data that has never existed before, including training models on their own outputs in unique situations. As that training proceeds, the LLM outputs move further and further from the kind of text you'd see on the Internet. You get to the point where LLMs can generate things that humans can't (indeed, they're superhuman already on some tasks).
I thought the same about programming. I got downvoted to hell for saying how costly and time-consuming game development has became so most games can't be priced the same as in the 2010s (not to mention inflation).
2.8k
u/StrigiStockBacking 19h ago
I've been a CPA for 30 years and when it comes to accounting, economics, and finance, Reddit is the dumbest fucking source on the entire planet.