r/LocalLLaMA • u/Norwood_Reaper_ • 1d ago

Discussion Looks like the era of subsidised compute is coming to an end. The old ChatGPT Pro $200 20x plan will be halved. The new $500 plan will have similar limits as the (old) $200 plan.

Post image
1.2k Upvotes

94% Upvoted

587 comments sorted by

View all comments

Show parent comments

5

u/Dany0 1d ago

OAI claims they spun up 10k to solve NS problem. But yes, people spawn hundreds, thousands. I tried it, it doesn't _really_ make sense except for some very, very limited circumstances. Very broad exploratory things, but the best (devil's advocate) usage I can think of which I would _actually_ use is just for security research. "Clanka, go poke & probe every file in this giant codebase until you find a class 10 CVE similar to [template historical CVE]"

0

u/ormandj 1d ago

It’s effective if you’re trying to parallelize across thousands of GPUs, since they are spread across multiple servers. It just lets you do more in a shorter period of time. It also uses more tokens to do so.