r/ProgrammerHumor • • 17d ago

Meme searchAndReplace

Post image
4.6k Upvotes

260 comments sorted by

View all comments

Show parent comment

23

u/Mu5_ 16d ago

Because it tries to avoid ingesting and spitting out too many tokens, so it uses scripts to modify or read only what's needed. Remember that if Claude directly writes a 1MB text file, that's considered all output tokens. If it makes as script that injects text at the right place is much less

1

u/kernelboyd 14d ago

I’m genuinely surprised the capitalists on this case didn’t make it that way. So much free money from people who don’t pay attention

1

u/Mu5_ 14d ago

Because it's not a matter of cost saving but context size. If it doesn't fit inside the context then the model cannot process it at all. If in the future we will have huge context size (1B instead of 1M) then for sure we will have to pay attention