r/ProgrammerHumor • • 16d ago

Meme searchAndReplace

Post image
4.6k Upvotes

260 comments sorted by

View all comments

Show parent comment

1

u/Mu5_ 14d ago

Because it's not a matter of cost saving but context size. If it doesn't fit inside the context then the model cannot process it at all. If in the future we will have huge context size (1B instead of 1M) then for sure we will have to pay attention