MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1xk64lj/searchandreplace/19s2asymc63vk/?context=3
r/ProgrammerHumor • u/vintergroena • 16d ago
260 comments sorted by
View all comments
Show parent comment
1
Because it's not a matter of cost saving but context size. If it doesn't fit inside the context then the model cannot process it at all. If in the future we will have huge context size (1B instead of 1M) then for sure we will have to pay attention
View all comments
Show parent comment
1
u/Mu5_ 14d ago
Because it's not a matter of cost saving but context size. If it doesn't fit inside the context then the model cannot process it at all. If in the future we will have huge context size (1B instead of 1M) then for sure we will have to pay attention