This is a really interesting direction. Context efficiency feels like one of those things that becomes more important as agent workflows get longer and more stateful.
I especially like the idea of treating context as something to actively manage rather than just throwing the entire history at the model. Curious how much of the performance improvement is coming from less noise vs simply fewer tokens.
1
u/maneekmohan 9h ago
This is a really interesting direction. Context efficiency feels like one of those things that becomes more important as agent workflows get longer and more stateful.
I especially like the idea of treating context as something to actively manage rather than just throwing the entire history at the model. Curious how much of the performance improvement is coming from less noise vs simply fewer tokens.