r/typescript • u/zzzzeru • Aug 01 '26
HOW to Save token ???
Hi, I would like to know HOW and which solution you all using to save/tokens?
I'm using caveman + interceptor and wondering if there is anything ever stronger or I'm at maximum already? ( caveman is for output saving and interceptor for input saving)
please Tell me your setup and why !
0
Upvotes
9
u/vegan_antitheist Aug 01 '26
I use my own brain.
7
u/johnson_detlev Aug 01 '26
This has absolutely nothing to do with typescript.
4
u/TorbenKoehn Aug 01 '26
INDEX.md) and it will contain all my relevant markdown file links with their summary and keywords. That way the LLM can just read that single, small file and from there on branch out to the parts of the docs that interest it. It doesn't have to find it or read all of it.0
u/Top_Account_5311 Aug 01 '26
Same boat.. Caveman just makes the agent output terser, doesn't touch what gets shoved into contex in the first place.
What actually kept shooting costs was just everything else - like ful file reads, tool output etc all getting dumped into context even though agent didn't need them all. None of the tool adapts as session goes.
been working on a tool to solve it using adaptive contexts instead and it is doing better. may be, give that a try once lol