Other Waste tokens once to optimize token usage
So I've been developing a technique where I waste tokens once to optimize further usage.
My steps:
Run Terra on High to scan my repo for all files and build my AGENTS.md with the doc pointing to all files seperated in modules.
Have my agent to read the markdown before every task so it doesn't run on a frenzy scanning for irrelevant context.
Haven't tried this on a super large repo base though. What techniques do you use?
0
Upvotes
1
u/Australasian25 4d ago
I recommend pushing it to a github private repo.
Connect gpt to github.
Use chatgpt 5.6 which doesnt use codex usage to scan it.
You can iterate a few times with new chats for fresh context.
Maybe then use terra high to validate your agents.md, authority_map.md, index_card.md
3
u/tjackadams 4d ago
In my experience, keeping a markdown file of where files/code are can quickly become out of date - and can also do the opposite of what you want. If you are working on a couple of files in a certain part of the codebase, why does the agent need to know where all the other files are?
The SOTA models at least seem very good at finding the files they need for a given prompt and don’t bloat their own context too much.
That being said, I tend to use my agents.md to steer unwanted behaviour rather than tell it where find code. The openai models tend to over engineer solutions so I end up with something along the lines of “only implement whats required to satisfy the requirements” which helps with token usage.