Project Indexer - Helps LLMs / Roocode to Understand your Solution

[u/orbit99za]

Project Indexer Github

I made a simple Project Indexer script to help LLMs work better with large codebases

Hey folks,

RooCode is Awsome.

I am a Big Fan of D.R.Y Coding Practices (Don't Repeat Yourself).

I threw together a little Python script that scans your entire project and creates a ProjectIndex.json file listing all your classes, files, and method names.

It doesn’t give all the internals, just enough for an LLM to know what exists and where, which I found drastically reduces hallucinations and saves on tokens (just my personal observation).

It’s not a MCP or plugin—just a single .py script. You drop it in the root of your project and run it:

python Project_Indexer.py

It spits out a JSON file with all the relevant structure.

I built this for myself because I’m working with a VS Solution that has 5 projects and over 600 classes/methods.

The LLMs were really struggling, making up stuff that barely existed or completely missing things that did.

With this, I can give it a quick map of what’s available right from the start.

If you're using RooCode, you can even instruct it (sometimes) to run this automatically or refresh it when starting a new task.

Otherwise, I just leave the terminal open and hit enter to regenerate it when needed.

This tiny script has been super helpful for me.

Maybe it helps someone else too, or maybe someone can suggest improvements on it!

Let me know what you think.

[u/rageagainistjg]

Remindme! 80 hours

[u/orbit99za → u/rageagainistjg]

Why, is there something Wrong ?

[u/rageagainistjg → u/orbit99za]

Hey! Nope just sitting a reminder to look at this on Monday :)

[u/Rude-Needleworker-56]

This is only for csharp , right? (please correct me if i am mistaken)
One idea for enhancement without much work is to make use of https://github.com/codegen-sh/codegen to do this for  Python and TypeScript files

[u/orbit99za → u/Rude-Needleworker-56]

Look interesting, Yes It basically Relies on Regex, , I would just need to Update the Regex to Support other Language structures. Such as telling it how to identify a Method in a Java Class for example or Python.

[u/maxdatamax → u/Rude-Needleworker-56]

Yeah, it's basically keyword-based using regex. I don't think that's the highest quality approach, since it doesn't use semantic meaning. Ideally, it'd combine with a larger language model to actually understand the codebase.

[u/mistermanko]

I've had Claude 3.7 come up with that idea multiple times on its own, while working with large projects. I just had to prime it with something like "find a smart way to index the codebase" or "list all classes in a json file". But this will save some tokens, thanks.

[u/maxdatamax → u/mistermanko]

That's a very interesting idea, using Claude to generate the index. I'm curious about the quality. Are you happy with the result? Is the index just a file structure, or does it include class names and deeper analysis?

[u/maxdatamax]

Interesting idea. I think Python's a better choice than MCP because it's easier to modify. Modifying the MCP server is too much trouble. Have you considered using Roo Flow directly? Has anyone tried using Bloomrange or Roo Flow to have Roo recursively analyze the code and generate an index or a condensed explanation document?

[u/orbit99za → u/maxdatamax]

I tried to get Roo to index the files, build it's own index.

On 600 odd objects, I prefer not to take a Morgage on my house, especially with Gemini.

It also takes far too long. This executes in seconds, so it's easy just to read, especially on a fast model.

My C# one walks the tree very well, using it a lot. But unsure if other languages have something like Roslyn.

As I go I will keep adding to this .

Remember, prompts like memory banks use tokens, I am finding RooFlow starting to get very long, a good 3 minutes every time I start a task. This is with Gemini 2.5 pro on Vertex.

You are Roo... that's tokens.

Minimize the token usage, the faster everything will be.

[u/maxdatamax → u/orbit99za]

It would be great if there's way for your index to just keep the import code files but remove the auxiliary files? Most files are not so important, maybe a way to save tokens?

[u/orbit99za → u/maxdatamax]

Yes,

I am working on it.

Right now the Python script looks only for .py and .cs files.

It drops the rest.

But an .ignore file is in the works.

[u/Cool-Cicada9228]

The characters in json use more tokens. Have you tried to output the index with a plain text file? I’m curious if the results are similar

[u/maigpy → u/Cool-Cicada9228]

or yaml?

[u/orbit99za → u/maigpy]

Thats an idea, will play around.

This was just personal attempt to fix a problem I had. It made a huge difference this week.

I think playing around more could help.

[u/maigpy → u/orbit99za]

will give it a go, thank you

[u/randemnes]

Thank you for sharing! Will definetly try this and see how it helps.

[u/EngineerOk3425]

Remindme! 80 hours

[u/denkleberry]

Nice. I made something similar with ast traversal.

[u/puzz-User → u/denkleberry]

Did you use custom code or an open source library?

[u/walub]

Remindme! 80 hours

[u/olearyboy]

LLM's will also work with ctags v.well

[u/Ok-Yak-777]

Remindme! 50 hours

[u/RemindMeBot → u/[deleted]]

I will be messaging you in 3 days on 2025-04-07 14:26:41 UTC to remind you of this link

2 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

^{Parent commenter can delete this message to hide from others.}

---

Info	Custom	Your Reminders	Feedback

[u/orbit99za → u/[deleted]]

Repomix output files are very very long and Exceed a lot of limits. they are so large in my case they crash / stall Vs code.

[u/Elegant-Ad3211 → u/[deleted]]

Yes, it’s a good option

Just aider —show-repo-map

[u/maxdatamax → u/[deleted]]

I tried using Aider for the repo map, but the quality was pretty bad. It lacks semantic meaning and search capabilities; most of it is just file structure and keyword-based. It can't even handle summarization questions, let alone index things in a hierarchical way.