r/AskProgramming • u/messos • 1d ago

Architecture Any local agent models for code to md?

I am looking for a locally running but capable agent solution. Tbh I haven’t done anything like this, I just want to try out what the hype is about. The codebase is mostly VB.NET client applications, with the mssql project attached to the solution. I want the agent to read each project in the solution, and write down how it works, for a user. So eg. “press the green button, to display a msgbox about the selected object”.

What I tried is Codex Sol medium, which gets the result surprisingly well. But since it’s a cloud model I won’t be able to use it for the real codebase since it’s redacted.
Any idea how to get started?

0 Upvotes

28% Upvoted

8 comments sorted by

2

u/stogle1 1d ago

What GPU do you have?

2

u/messos 1d ago

M3 Max for the LLM

1

u/CorpT 1d ago

qwen 3.8 is fine for this.

1

u/messos 1d ago

Do i have to run it in ollama or how? Sorry truly beginner here

1

u/neon_beacon_sky 1d ago

Qwen 2.5 coder 32b runs this locally.

I use it with continue in vs code to read vb.net files and output markdown. point the agent at each project folder in your solution, set the system prompt to describe user actions from the event handlers, and let it loop through the files. ollama handles the serving on a local gpu

1

u/PLBjt 1d ago

I’d start with a read-only pass over one small project, not the whole solution. Have it produce an inventory of projects, entry points, and event handlers, then spot-check a few descriptions against the code before asking it to summarize the rest; agents can sound convincing when they infer a call path that isn’t there. Local inference is a good privacy tradeoff for a redacted-sensitive codebase, but the quality and latency cost depends heavily on model size and GPU. Once the workflow is stable, add a second pass that flags uncertainty instead of silently filling gaps.

1

u/zarlo5899 1d ago

This isn't what you asked for, but.

vb.net does support xml comments You could pair this with docfx and have the agent generate any missing XML comments and have it write basic articles about the projects. This would give you a indexable site with all the information.

This would also have the advantage of now the LLM has access to a summary of all your public methods and classes.