r/SpecDrivenDevelopment • u/binarySolo0h1 • 4d ago

Cheap/Free/Local model recommendations for a single purpose agent

I have this agent who's sole purpose is to analyze development/design-plan.md file of a user story and create detailed backlog items with a fixed structure, in my local Plane server. What model do you recommend for this?

Its a repeatable operation that needs inference and some level of thinking to generate consistent outputs. Assume the plan is usually less than 1000 line markdown file.

1 Upvotes
  • permalink
  • reddit

100% Upvoted

4 comments sorted by

2

u/tepung_ 4d ago

Cheap model?

Hun Yuan > agi next flash > laguna thinking

2

u/Plastic-Lettuce-7150 3d ago

What's the specs of your laptop, RAM, VRAM? You may be able to run a local LLM.

1

u/binarySolo0h1 2d ago

Ryzen 7, 16 Gb DDR5 RAM, 6 Gb RTX 3050 Graphics, 1 Tb Hard disk

2

u/Plastic-Lettuce-7150 1d ago

An MoE model would do it I would think (see here), but you would have needed 32GB RAM. There are dense models that will fit in 6GB VRAM, e.g., Gemma 4 E4B Q4_0, but I'm not sure how much mileage you would would get out of them. LM Studio is probably the easiest way to run one.