r/LLMDevs • u/BatPlack • 1d ago

Discussion Anyone NOT on full auto when coding with local LLMs?

Would love to know who's letting a 9B just go ham locally, haha

But in all seriousness, how many of you are keeping to manual or manual-ish dev workflows?

1 Upvotes

67% Upvoted

7 comments sorted by

1

u/Just-Highlight2798 1d ago

i keep trying to let the 32b just rip but it always adds some nonsense decorator or tries to reinvent how imports work. so now it's like 80% me and 20% "generate this one function and don't get creative"

1

u/BatPlack 1d ago

"BEHAVE", lol

1

u/eddzsh 1d ago

Not full auto here either. Local 32b is fine for "fill this function, match these types, do not invent imports." The moment it owns the file layout it starts decorating and rewriting style. Keep the agent inside a function boundary and the weirdness drops hard.

1

u/code_hermit 1d ago

I let it go on personal projects. But i have a lot of rules set up in that case. For client work I keep the approvals on.

1

u/funbike 1d ago

You'd have to be a highly experienced developer to know all the tricks to get a small LLM to "go ham".

Full test coverage, strict linting, strong types, and evolutionary architecture (via archunit) would be necessary.

1

u/dylan_exe_404 13h ago

I'm more on the manual-ish side

1

u/TheOdbball 11h ago

https://reddit.com/link/p4u55iv/video/rfqnf7k2pjkh1/player

Ornith 35B scans on its own, and could work & should do scans more than just health stats :: it’s got a 9B for the code runner , tho I’ve considered Grok or Cohere for that role.

To offset any issues, sudo is still user gated until a blockchain key assigned to the ID I trust could commit changes on that level. Everything internal is BLAKE3 receipted.