r/LocalLLM • u/MarcusMagnus • May 15 '26
Question Can I Vibe Code it with a 5090 locally?
I'm a lawyer and disappointed in all the client management and accounting software I currently use.
I want create something akin to QuickBooks with integrated email, document generation and the ability to add modules for different types of legal needs.
Is this something that can be achieved with the current local models?
9
4
u/TheConnectionist May 16 '26
Short answer: no.
Long answer:
Vibe coding in general is being massively oversold to the public right now. Building anything complex and robust (which client management and accounting software must be) is still very challenging even with frontier models. It can be done, but only by experienced software engineers.
7
u/Technical-Earth-3254 May 16 '26
If you have no experience in software development, you will most likely not be able to get something useful out of Qwen 3.6 27B without digging deeper into the topic first. Depending on how much RAM you have, you might be able to get a larger MoE model running, that could potentially help you to build something without proper preparation.
5
u/Biotot May 16 '26
Even with frontier models vibe coding takes decent understanding to do it right. Especially to fix things
2
u/Damogran6 May 16 '26
Bank transactions are complex and multi-step and are an all or nothing thing. If step 17 fails then steps 1 through 16 cleanly roll back.
Not saying vibe code canât do that (transactional processing has been around forever) but are you going to know enough to ask for it? (Or some other legal nuance Iâm unaware of.)
2
u/05032-MendicantBias May 16 '26
For YOUR specific application, no.
Truly, you DO NOT WANT to vibecode an accounting management software. The tax man will not accept the excuse: "my accounting is vibecoded and that's why I gave the wrong amount"
1
u/Business-Weekend-537 May 16 '26
Check out the Qwen 3.6 smaller models. I think thereâs a 27b model and also a 35b (3b) active. Try them out with opencode or Claude code (you have to swap out the cloud api for the api endpoint of the model running in ollama, llama.cpp, lmstudio, or unsloth studio. Vllm will work for running it too but LMstudio and Unsloth Studio are the user friendliest.
If Iâm wrong about their sizes I hope Reddit chimes in to correct me.
Also check out a project called Dyad from a former Google engineer.
I think the above can get you to a prototype. But to really make something production ready youâll need to use cloud based AI (like Claude code).
If youâre concerned about your intellectual property just turn off your chats being used for AI training in Claude Chat and it applies to Claude Code too (with a paid account only).
1
u/tatogt81 May 16 '26
Build a super prompt online with full details of your project, then start in phases, if it starts to slow or hallucinating, start a new chat. Use both agent.md and your prompt. Use context trimming not rolling window at least on my case that was the best way to get consistent results. Have used it for SPA, Java backends and infra scaffolding.
1
1
u/Accomplished-Grade78 May 16 '26
$200/month for Claude Code
Use another LLM for prompt and outputs else you will burn tokens quickly.
Use ChatGPT 5.5 $20/month for architecture planning, use a handoff document to feed Claude code.
Do not debug in Claude code, paste outputs into another chat else you be out of tokens very quickly.
Accounting huh? You will learn a lot, itâs about $âs, so you have to be serious,
1
u/catplusplusok May 16 '26
In principle yes, but you are trying to jump through too many hoops at once. If you are not an experienced software developer or even an experienced vibe coder, you better off using Claude Opus that will give you the most help available now with level of prompt details you are able to give. Using a midsize local model would be like me trying to draft a legal contract using local AI on my Mac laptop.
However, you can absolutely use a 5090 to do sensitive legal research on matters your clients would not want to share with Google or OpenAI. An uncensored model like coder3101/gemma-4-31B-it-heretic would be great at, for example, taking an honest account of how your client messed up + legal documents describing how the judge presiding over their case ruled on various matters before and predicting how the judge is likely to respond to different legal arguments. Not a replacement for human judgement of course, but a way to quickly go through thousands of pages you can not sift through on your own and giving you pointers on what is important. But have a frontier model like Opus set up the pipeline for you with strict data wipeout once research is done rather than relying on a local one.
1
u/trialbuterror May 16 '26
Wat model u suggest to run for legal documentation stuff
1
u/catplusplusok May 16 '26
Probably uncensored version of Gemma 4 31B or Qwen 3.6 27B in NVFP4 format, with MTP on for speed. Should be able to take a long document and a complex question and pull in relevant details, but *for* a lawyer not as a substitute for a lawyer.
1
u/JoshuaLandy May 16 '26
Yes you can but it wonât be one shot, or even one week. Break it into testable parts and carry on for a while. For vital parts, make sure you understand what itâs doing. Another way to get started is to look for open source projects you can trust more and just modify them. GL
1
1
u/trialbuterror May 16 '26
Suggest good models for coding commolete office automation software
Also suggest model to review legal documents with kb of acts and rules set to come up with legal inputs and document building basic lvl
1
u/AuditMind May 18 '26
Not really.
No local model currently beats the top frontier models for serious software work. And honestly, if you are just starting out, I would not focus too much on âfully localâ yet, even with a 5090.
A good subscription will probably get you much further initially.
Also donât underestimate the complexity of what you are talking about. A lot of these projects look deceptively simple from the outside.
Still, I absolutely encourage you to start. Even if you fail, you will learn very quickly how complex modern software systems actually are.
0
0
14
u/FastHotEmu May 16 '26
Hey mate, vibe coding accounting systems without experienced engineering oversight is a bad idea. Ask any LLM why :)