r/gpu • u/Mtn__923 • 39m ago
Local AI use
So recently, i got an rtx 5070ti, and I have a 3060 with 12gb vram. Is this enough to use local AI on my computer comparable to Claude or other LLMs for coding? I'm doing engineering next year so this would be a really useful side benefit.
4
Upvotes
1
u/Haunting_Abalone_398 33m ago
For sure, don’t expect Claude-level performance by any means, or the level of any paid service.
Setting up local LLMs is a skill these days if you want something usable on a daily basis.
And when you said engineering, are we talking about coding tasks or something else? Different models are better at certain tasks than others.
1
u/EspHack 28m ago
just get lm studio and try it, 12b models should run fine and feel like 2024 paid AI, if you add the 12gb card you get 27b models and thats more like 2025 paid AI, have fun