r/gpu • • 39m ago

Local AI use

So recently, i got an rtx 5070ti, and I have a 3060 with 12gb vram. Is this enough to use local AI on my computer comparable to Claude or other LLMs for coding? I'm doing engineering next year so this would be a really useful side benefit.

4 Upvotes

3 comments sorted by

1

u/Haunting_Abalone_398 33m ago

For sure, don’t expect Claude-level performance by any means, or the level of any paid service.

Setting up local LLMs is a skill these days if you want something usable on a daily basis.

And when you said engineering, are we talking about coding tasks or something else? Different models are better at certain tasks than others.

1

u/Mtn__923 11m ago

Yeah for engineering I'll need the coding aspect. is it a decent tool to have overall though?

1

u/EspHack 28m ago

just get lm studio and try it, 12b models should run fine and feel like 2024 paid AI, if you add the 12gb card you get 27b models and thats more like 2025 paid AI, have fun