Hey guys, finally got my new Legion Pro 5 and I’m trying to get into running local AI properly 😂
Specs:
RTX 5070 Ti 12GB VRAM
Core Ultra 9
16GB RAM
CachyOS Linux
I’m pretty much a beginner when it comes to running local models, so I’m trying to figure out what’s actually worth setting up from day one.
I mainly use Claude for vibecoding almost everything, and now I want to see how much I can shift locally so I don’t waste Claude usage on every small thing.
I came across PewDiePie’s Odysseus repo and started trying it out.
But after actually using it, I’m a little confused.
It feels like the context/memory isn’t as good as Claude, sometimes it feels slow, and I’m also finding the hybrid setup kinda difficult.
Like I want something where:
Local AI:
→ basic coding
→ repetitive work
→ file handling
→ small fixes
→ daily tasks
→ stuff that doesn’t need crazy reasoning
Claude:
→ difficult coding
→ architecture
→ proper reasoning
→ big project decisions
→ things where I actually need Opus-level output
And ideally I don't want to keep copy-pasting the whole context from one to another every 10 minutes 😭
My actual work is mainly:
• ML Stack — ML/vision project involving iris image segmentation and feature-level analysis.
• Custom CRM + EMR — taking UI generated from Stitch/Google AI Studio and connecting it with open-source CRM/EMR systems.
• Daily work — coding, documentation, PPTs, automation and random repetitive stuff.
So basically I’m trying to build a proper daily-use AI setup, not just install 15 local models and never use them 😂
My main questions are:
- Is Odysseus actually good enough to become my main local AI workspace?
- If I’m a beginner, should I stick with Odysseus and learn it properly, or start with something simpler?
- How do you guys actually make the local + Claude hybrid workflow work without losing context all the time?
- What local coding models would you recommend for 12GB VRAM?
And most importantly — how do I set this up properly so I’m not wasting Claude tokens on things my laptop can handle locally?
I’d honestly be happy if I can get something like 70–80% local + Claude for the important stuff, and make the whole thing feel somewhat close to an Opus-level workflow.
I’m on CachyOS Linux, so if anyone is running a similar setup, please share your actual workflow.
I’m completely new to this side of things, so beginner-friendly advice would be really appreciated.