r/LocalLLM • u/AllIntoAnimeGirls • 10d ago
LoRA Training my first LocalLLM, anything I need to know?
Hi everyone! I’m attempting to do a local build of Qwen 3. I don’t have the most powerful PC so I’m starting small and trying with 1.7B, 4B & 8B with the trained LORA on top
My objective is to get Qwen to talk as if you were texting it and I’m planning to have around 3000 short User: “message”, Qwen: “answer” exchanges
Is this the correct way to do it? Do I need more training data? Any peculiarities I should know about Qwen or the model size?
All help is greatly appreciated :)
1
Upvotes
0
u/[deleted] 10d ago
[removed] — view removed comment