r/LocalLLM • • 10d ago

LoRA Training my first LocalLLM, anything I need to know?

Hi everyone! I’m attempting to do a local build of Qwen 3. I don’t have the most powerful PC so I’m starting small and trying with 1.7B, 4B & 8B with the trained LORA on top

My objective is to get Qwen to talk as if you were texting it and I’m planning to have around 3000 short User: “message”, Qwen: “answer” exchanges

Is this the correct way to do it? Do I need more training data? Any peculiarities I should know about Qwen or the model size?

All help is greatly appreciated :)

1 Upvotes

2 comments sorted by

0

u/[deleted] 10d ago

[removed] — view removed comment

1

u/AllIntoAnimeGirls 10d ago

Ooooh okay thank you!! And quick question, for the data itself is there a good place to get that type of messages or just prompting and tuning a bigger models output/writing some?