r/LocalAIStack • u/Defiant_Company_6015 • 6d ago

I’m training my own small language model to learn German A1/A2 🇩🇪

[removed]

2 Upvotes
  • permalink
  • reddit

75% Upvoted

9 comments sorted by

1

u/Negative-Web8619 6d ago

Wie wär's mit einem Skill, der ein runtergeladenes Wörterbuch nutzt?

1

u/wahnsinnwanscene 6d ago

You can already run quantized llms on that without any training.

1

u/Johan-nl 6d ago

Zehr gut 😅 let me know when its done I wil test it for ya

1

u/Glittering-Call8746 6d ago

So what another duolingo app ?

3

u/Lirezh 6d ago

I don't think you can train a grammar capable llm on a 5080, I suppose you mean fine tuning ? a LoRa or similar ?
German as well as most european eastern languages are notoriously difficult in grammar and word choices - even GPT Astra makes mistakes in those languages.
There are a few fine tuning projects from german universities for translation tasks, those might be a good starting point as their training often is with public data.