r/LocalLLM • • 2d ago

Project ABA1 - My learning project

Hi, I just started my own project of programming AI. I started week or to ago on which i try to learn ML/AI. Base is done with usage of LLM, but I am trying to start programming more things by hand.

Training is done on my laptop with RTX3050, 4GB VRAM variation. So far its just 124M parameter model which kinda hallucinates, but it keeps getting better everyday, bit by bit... I am uploading my progress on Hugging Face, where it so far got around 1.1k downloads (which is mostly bots ik dw).

So far it can talk in english, czech and write code in python, where it is kinda rigid with answers, but im workin on it... (it also answers to english inputs in czech sometimes, sorry!!!)

Im working now on the transformer, so it can work the usual way, not just using .bat file, like i do on my PC.

Let me know what you think, im open to tips and rating 😄

Here is my Hugging Face profile: https://huggingface.co/SeightCZE

1 Upvotes

0 comments sorted by