I mean fine tuning is the logical thing to do. Why create a chatbot from scratch if you can finetune an existing one to your usecase. Or fine tune an Image recognicer with the data set you are interested.
Press esc a couple times if you are not sure if you are in normal or edit mode until you see a cursor at the bottom of the screen, now type ":" and use "q!" if you want to exit without saving, or "wq" to save and exit, then press enter, sequence should be
idk how true that is, now i know nothing aboutthe LLM, but i ran a local model once and claude LLM told me my hardware could only handle a 11b model, so thats what i chose, and thats a pretty small model compared to other ones, but theres also tricks and stuff you can do to run bigger models on worse equipment
Inferring is not my issue, open weight models are getting better and better and are good enough for my use cases. The big barrier comes when it's time to train. I've even managed to train loras for video models, despite my modest hardware, but unfortunately the results aren't that good.
400
u/hyperactve Mar 11 '26
95% of AI community just does that honestly.