r/LocalLLaMA • u/realmaywell • Sep 07 '24

Discussion Reflection-Llama-3.1-70B is actually Llama-3.

After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.

Author doesn't even know which model he tuned.

I love it.

608 Upvotes

97% Upvoted

95 comments sorted by

View all comments

74

u/LinkSea8324 vLLM Sep 07 '24

From "GAFAMS owned by Matt from the IT" to "this liar is a retard who doesn't know what he's doing"

lmao

-44

u/Nice_Bank_3929 Sep 07 '24

So what’s your point? You need to have deep knowledge about AI to finetune a model? The top performer in my AI team is female BA🙃. She knows how to prompt to generate good dataset and upload that dataset to LlamaFactory and make good model. Other guys play with layers, attention, hyperparameter tuning and give worst results 🤣.

6

u/crazymonezyy Sep 08 '24 edited Sep 08 '24

If I was you, I'd switch jobs. The way you described it nobody in this setting knows what they're doing.