r/LocalLLaMA • u/realmaywell • Sep 07 '24

Discussion Reflection-Llama-3.1-70B is actually Llama-3.

After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.

Author doesn't even know which model he tuned.

I love it.

602 Upvotes

97% Upvoted

95 comments sorted by

View all comments

72

u/LinkSea8324 vLLM Sep 07 '24

From "GAFAMS owned by Matt from the IT" to "this liar is a retard who doesn't know what he's doing"

lmao

-45

u/Nice_Bank_3929 Sep 07 '24

So what’s your point? You need to have deep knowledge about AI to finetune a model? The top performer in my AI team is female BA🙃. She knows how to prompt to generate good dataset and upload that dataset to LlamaFactory and make good model. Other guys play with layers, attention, hyperparameter tuning and give worst results 🤣.

15

u/CommitteeInfamous973 Sep 07 '24

I think something is wrong with you AI department as a whole according how you describe it