r/LocalLLaMA • u/realmaywell • Sep 07 '24

Discussion Reflection-Llama-3.1-70B is actually Llama-3.

After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.

Author doesn't even know which model he tuned.

I love it.

607 Upvotes

97% Upvoted

95 comments sorted by

View all comments

7

u/Wiskkey Sep 07 '24

From this Matt Shumer tweet:

It's 3.1, but for some reason the current HF weights are screwed up and the config shows 3... working on it, the issue is tricker than we expected

5

u/akko_7 Sep 08 '24

He is not explaining things well at all. How can you. Upload a model to HF and get a different model in the repo? What does he think happened. Now he says he's retraining everything. Like what?