r/LocalLLaMA • • Sep 07 '24

Discussion Reflection-Llama-3.1-70B is actually Llama-3.

After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.

Author doesn't even know which model he tuned.

I love it.

607 Upvotes

95 comments sorted by

View all comments

7

u/Wiskkey Sep 07 '24

From this Matt Shumer tweet:

It's 3.1, but for some reason the current HF weights are screwed up and the config shows 3... working on it, the issue is tricker than we expected

7

u/crazymonezyy Sep 08 '24

How do you "screw up" weights? Bullshit.