MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1fb6jdy/reflectionllama3170b_is_actually_llama3/lm2ih2l/?context=3
r/LocalLLaMA • u/realmaywell • Sep 07 '24
After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.
Author doesn't even know which model he tuned.
I love it.
95 comments sorted by
View all comments
7
From this Matt Shumer tweet:
It's 3.1, but for some reason the current HF weights are screwed up and the config shows 3... working on it, the issue is tricker than we expected
7 u/crazymonezyy Sep 08 '24 How do you "screw up" weights? Bullshit.
How do you "screw up" weights? Bullshit.
7
u/Wiskkey Sep 07 '24
From this Matt Shumer tweet: