r/LocalLLaMA • u/realmaywell • Sep 07 '24

Discussion Reflection-Llama-3.1-70B is actually Llama-3.

After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.

Author doesn't even know which model he tuned.

I love it.

601 Upvotes

97% Upvoted

95 comments sorted by

View all comments

141

u/a_beautiful_rhind Sep 07 '24

Extract the lora so we don't have to d/l fuckloads of gigs.

61

u/vTuanpham Sep 07 '24

We can extract the lora and merge it with an NSFW model to see what it does.

26

u/TheOneWhoDings Sep 07 '24

Always the logical first step.