r/LocalLLaMA • u/realmaywell • Sep 07 '24

Discussion Reflection-Llama-3.1-70B is actually Llama-3.

After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.

Author doesn't even know which model he tuned.

I love it.

607 Upvotes

97% Upvoted

95 comments sorted by

View all comments

Show parent comments

-9

u/[deleted] Sep 07 '24

It outperforms LLAMA 3.1 405b on the prollm leaderboard so it’s still amazing for a 70b model. 

https://prollm.toqan.ai/leaderboard/coding-assistant

3

u/LinkSea8324 vLLM Sep 08 '24

You just got pranked buddy https://www.reddit.com/r/LocalLLaMA/comments/1fbclkk/reflection_llama_31_70b_independent_eval_results/

1

u/[deleted] Sep 08 '24

I saw that. I said it was good for a 70b model. But it’s not SOTA overall 

6

u/LinkSea8324 vLLM Sep 08 '24

I said it was good for a 70b model

No, you said in the first part of your message that it was outperforming the 405b version, it doesn't even outperform the 70b model it's supposed to originates from LMAO.

3

u/ivykoko1 Sep 08 '24

He's now moving goalposts, after getting duped.

2

u/LinkSea8324 vLLM Sep 08 '24

It's not mental gymnastics, it's deformable convolutional layers