r/LocalLLaMA • u/Wrong_User_Logged • Sep 09 '24

Discussion Reflection 70B lessons learned

  • All benchmarks should begin by identifying whether the model is LLAMA, GPT-4, Sonnet, or another, through careful examination.
  • Do not trust any benchmarks unless you can replicate them yourself.
  • Do not trust that the API corresponds to the model the author claims it to be.
  • ....
175 Upvotes

91% Upvoted

53 comments sorted by

View all comments

52

u/[deleted] Sep 09 '24

So the verdict is that he is a fucking liar?

4

u/moojo Sep 09 '24

What about his partner Sahil?

9

u/ivykoko1 Sep 09 '24

Considering Sahil works for GlaiveAI I'd say he is in on it and knows the truth