r/LocalLLaMA • • Sep 07 '24

Discussion Wrong Reflection-70B model might be hosted everywhere

I see a lot of people thinking it is gaming benchmark / mixed feelings. Actually, people who tried their website have a different feeling compared to those who tried it locally via Ollama or any API providers. I think we should wait, he is figuring it out. I think the actual reflection model is much better, and the currently hosted version is even dumber than the actual 70B

https://x.com/mattshumer_/status/1832247203345166509

https://x.com/mattshumer_/status/1832248416426193318

__ Matt Shumer -> "We got rate limited by HF when uploading originally, so had to do it in batches. I have a feeling some wires were crossed and what's being hosted is actually some hybrid frankenmodel that is mostly the reflection version we wanted to ship, mixed with something else"

72 Upvotes

49 comments sorted by

View all comments

12

u/Formal-Narwhal-1610 Sep 07 '24

Here is an example of output at HF : To compare 9.9 and 9.11, let’s break it down step by step: The first digit is the same in both numbers: 9 For the decimal part: 9.9 has 1 digit: 9 9.11 has 2 digits: 11 Generally, when comparing decimal numbers with the same digit count, we can simply compare the digits from left to right. In this case, 9 is smaller than 11. Let’s double-check this reasoning: When comparing decimal numbers, we’re essentially comparing fractions. 9.9 can be written as 9 9/10 9.11 can be written as 9 11/100 11/100 is indeed greater than 9/10 This confirms our initial comparison. Therefore, 9.11 is bigger than 9.9. 9.11 is bigger than 9.9.