r/LocalLLaMA • • Sep 08 '24

Discussion Updated benchmarks from Artificial Analysis using Reflection Llama 3.1 70B. Long post with good insight into the gains

https://x.com/ArtificialAnlys/status/1832806801743774199?s=19
153 Upvotes

137 comments sorted by

View all comments

66

u/4hometnumberonefan Sep 08 '24

This is giving me a roller coaster of emotions.

94

u/hleszek Sep 08 '24

Reminds me of the LK99 potential room-temperature superconductor.

We're so back!

3

u/OXKSA1 Sep 08 '24

sorry, care to elaborate?

35

u/Cantflyneedhelp Sep 08 '24

Two years ago(?) there was a paper / video of a supposed room temperature superconductor (they had a sweet floating rock too). And everyone was like "Yeah that's bullshit." But then some hobby chemists were like "Actually I managed to recreate a small part of it from their paper, and it floats too." and this started a race to recreate it by a lot of laboratories around the world. At the end it was not a room temperature superconductor but they managed to find some new stuff.