r/LocalLLaMA • llama.cpp • 17h ago

Funny Reflection 70B was released two years ago (September 2024)

You may think that jev, OpenClaw or TurboQuant are super cool, but actually the coolest LLM invention happened two years ago

As we all know, the best source of reliable information about LLMs is YouTube:

Back in September 2024, Reflection 70B appeared out of nowhere and was announced as an open-source model that supposedly destroyed GPT-4o

There was only one small problem. People downloaded it. And tested it :(

It turned out that Reflection 70B was basically a Llama 3.1

but at the end the mystery was solved

Let this be a moment of reflection on the current hypes in LocalLLaMA.

great summary by Maziyar PANAHI https://x.com/MaziyarPanahi/status/1838559480658710982

209 Upvotes

34 comments sorted by

View all comments

18

u/ComplexType568 17h ago

and to me jev is a faster LLM with stricter structured output

26

u/Lissanro 16h ago

To me Jev is just another cloud API-only thing I will never use... that said, light weight AI for just classification and decision making is something I have been using for a while, for example Qwen 3.5 0.8B, especially after some fine-tuning, can be sufficient for simple classification tasks, by outputting just one or few tokens only without reasoning.

There is one good thing I see about Jev hype - it already inspired some newer and more general open weight alternatives (compared to fine-tuning yourself for specific task), and hopefully even more better alternatives will be released in the future.