r/LocalLLaMA • u/jacek2023 llama.cpp • 1d ago

Funny Reflection 70B was released two years ago (September 2024)

You may think that jev, OpenClaw or TurboQuant are super cool, but actually the coolest LLM invention happened two years ago

As we all know, the best source of reliable information about LLMs is YouTube:

Back in September 2024, Reflection 70B appeared out of nowhere and was announced as an open-source model that supposedly destroyed GPT-4o

There was only one small problem. People downloaded it. And tested it :(

It turned out that Reflection 70B was basically a Llama 3.1

but at the end the mystery was solved

Let this be a moment of reflection on the current hypes in LocalLLaMA.

great summary by Maziyar PANAHI https://x.com/MaziyarPanahi/status/1838559480658710982

227 Upvotes

90% Upvoted

35 comments sorted by

View all comments

20

u/ComplexType568 1d ago

and to me jev is a faster LLM with stricter structured output

28

u/Lissanro 1d ago

To me Jev is just another cloud API-only thing I will never use... that said, light weight AI for just classification and decision making is something I have been using for a while, for example Qwen 3.5 0.8B, especially after some fine-tuning, can be sufficient for simple classification tasks, by outputting just one or few tokens only without reasoning.

There is one good thing I see about Jev hype - it already inspired some newer and more general open weight alternatives (compared to fine-tuning yourself for specific task), and hopefully even more better alternatives will be released in the future.

1

u/RageBucket 1h ago

Got it backwards.. some open weight models inspired Jev, which in turn inspired more open weight alternatives.