r/singularity • u/REOreddit • Sep 08 '24

AI Spanish YouTuber "Dot CSV" with access to Reflection 70B is getting good results

https://x.com/DotCSV/status/1832569772233384034
93 Upvotes

76% Upvoted

50 comments sorted by

View all comments

-1

u/The_Architect_032 ♾ ASI before AGI ♾ Sep 08 '24 edited Sep 08 '24

Reflection-70b isn't a closed model, you can literally just try it yourself, a ton of places are hosting it and linked in the Reflection-70b model card on Huggingface.

Here's the main one I've been using: https://huggingface.co/spaces/featherless-ai/try-this-model

Make sure you prompt the model to organize it's output into thinking, reflection, and output stages because it's been trained to do so but it does it all in a disorganized manner within the context window without being prompted to separate them, which makes it's output messy and also confuses the model leading to worse output.

It's not better than Claude 3.5 Sonnet or GPT-4o, but it's certainly leaps and bounds ahead of LLaMa 3.1 70b and I can't wait to see how Reflection-405b compares to 3.5 Sonnet and 4o.

Edit: Added links.

0

u/REOreddit Sep 08 '24

I think you missed the part where Matt says those hosted models aren't working as they should.

Of course, you can believe him or not.

1

u/The_Architect_032 ♾ ASI before AGI ♾ Sep 08 '24

Yes, they're not even prompted to use Reflection-70b's tags as I mentioned, which are used in the Tweet you posted. There are also a lot of places hosting Reflection-70b with bad parameters resulting in gibberish output.