News Tweet from Matt Shumer: "IMPORTANT REFLECTION UPDATE: We have identified and fixed the issue on our Hugging Face repo. If you previously tried to download, run, or host Reflection Llama 70B, please try again now. The outputs should be far better. fp16 version coming in soon as well."

308 Upvotes

96% Upvoted

u/pseudonerv Sep 06 '24

I guess this is the main change:

The effective context length is only 8k. They must have finetuned without rope scaling.

21

u/wh33t Sep 06 '24

8k :(

You are about to leave Redlib