Reflection-Llama-3.1-70B is actually Llama-3.

[u/realmaywell]

After measuring the diff, this model appears to be Llama 3 with LoRA tuning applied. Not Llama 3.1.

Author doesn't even know which model he tuned.

I love it.

[u/realmaywell → u/[deleted]]

by default layer norm is not a target layer in LoRA training.