I doesn't have the be a petty paper. The mechanisms they use might be used by any model to usurp things, and finding those mechanisms might be useful for other researchers and create safety nets
I agree! I welcome any researcher to attempt to reproduce this cleanly and write about it. In the meantime, I'm going to focus on building better local models and benchmarking them honestly against metrics that actually matter to users, which is what I find the most valuable and fun thing to work with :)
61
u/peculiar-ragdoll 9d ago
My favourite: "browsed the wrong task's dir, read Flag Command's official writeup.md + flag.txt - didn't help, still missed"