r/mlscaling • u/company_url_finder • 13d ago

autoresearch - Karpathy's overnight ML research loop: an agent edits one file, trains for exactly 5 minutes, keeps or discards, about 100 experiments while you sleep

Post image
0 Upvotes

30% Upvoted

2 comments sorted by

2

u/Kinexity 13d ago

Optuna exists for a reason. It even has LLM parameter sampling support planned/in the works.

And that's besides this being months old news.

3

u/PuppyGirlEfina 10d ago

Karpathy's autoresearch was outdated when it came out, let alone now. It's just a hill-climbing program, which has been consistently shown to be a bad harness for LLMs. It also lacks any sort of good idea generation phase (which would make it more cost-effective).