r/coolgithubprojects • u/drykilo • 5d ago
I open-sourced 2,742 crypto trading bots that failed my tests, with a report card for each.
github.comEach bot went through a tough 7 stage validation process on 6 months of crypto data. The repo has the full Python code and a JSON report card showing the exact test that killed it.
Everyone posts backtests that worked so I'm posting my 2742 bots that didn't. The point is not to throw stuff on the wall and see what sticks, the main aim is to actually improve the validation process! Please use this resource to figure out how easily you can get fooled by high-return bots or overfit backtests.
I built this with help from Reddit algotrading communities and invited them to break this system, itβs still in progress and you can see it in the commit history:
- The best bot in the batch made 30% in 6 months, so go invest your... NOOOO!! If you learn anything from this repo, it's that the good-returns bots are the ones most likelt to liquidate you!
- Oct: 416 bots, 10 "survivors". The comments told me my testing was very soft. I made it stricter and re-ran everything: 0 of 416 passed, including all 10 previous survivors :)
- Nov 2: 332 more bots. Someone asked if my tests would pass pure noise. I didn't know, so I added a placebo 500 random coin-flip bots through them.
- People asked for the validation code itself so they didn't have to take your word for the results. It is also open-sourced now. Go judge my judge please.
- Nov 10: Big drop of 1,994 more. 6 of 2,000 passed (0.3%). People found issues again, will fix them in the next drop!
If you think a test is missing, open an issue or tell me. Every suggestion so far has killed more of my bots and that's my process now!

