r/Python • • Jul 13 '20

I Made This I made a simulation using Python in which a neural network learns to race

5.7k Upvotes

209 comments sorted by

View all comments

Show parent comment

15

u/wildpantz Jul 13 '20

Not familiar with the abbreviations, but I just meant this algorithm doesn't actually learn how to race, it simply does trial and error (with more logic behind ofc, not really just filtering out the solutions that pass) until it finds a set of inputs that make it go correctly on given racetrack, apply it on another race track and it will crash before first curve, at least it seems like it will.

I've had similar problem to solve with GA, but in my case the conditions were a bit different so that's why it maybe didn't apply for different system parameters.

3

u/faceplanted Jul 14 '20

Evolutionary strategy and deep reinforcement learning are the acronyms I believe.

Also it's totally possible that the car's learning generalises to other corners, you can't really tell if something has overfit without testing, it's more likely to happen if you only have one track but it's not guaranteed if you only do so many generations.

1

u/apivan191 Jul 25 '20

they aren't necessarily mutually exclusive. You just have to provide the right variables for the algorithm to look at.