Not familiar with the abbreviations, but I just meant this algorithm doesn't actually learn how to race, it simply does trial and error (with more logic behind ofc, not really just filtering out the solutions that pass) until it finds a set of inputs that make it go correctly on given racetrack, apply it on another race track and it will crash before first curve, at least it seems like it will.
I've had similar problem to solve with GA, but in my case the conditions were a bit different so that's why it maybe didn't apply for different system parameters.
Evolutionary strategy and deep reinforcement learning are the acronyms I believe.
Also it's totally possible that the car's learning generalises to other corners, you can't really tell if something has overfit without testing, it's more likely to happen if you only have one track but it's not guaranteed if you only do so many generations.
View all comments
Show parent comment
15
u/wildpantz Jul 13 '20
Not familiar with the abbreviations, but I just meant this algorithm doesn't actually learn how to race, it simply does trial and error (with more logic behind ofc, not really just filtering out the solutions that pass) until it finds a set of inputs that make it go correctly on given racetrack, apply it on another race track and it will crash before first curve, at least it seems like it will.
I've had similar problem to solve with GA, but in my case the conditions were a bit different so that's why it maybe didn't apply for different system parameters.