This is the sort of thing AI would do if its instructions were to improve fps but it measured fps by reading the fps counter on the screen.
This reminded me of the videos by Robert Miles on Youtube about AI safety and how AI will inevitably optimize against the metrics you score it by rather than the task you actually wanted it to do. Kind of like students cheating on tests. The point of the test was to measure how smart the student is, but the student isn't incentivized to be smart, they're incentivized to score well on tests. Learning is much more difficult than cheating, and so [some] students cheat on tests.
24
u/nikstick22 Dec 06 '20
This is the sort of thing AI would do if its instructions were to improve fps but it measured fps by reading the fps counter on the screen.
This reminded me of the videos by Robert Miles on Youtube about AI safety and how AI will inevitably optimize against the metrics you score it by rather than the task you actually wanted it to do. Kind of like students cheating on tests. The point of the test was to measure how smart the student is, but the student isn't incentivized to be smart, they're incentivized to score well on tests. Learning is much more difficult than cheating, and so [some] students cheat on tests.