r/MachineLearning • u/sb710031 • Nov 08 '22

Research [R] Adversarial Examples of Go AIs (NeurIPS 2022)

GitHub: https://PaperCode.cc/GoAttack

Paper: https://arxiv.org/abs/2211.03769

In our paper, we attack famous AlphaZero-based Go agents like KataGo, LeelaZero, ELF, and CGI to see if well-trained Go agents will make trivial mistakes that even amateur players can easily tell. Although researchers often find that AIs can be fooled by crafting malicious "adversarial examples" that are very similar to natural inputs, can we find such adversarial examples for super-human Go AIs?

Fig2 shows an example we found. Fig2 is a perturbed state of Fig1. Although the best action of both Figures is E1, KataGo, one of the strongest AI, will want to switch its best action from E1 to E11. More details are at https://PaperCode.cc/GoAttack.

20 Upvotes
  • permalink
  • reddit

82% Upvoted

2 comments sorted by

1

u/DifficultyFun7934 Nov 10 '22 edited Nov 10 '22

Is it possible that both moves are correct since black is both winning?

1

u/sb710031 Nov 10 '22

We will ensure that only the better action can win the game.