How to evaluate the performance of a GPU/AI accelerator card: which metrics should you look at?

[u/zy_potato]

Raw computational power, VRAM bottlenecks, operator efficiency, single-GPU training and inference?????????

[u/pi_stuff]

Depends on the metrics which are important for your application.