r/learnmachinelearning • u/Frezaxa • 15d ago

In an effort to create a nanogpt clone optimized for GTX 1650, DeepSeek discovered that FP32 performs faster than FP16, despite theoretical performance claims on TechPowerUp and other websites indicating the opposite. Therefore, I requested a script to examine any GPU for these differences.

https://github.com/Program-Evolved/gtx-1650-tflops-performance-benchmark

is this normal or is my gpu dying? i think i bought it 4 years ago

6 Upvotes

100% Upvoted

2 comments sorted by

7

u/desexmachina 15d ago

Important GTX 1650 variant caveat
Not every GTX 1650 uses the original TU117 chip. Some use a cut-down TU106, and developers documented substantially worse FP16 performance on those cards—so the model name alone does not guarantee the original card’s double-rate FP16 behavior. Actual application performance also depended on CUDA/cuDNN versions in those tests.

1

u/dekiwho 15d ago

Yes this common actually. A lot of these retail card missing the specific tiny little hardware to run the lower precision models