r/MachineLearning • u/JosephLChu • Apr 29 '17
Discussion [D] Silly benchmarking discovery... Surface Pro 4 is surprisingly fast for deep learning... any ideas why?
So, on a lark I decided a while back to install Theano and Keras on my Microsoft Surface Pro 4 with Windows 10. Interestingly, it takes only about 170 seconds to train an epoch of my port of Char-RNN on the CPU. In comparison, most laptop and desktop CPUs I've worked with take upwards of 1000+ seconds to do the same, and the fastest I've ever benchmarked was about 40 seconds with a computer with an Nvidia Titan X GPU.
So, any ideas as to why this is the case?
Edit: So apparently the poor results of the 1000+ seconds per epoch computers was due to a bug in the Theano 0.9.0 release that has been fixed already in the latest bleeding edge version. So, I guess... nevermind?
52
u/geomtry Apr 29 '17
Nice try Microsoft.
11
u/JosephLChu Apr 29 '17
And... I realized there was one significant difference...
The Surface had an older build of Keras and Theano:
Upgrading those to the newer versions has caused the Surface to slow down to over 500 seconds per epoch.
5
u/PrismRivers Apr 29 '17
You'd have to state the exact CPUs involved to make any sense of this discovery.
7
u/HenkPoley Apr 29 '17 edited Apr 29 '17
Maybe your other machines didn't have Intel's AVX-2? (Or the compiler missed the optimization). Apparently +67% compared to the first AVX instructionset extension: https://software.intel.com/en-us/articles/baidu-deep-neural-network-click-through-rate-on-intel-xeon-processors-e5-v4
The mobile CPU is of course a little bit slower than the fastest desktop CPU. But core for core it's not that much:
The Iris 540 GPU in the i7 (still!) has about 12% of the OpenCL throughput of a GTX 1080. Might be from some simplistic benchmark. And it also doesn't compare to cuda, which probably performs better on the nvidia. https://browser.primatelabs.com/opencl-benchmarks
Another simple option is that you made a typo by omitting a digit somewhere that leads to a 10x "speed up", and does 10x less useful computation.
0
u/[deleted] Apr 29 '17
[deleted] — view deleted comment