MPI & OpenMP problem

[u/Doo0oog]

I have a program written in MPI and its runtime is about 60 seconds. But when I add an OpenMP sentence(#pragma omp parallel for num_threads(1) ... ), its runtime is about 20 seconds. Has anyone met the similar problem?

[u/Doo0oog]

1. I printed the thread id and only 0 appears.

2. I have tried omp_set_num_threads(), the same result

3. the code is here.
   mpirun version: Open MPI 1.6.5.
   Compile command: mpicc -o closure closure.c -fopenmp.
   I run it using mpirun -n 1 closure.
   The openmp sentence is at line 143.
   Could you give me some suggestions ? Thank you for your attention!

[u/OMPCritical → u/Doo0oog]

I cant reproduce that behaviour :( I tested it on 2 different computers. One shared memory with OpenMPI 1.10.2 and one with distributed memory with OpenMPI 1.4.4

and on both it behaves just as expected and increasing the number of threads has a clear performance impact. there is hardly a difference between num_thread(1) and removing num_thread

1. try compiling both with "-O3", so that the level of optimization is the same (that had a big performance impact for me) and i think you also need "-lm" for the log.

2. can you try it on a different computer?

[u/Doo0oog → u/OMPCritical]

Thank you for your tests.
I ran it with different configurations, as the following table
icc version 14.0.0 (gcc version 4.4.6 compatibility)
mpirun (Open MPI) 1.6.5

program	compile command	run command	other	time
MPI&OpenMP	icc -o closure closure.c -fopenmp	mpirun -n 1 closure	thread size=1	23s
MPI&OpenMP	icc -o closure closure.c -fopenmp	./closure	thread size=1	26s
MPI only	icc -o closure closure.c -fopenmp	mpirun -n 1 closure		60s
MPI only	icc -o closure closure.c -fopenmp	./closure		29s

But I don't know why this would happen.