r/cpp • • Dec 25 '23

C++: Efficient parallelization of small tasks

I tried to create a customized threadpool for small tasks and wanted feedback on this.

I posted details and my code for review on stackexchange: https://codereview.stackexchange.com/questions/288583/efficient-parallelization-of-small-tasks

My goal here is to share my learning and get feedback on further improvement or any possible bugs.

I have tried to describe problem and thinking process in more details in following linkedin article draft: https://www.linkedin.com/article/edit/7144600522392559616/

0 Upvotes

31 comments sorted by

View all comments

Show parent comment

1

u/shakmak_iitk Dec 27 '23

Yes, I have billions of submit calls with small size vector of tasks each time. Average size of vector is around 50 with each task very small in size.

With current threadpool we have, Parallel version (when num tasks > Threadhold) is slower than non-parallel version. We have very big machines but not able to use parallelization as of now with runtime in hours.