parallel processing fine balance
1 view (last 30 days)
Show older comments
Raphael Alhadef
on 16 Apr 2020
Commented: Raphael Alhadef
on 17 Apr 2020
I am running a fairly straightforward loop on a single machine, and want to take advantage of parallel processing (parfor on heaps).
Each iteration of the loop is supposed to take about the same time.
I am splitting between each worker equally, but I am unsure on how to treat the remainer, and am unsure whether this even makes a diffence.
Let's assume I have 3 workers and 19 iterations. I could do 7,7,5 or 7,6,6. Theoretically, they are both limited by the slower worker (on average either one with 7 iterations), so it wouldn't seem like it makes much of a difference.
Any insight on this would be helpful - namely which approach should I use.
thanks!
0 Comments
Accepted Answer
Edric Ellis
on 17 Apr 2020
Edited: Edric Ellis
on 17 Apr 2020
You're quite right that in this case, you're always inevitably going to be held up by the slowest worker. It's almost impossible to predict which of your two approaches would be faster - I'd suggest simply measuring the execution time for each case.
More Answers (0)
See Also
Categories
Find more on Parallel for-Loops (parfor) in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!