The assignment of workers to cores

43 views (last 30 days)
Halil Eyyuboglu
Halil Eyyuboglu on 21 Feb 2018
Commented: Kojiro Saito on 24 Sep 2019
Hello, we are planning to buy an MDSC of 128 workers. In running a parallel job of 128 workers, what is the minimum number of cores should there be in the hardware platform that I am going to use? How many workers can I assign to each core of the machine at the maximum ? Would appreciate your answer. Thanks

Answers (2)

Kojiro Saito
Kojiro Saito on 21 Feb 2018
Edited: Kojiro Saito on 21 Feb 2018
It is possible to run more workers than the number of CPU cores, for example, 128 workers on 1 CPU core, but it would not make the performance better.
Please see this MDCS System Requirments. It says "Maximum of 1 MATLAB worker per CPU core is recommended." So, assume you want to obtain 128 MDCS workers, recommended CPU cores are more than 128.

Halil Eyyuboglu
Halil Eyyuboglu on 26 Feb 2018
Dear Saito ; Thanks for the reply, there is also the thread issue (mostly two threads per core). The people who sell workstations say that since the threads within the core are independent physical entities, it should be possible to assign one worker to a thread or alternatively two workers to a core (without degrading the performance). I would like to receive your kind comment on this issue as well. Thanks.
  3 Comments
wonderkismet
wonderkismet on 23 Sep 2019
How to do it programmaly?
Kojiro Saito
Kojiro Saito on 24 Sep 2019
You can change NumThreads by editing parcluster object. Here is an example.
c = parcluster('myMjsProfile'); % myMjsProfile is a cluster profile name
% Change NumThreads from 1 to 2
c.NumThreads = 2;
% Optional. You can save the cluster profile
saveProfile(c)
% Open parpool using this cluster profile
p = parpool(c);
% Do parfor job
parfor n=1:c.NumWorkers
% ...
% ...
end

Sign in to comment.

Categories

Find more on Parallel Computing Fundamentals in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!