How can I open a worker pool on a remote machine?
조회 수: 24 (최근 30일)
이전 댓글 표시
Can MATLAB send calculations to remote workers through ssh?
I want to achieve the following behavior:
% connect to remote machines via ssh
% and open 4 workers on each machine (i.e. total pool of 8 worker)
RemoteParpool('location',{'local','userA@address1','userB@address2'},'PoolSize',[2 3 4])
% distribute some work over 9 workers (6 remote & 2 local) and return an answer to the Workspace variable 'MyArray'
parfor j=1:10
MyArray(j)=rand; % do stuff
end
The remote (and local) machines all have MATLAB with Parallel Computing Toolbox and run on Linux. And I'm using passphraseless ssh login with shared keys.
댓글 수: 0
채택된 답변
Jason Ross
2019년 4월 9일
This is the purpose of MDCE / MATLAB Parallel Server. It allows you to run the MATLAB job scheduler on a collection of machines, or integrate with an existing scheduler installation (Slurm, LSF, PBS, Torque, Grid Engine, etc). You submit the job to the remote scheduler using Parallel Computing Toolbox and then the job scheduler starts the MATLAB sessions and runs the job.
댓글 수: 2
Jason Ross
2019년 4월 10일
No, when you go off the single machine (local scheduler) you definitely need some kind of scheduler listening.
We do offer a means of parallelized computation on Amazon EC2, where all the scheduler setup happens on Amazon -- but that's not local resources, and it does require some other setup.
추가 답변 (0개)
참고 항목
카테고리
Help Center 및 File Exchange에서 Cluster Configuration에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!