MATLAB Answers

0

Distributed and parallel computing without DCS

Chuck 님이 질문을 제출함. 9 Sep 2011
최근 활동 Walter Roberson 님이 편집함. 29 May 2015
Is there a way to perform distributed computing across multiple computers without licensing Distributed Computing Server (DCS)? It is implied that Sun Grid Engine may be used without DCS, but my attempts to integrate torque+maui produce licensing errors. Which schedulers/resource managers are possible without the quite expensive (relative term, of course) DCS?

  댓글 수: 1

Has no one integrated Sun Grid Engine and MATLAB? Can anyone help with this?

로그인 to comment.

답변 수: 5

Daniel Shub 님의 답변 26 Oct 2011
 채택된 답변

If you have the MATLAB compiler you can compile your code and then run it with the Sun Grid Engine without MATLAB or the DCS toolbox.

  댓글 수: 4

표시 이전 댓글 수: 1
It limits what you can do. Everything I do is embarrassingly parallel, so I can get away with it. There are advantages of the PCT and DCS. With the PCT you can use parfor, with the compiler you need to roll your own. I shudder to think about trying to deal with distributed arrays and the such.
Hi all If i want to use MATLAB compiler to compile the matlab program to Java or C++ program and then deploy with grid technology such as Datasynapse without using DCS, is it viable? If yes, is there any document / URL could provide very details. Many thx for sharing the info
You need to provide a lot more details to get a useful answer. The comments of an answer is probably not the best place to ask this question. You should ask a new question (it might be converting my MATLAB code to Java/C, or making an executable from MATLAB code, or modifying MATLAB code so that it will work in a distributed environment, or deploying a set of executables on a Datasynapse grid). The last not really being a MATLAB question.

로그인 to comment.


Thomas 님의 답변 26 Oct 2011
Walter Roberson 님이 편집함. 29 May 2015

Hi Chuck,
In order to perform distributed computing across multiple computers you need the DCS license. We have DCS running with the Sun Grid Engine on our Cheaha cluster at UAB. The implication that SGE may be used with out the DCS is not correct. What I think was implied was that - You can use the SGE scheduler instead of the scheduler provided by the MATHWORKS (MATHWORKS job manager) along with the DCS.
Grid Engine Family:
Grid Engine
Sun N1 Grid Engine
Sample integration scripts are available with the
MATLAB Distributed Computing Server installation.
In short- you cannot use the distributed computing without the DCS.
You can use the parallel computing toolbox on your local multicore machine to use upto 12 workers to run in parallel with R2011b.
If you need help integrating DCS with SGE there are sample scripts available or you can contact MATHWORKS support.

  댓글 수: 0

로그인 to comment.


Jason Ross 님의 답변 26 Oct 2011

To add a little additional information: If you want to use Torque/PBS, you can do so with the direct integration from the Parallel menu, or using scripts similar to the ones for SGE if your environment won't allow the use of the direct integration.
Thomas and Anthony have already covered the licensing issues fairly thoroughly.

  댓글 수: 1

Hi Jason, per your above additional info, does it means it is technically possible to use the the Parallel menu of PCT to directly integrate with some scheduler such as SGE or grid technology without DCS? If so, is there any document / URL could provide very details. Many thx for sharing the info

로그인 to comment.



Starting with MATLAB R2010b MATLAB Compiler allows you to compile MATLAB code containing PARFOR and SPMD running on local scheduler.
The same limitations as with PCT local scheduler apply to compiled MATLAB applications.

  댓글 수: 1

This is not correct. The feature was added in release R2011a. See the MATLAB Compiler release notes:

로그인 to comment.


Chuck 님의 답변 27 Oct 2011

Thanks for this information. We do have the compiler licensed, so that may be a good solution for us.

  댓글 수: 0

로그인 to comment.



Translated by