Edric Ellis
MathWorks
Followers: 0 Following: 0
Developer at MathWorks, working on Parallel Computing Toolbox. Professional Interests: parallel computing, distributed arrays, gpu
Feeds
How to output variables properly from a parfor loop
For your first case, you could use a parfor "reduction variable". Like this: loops = 10000000; b = []; parfor ii = 1:loops ...
5일 전 | 0
| 수락됨
Parallel tool (parfor) and COM objects
The general approach to fixing cases where a variable is needed inside parfor, but cannot be directly sent there, is to use para...
6일 전 | 0
Problem working with parfor
That stack frame in the profiler is simply where your MATLAB client is waiting for the workers to complete their work. You can g...
6일 전 | 0
| 수락됨
Updating a parallel.pool.Constant within a parfor loop
You can't directly update the Value of a parallel.pool.Constant inside a parfor loop - not least because the parfor constraints ...
7일 전 | 0
| 수락됨
Interference in parfor when using global variables
Separate workers have their own completely separate global workspaces. If the function that you call from parfor first assigns a...
19일 전 | 0
Parsing files and computing in parfor - GA
When working with a remote cluster parpool, usually Parallel Computing Toolbox is able to work out automatically which files nee...
대략 1개월 전 | 0
Parallelize cumulative average algorithm
You can use a parfor "reduction variable" to compute this, with a slight modification which may or may not be significant: dat ...
대략 2개월 전 | 0
| 수락됨
doubts about parfeval memory allocation
If the entire dataset only just fits in memory once, then a better option than readall might be to use partition on the datastor...
대략 2개월 전 | 0
| 수락됨
Error Implementing parfor while creating satellite objects
I'm guessing you are trying to use this with a thread-based parallel pool. I had to add a line to your code to make it work, nam...
대략 2개월 전 | 0
| 수락됨
Why is it not possible to pass matrix parameters as argument to GPU arrayfun and what to do?
It would be great to see a simplified example of what you're trying to do. What you can do with gpuArray/arrayfun is write a nes...
대략 2개월 전 | 1
| 수락됨
terminate program if worker aborts in parallel loop
If you create your parpool using the option SpmdEnabled=true, then this has the side-effect of making parallel pools terminate c...
2개월 전 | 0
| 수락됨
How is the work distributed in parfor loop?
If you know in advance which iterations are the time-consuming ones, then you could consider running those together as a separat...
2개월 전 | 1
| 수락됨
How can I debug a parallel script with spmd?
Unfortunately you cannot set breakpoints in code running on workers. If the problem is related to the messages you are sending u...
3개월 전 | 0
how parfor distributes resources to each iteration if the number of cores is larger than the number of iterations
When a parfor loop executes on a parallel pool, PCT will divide up the entire loop range 1:N into a series of batches known as "...
3개월 전 | 3
bug parfor: analyzing and transferring files to worker: not done: blocked
The "analyzing and transferring files to workers" message occurs only when the workers encounter a failure to find some code tha...
3개월 전 | 0
parpool use existing slurm job
Further to @Venkat Siddarth Reddy's suggestion, what you might want to do is something like this: clus = parcluster('mySlurmPro...
3개월 전 | 0
Store intermediate results of cost function when solver is run in parallel
You could use a parallel.pool.PollableDataQueue to let the workers send the data to the client. The idea is that you create the ...
4개월 전 | 0
| 수락됨
"Invalid or deleted object" when using clib object in parfor loop
I'm not terribly familiar with clibgen I'm afraid, but I think the problem here is almost certainly that the function myCppFunct...
4개월 전 | 2
| 수락됨
MATLAB workers can't access files in network shared folder
You could try using FileStore for this. You'll first need to save your figure to a temporary location on disk, and then you can ...
4개월 전 | 0
| 수락됨
Running parfor on multiple nodes (20 nodes = 960 cores) using Slurm (super computer)
To run across multiple nodes of a cluster, you need to set up MATLAB Parallel Server on the cluster. You might well need help fr...
4개월 전 | 1
Parallelization data organization/transfer
parfor is designed to "just work" for a wide range of cases, but it's true that sometimes you need a bit more control. parforOpt...
5개월 전 | 0
Access Violation Detected MatLAB
That crash dump clearly implicates your MEX file octtrees.query_index_moct. One of the common pitfalls when running MEX files in...
5개월 전 | 0
Is it possible to run multiple lines at once in a Matlab script?
To expand just a little on @Stephen23's comment - you can do this if you have Parallel Computing Toolbox. You should first restr...
5개월 전 | 1
| 수락됨
CNN Performance: CPU Consistency vs. GPU Variance - Why?
I'm not certain if it will make everything consistent, but note that random state on the GPU is controlled by the gpurng functio...
5개월 전 | 0
Parfor with options = statset('UseParallel',true);
If you are able to "flatten" the parallelism so that it is all exposed to a single parfor loop with enough iterations to keep al...
5개월 전 | 0
| 수락됨
Is it possible to use parfeval and backgroundPool to write to a Mongo database in a background thread?
In your first case using parfor, if you haven't changed any settings, you will be using a process pool. (The default profile is ...
5개월 전 | 0
Avoid memory copy in thread-based environment (parfeval)
In this case, thread-based workers already avoid copying the large array m to the workers. See this section in the doc. Note tha...
6개월 전 | 2
| 수락됨
How to assign values to arrays inside the PARFOR loop in Parallel Computing Toolbox?
To assign into A here, you need to follow the rules of sliced variables in parfor. In this case, you need to modify your code to...
7개월 전 | 1
| 수락됨
Is there a parallel version of splitapply()?
tall arrays support parallel execution of splitapply. Would that work for your case?
7개월 전 | 0
| 수락됨
How do you organize data from a parfor loop?
You can do this more directly by flattening the parfor loop, and using a combination of ind2sub and reshape. The idea is as foll...
11개월 전 | 0