photo

Edric Ellis

MathWorks

Last seen: 1 day ago |  Active since 2011

Followers: 0   Following: 0

Developer at MathWorks, working on Parallel Computing Toolbox. Professional Interests: parallel computing, distributed arrays, gpu

Statistics

All
  • 5-Star Galaxy Level 3
  • Personal Best Downloads Level 1
  • First Review
  • First Submission
  • 36 Month Streak
  • Thankful Level 1
  • Guiding Light
  • Revival Level 2
  • Knowledgeable Level 5
  • First Answer
  • Solver

View badges

Feeds

View by

Answered
Did the default NumWorkers change for a local pool in R2024a?
Check the answer here: https://uk.mathworks.com/matlabcentral/answers/2062522-how-does-parallel-computing-toolbox-handle-perform...

5 months ago | 0

| accepted

Answered
parpool memory allocation per worker
Further to the other suggestions here, using parpool("Threads") will use less memory than parpool("Processes"), but not everythi...

5 months ago | 0

Answered
How to resolve warning message about broadcast variable while using 'parfor'?
I think you should ignore this message in this case. It looks like you really need all the values of males for each iteration of...

5 months ago | 0

| accepted

Answered
parfor problems (structure, reduction assignment, etc)
The problem here is that you're trying to extend the arrays like Ball by assigning off the end of the current size of the array....

6 months ago | 0

| accepted

Answered
Cancel parfeval causes workers to throw errors
My guess is that whatever myFunc is doing is not safe against being interrupted with CTRL-C. When you cancel a parallel.Future, ...

6 months ago | 0

Answered
How to run multiple functions simultaneously and communicate with each other?
Your spmd block as written instructs each worker to run first aData() and then bData(). This is the general pattern of spmd - al...

6 months ago | 1

Answered
Error when running function with batch()
This is nothing to do with batch, and everything to do with workspace transparency. Basically when a parfor loop exists inside a...

7 months ago | 0

| accepted

Answered
FFT is suddenly slow down for repeated operations.
This is due to the asynchronous nature of gpuArray operations. Where possible, operations on the GPU are queued up and run in th...

7 months ago | 2

| accepted

Answered
generalizedInverseKinematics in a nested parforloop
You haven't given us a lot to go on there, but the form of assignment you mention is only valid if qWaypoints is a parfor "tempo...

8 months ago | 0

| accepted

Answered
How can I know which worker performs each iteration of the parfor loop?
You can use getCurrentTask (if you're using a process pool rather than a thread pool). This has a field ID which tells you which...

8 months ago | 0

Answered
Multiply tall array with array
You need to use a bit of a trick to construct the colon vector. (This trick is alluded to on this doc page). Basically, you need...

8 months ago | 0

Answered
How to output variables properly from a parfor loop
For your first case, you could use a parfor "reduction variable". Like this: loops = 10000000; b = []; parfor ii = 1:loops ...

8 months ago | 0

| accepted

Answered
Parallel tool (parfor) and COM objects
The general approach to fixing cases where a variable is needed inside parfor, but cannot be directly sent there, is to use para...

8 months ago | 0

Answered
Problem working with parfor
That stack frame in the profiler is simply where your MATLAB client is waiting for the workers to complete their work. You can g...

8 months ago | 0

| accepted

Answered
Updating a parallel.pool.Constant within a parfor loop
You can't directly update the Value of a parallel.pool.Constant inside a parfor loop - not least because the parfor constraints ...

8 months ago | 0

| accepted

Answered
Interference in parfor when using global variables
Separate workers have their own completely separate global workspaces. If the function that you call from parfor first assigns a...

9 months ago | 0

Answered
Parsing files and computing in parfor - GA
When working with a remote cluster parpool, usually Parallel Computing Toolbox is able to work out automatically which files nee...

9 months ago | 0

Answered
Parallelize cumulative average algorithm
You can use a parfor "reduction variable" to compute this, with a slight modification which may or may not be significant: dat ...

10 months ago | 0

| accepted

Answered
doubts about parfeval memory allocation
If the entire dataset only just fits in memory once, then a better option than readall might be to use partition on the datastor...

10 months ago | 0

| accepted

Answered
Error Implementing parfor while creating satellite objects
I'm guessing you are trying to use this with a thread-based parallel pool. I had to add a line to your code to make it work, nam...

10 months ago | 0

| accepted

Answered
Why is it not possible to pass matrix parameters as argument to GPU arrayfun and what to do?
It would be great to see a simplified example of what you're trying to do. What you can do with gpuArray/arrayfun is write a nes...

10 months ago | 1

| accepted

Answered
terminate program if worker aborts in parallel loop
If you create your parpool using the option SpmdEnabled=true, then this has the side-effect of making parallel pools terminate c...

10 months ago | 0

| accepted

Answered
How is the work distributed in parfor loop?
If you know in advance which iterations are the time-consuming ones, then you could consider running those together as a separat...

10 months ago | 1

| accepted

Answered
How can I debug a parallel script with spmd?
Unfortunately you cannot set breakpoints in code running on workers. If the problem is related to the messages you are sending u...

11 months ago | 0

Answered
how parfor distributes resources to each iteration if the number of cores is larger than the number of iterations
When a parfor loop executes on a parallel pool, PCT will divide up the entire loop range 1:N into a series of batches known as "...

11 months ago | 3

Answered
bug parfor: analyzing and transferring files to worker: not done: blocked
The "analyzing and transferring files to workers" message occurs only when the workers encounter a failure to find some code tha...

11 months ago | 0

Answered
parpool use existing slurm job
Further to @Venkat Siddarth Reddy's suggestion, what you might want to do is something like this: clus = parcluster('mySlurmPro...

11 months ago | 0

Answered
Store intermediate results of cost function when solver is run in parallel
You could use a parallel.pool.PollableDataQueue to let the workers send the data to the client. The idea is that you create the ...

12 months ago | 0

| accepted

Answered
"Invalid or deleted object" when using clib object in parfor loop
I'm not terribly familiar with clibgen I'm afraid, but I think the problem here is almost certainly that the function myCppFunct...

12 months ago | 2

| accepted

Answered
MATLAB workers can't access files in network shared folder
You could try using FileStore for this. You'll first need to save your figure to a temporary location on disk, and then you can ...

12 months ago | 0

| accepted

Load more