Answered
Long time to load 40 gig file
You don't mention how you're loading the data right now. If you have <http://www.mathworks.com/help/distcomp/index.html Parallel...

8 years ago | 0

Answered
How to apply parallel.pool.constant?
A |parallel.pool.Constant| only really helps if you're calling _multiple_ |parfor| loops - it stops you having to transfer const...

8 years ago | 1

Answered
Matlab Does not recognise NVIDIA GPU Card in the PC
Further to Walter's pertinent questions, I'd like to add: it's important to distinguish the CUDA _driver_ from the CUDA _toolkit...

8 years ago | 0

8 years ago | 0

Answered
'parfor' slower than 'for' for simple tutorial example
The problem with your loop is that there just isn't enough work happening in the body. To get the sort of speed-up you might exp...

8 years ago | 4

| accepted

Answered
What's the Largest Recorded Data Set Ever Used with MATLAB?
<https://www.mathworks.com/solutions/big-data-matlab.html This page> has links to information about MATLAB's "big data" capabili...

8 years ago | 0

Answered
How do I construct a complex gpuArray directly on the GPU?
None of MATLAB's build methods (the |zeros|, |ones| family) build complex arrays, so the nearest you can get is to do something ...

8 years ago | 0

| accepted

8 years ago | 1

| accepted

Answered
How can we create a distributed array for specific number of workers (cores) in MATLAB?
You could either create the pool explicitly using only three workers parpool(3) Or, you could use |spmd| with the option...

8 years ago | 0

Answered
Issues with parfor, strsplit and MATLAB path
You can see which version of |strsplit| the workers are seeing by executing: fetchOutputs(parfeval(@which, 1, 'strsplit')) ...

8 years ago | 1

Answered
Is it possible to create a global variable in a parfor loop that is global within all functions called, but local to the specific iteration?
Yes, this should work OK. It's not recommended to use |global| variables - but if you're certain they are being initialised inde...

8 years ago | 1

Answered
"ismember" error with tall arrays
|tall/ismember| was only added in R2017a. See the <https://uk.mathworks.com/help/releases/R2016b/matlab/import_export/functions-...

8 years ago | 0

| accepted

Answered
How to save workspace variables of a cluster job in .mat file?
If you want to save the outputs to a |.mat| file, I would recommend providing the full path to where you want it to be saved - o...

8 years ago | 1

Answered
Passong COM objects within a parfor loop
This sounds like a job for <https://uk.mathworks.com/help/distcomp/parallel.pool.constant.html |parallel.pool.Constant|>. This l...

8 years ago | 1

8 years ago | 1

| accepted

Answered
What happens when a parallel worker finishes early?
When MATLAB runs a |parfor| loop, it attempts to split the iterations of the loop across the workers to keep them all busy simul...

8 years ago | 2

| accepted

Answered
Please help me create a tall array from a large binary file and "fileDatastore" without running out of memory.
In R2017a, |fileDatastore| is currently restricted to reading entire files at a time. This is a known limitation of the current ...

8 years ago | 0

| accepted

Answered
The MATLAB 2017a identifies half number of core on Google Cloud virtual machine.
What happens when you run >> feature('numcores') on one of those machines? By default, MATLAB (and Parallel Computing To...

8 years ago | 0

Answered
How can you set up very large Tall Arrays without Running into swap/page-file issues
Firstly, |tall| arrays are definitely _not_ required to fit into RAM, or swap space, or anything like that. It is perfectly poss...

8 years ago | 0

Answered
Matlabpool Maximum Number of Local Workers on one computer - Parallel Computing
Please note that in R2014a the limit on the number of local workers was removed. See <http://www.mathworks.com/help/releases/R20...

8 years ago | 4

Answered
Why does parallel.pool.const create a copy of the variable in memory for each worker sequentially instead of in parallel?
I suspect you're creating the |parallel.pool.Constant| using data created on the client. It's much more efficient to have the wo...

8 years ago | 1

| accepted

Answered
How do I convert a for-Loop Into parfor-Loops?
The outputs from |parfor| loops need to be <http://uk.mathworks.com/help/distcomp/sliced-variable.html "sliced"> - i.e. one of t...

8 years ago | 2

| accepted

Answered
simulating in parfor and geting a vector
It looks like your |volumeworkerdata| array isn't the right size to assign into a row of |volumedata|. I would make the followin...

8 years ago | 0

Answered
Nested cellfun in parfor loop
Here's some code that I tried combining using nested functions together with |parfor| and |cellfun|: function out = pfeg ...

8 years ago | 0

| accepted

Answered
valid slice are restricted in PARFOR loop
Adam's comment is correct. The |parfor| machinery cannot prove that your loop iterations are order-independent because you're in...

8 years ago | 0

Answered
How MATLAB scheduler is doing the parallelization between the workers in one computer ?
For |spmd|, the model is simple: each worker executes the body of the block simultaneously. For |parfor|, the iterations of t...

8 years ago | 0

| accepted

Answered
How much overhead cost is incurred by using a function handle as a broadcast variable in a parfor loop?
It's not _necessarily_ a problem to have broadcast data in a |parfor| loop. If you're using R2016b or later, you can assess the ...

8 years ago | 1

Answered
How do I create datastore class interactively?
Further to @Steven's suggestion, you might instead wish to create a single |datastore| referring to all the files. See <http://w...

8 years ago | 1

Answered
How to add folders containing class definitions to matlab parpool object
The function <http://www.mathworks.com/help/distcomp/addattachedfiles.html |addAttachedFiles|> can accept folder names as well a...

9 years ago | 0

Answered
How to broadcast a variable in spmd mode
The broadcast function to use inside an |spmd| block is <https://www.mathworks.com/help/distcomp/labbroadcast.html |labBroadcast...

9 years ago | 0