communicat​ingJobWrap​per.sh file default location moved in 2022a?

Hi,

In MATLAB R2021b, the default location for the communicatingJobWrapper.sh was C:\ProgramData\MATLAB\SupportPackages\R2021b\parallel\slurm\nonshared.

I have a new computer and need to replicate modifiactions to the .sh file to allow communication with my computing cluster. However, the file path does not exist past C:\ProgramData\. There is an alternate file path C:\ProgramData\MathWorks, however it does not appear to lead to the C:\ProgramData\MATLAB\SupportPackages\R2021b\parallel\slurm\nonshared location. The parallel toolbox documentation does not appear to list a change of default location either. I also have made sure hidden files are visiable, ran file explorer as admin and have parallel compute toolbox installed.

Does anyone know where the new default location for communicatingJobWrapper.sh file?

Thanks,

Christopher

Answer 1

[Raymond Norris]

Hi @Christopher McCausland. The Slurm plugin scripts are now posted on GitHub

GitHub - mathworks/matlab-parallel-slurm-plugin

[Christopher McCausland]

Hi Raymond,

I hope you are keeping well!

Thank you, Appologies as I maybe wasn't the clearist. I need to make a change to the communicatingJobWrapper.sh. Basically a slight modification to the line:

CMD="\"${FULL_MPIEXEC}\" ${MPI_VERBOSE} -n ${PARALLEL_SERVER_TOTAL_TASKS} \"${PARALLEL_SERVER_MATLAB_EXE}\" ${PARALLEL_SERVER_MATLAB_ARGS}"

line as our HPC is expecting the command to be constructed differently.

However I cannot find where the communicatingJobWrapper.sh file now 'lives' on the C:\ drive? It no longer seems to be here:

C:\ProgramData\MATLAB\SupportPackages\R2021b\parallel\slurm\nonshared

I am running R2022a and R2023a on the new machine as well as windows 11, where as my old machine is running R2021b and windows 10. So I am not 100% sure if this is a MATLAB or Windows change (or something else)

I hope that is a bit clearer,

Christopher

[Raymond Norris]

@Christopher McCausland from the GitHub, you can either pull the repo or download the source as a ZIP file. However, you get to it from GitHub, you should see communicationJobWrapper.sh in the folder.

[Steven Lord]

An easy way to get the source code for this plugin is to open the Add-Ons Explorer from the Home tab on the toolstrip and search for Slurm. That will allow you to download the Parallel Computing Toolbox Plugin for Slurm. I've confirmed the ZIP file contains that script.

[Christopher McCausland]

Hi @Raymond Norris and @Steven Lord,

Thank you for the answers. I can see what the issue is now.

For anyone else at a later date:

When using the offical SLURM download "parallel computing toolbox plugin for SLURM", via the Add-Ons Explorer, the PluginScriptsLocation field changes path location by default. Orignally in R2021b/windows 10 the path is: C:\ProgramData\MATLAB\SupportPackages\R2021b\parallel\slurm\nonshared

However in R2022a/windows 11, the new default path is:

C:\Users\<username>\AppData\Roaming\MathWorks\MATLAB Add-Ons\Collections\Parallel Computing Toolbox Plugin for Slurm

If importing a previous cluster, users will need to update PluginScriptsLocation to match the new file path.

Thank you for the help!

Christopher