Edric Ellis

MathWorks

Last seen: 6日前 | 2011 年からアクティブ

Developer at MathWorks, working on Parallel Computing Toolbox. Professional Interests: parallel computing, distributed arrays, gpu

統計

All

バッジを表示

Content Feed

回答済み
Read/Write Limitations with Parallel Computing Toolbox (parfor)
Generally speaking, parfor is conservative in what it allows to ensure that by default, all variable accesses are safe. It is s...

14日前 | 0

| 採用済み

回答済み
Parallel workers automatically shutting down in the middle of RL parallel training.
If workers are leaving the pool one at a time while the pool is busy, this almost certainly means that they are crashing. I reco...

19日前 | 0

| 採用済み

回答済み
Clear persistent variables of function on worker
Whenever you issue a clear command at the client, the same clear command is issued on the workers. So you can simply do clear p...

21日前 | 1

回答済み
Error using parpool. Parallel pool failed to start with the following error. For more detailed information, validate the profile 'Processes' in the Cluster Profile Manager.
This is probably the following known problem in R2023a: https://www.mathworks.com/support/bugreports/2968710 . There are workaro...

約1ヶ月前 | 0

回答済み
Matlab spmd Collecting Composite Arrays
You missed a crucial clue from your question - where are you assigning hx. I'm going to guess you have something like this: spm...

3ヶ月前 | 0

| 採用済み

回答済み
Matlab spmd and CoolProp (CPython library)
You need to avoid transferring the objects to the workers, and instead simply build the objects directly on the workers. The sim...

3ヶ月前 | 0

| 採用済み

回答済み
How to shut down all running workers of paarpools?
You can shut down all remaining workers of the currently running pool by executing: delete(gcp('nocreate')) There should be no...

3ヶ月前 | 0

回答済み
Assigning values to a vector out of order in parallel (parfor)
One of the constraints of parfor is that indexed outputs like myVec must be "sliced" - that means that you must assign only elem...

3ヶ月前 | 0

| 採用済み

回答済み
Is it possible to create multiple parallel pools simultaneously
There's no direct way to do what you're after here. (As @Walter Roberson points out, you can have a backgroundPool and a parpool...

4ヶ月前 | 1

| 採用済み

回答済み
Cluster multi-gpu training Error: Current pool is not local.
I think you need to specify ExecutionEnvironment="parallel" for this situation. According to the trainingOptions reference page,...

5ヶ月前 | 0

| 採用済み

回答済み
Is is possible to run a batch job on an MJS Cloud Center cluster with SpmdEnabled set to false?
Unfortunately, this option is not supported at the moment for batch jobs. I realise it's probably rather a big change to your co...

5ヶ月前 | 0

| 採用済み

回答済み
I need help regarding parfeval implementation with object handle. I have created an object handle, the member functions of which i want to run as parallel processes.
The documentation here applies to parfeval as well as parfor in the sense that the object instances on the workers are not conne...

5ヶ月前 | 0

| 採用済み

回答済み
How to avoid broadcast variable while optimizing a cost function in parallel computing?
Investigating performance of parfor loops can be a bit tricky. Here are a few pointers: Do you happen to know if your function ...

6ヶ月前 | 0

回答済み
parfor with temporary variable worning
I think there are a couple of problems here. Firstly, I think you need to change the way you're assigning into dcm_stack because...

6ヶ月前 | 0

| 採用済み

回答済み
Can parfor be used if no Parallel Computing Toolbox licenses are available?
The implementation of parfor is intended to gracefully fall back to running in serial if a Parallel Computing Toolbox licence ca...

6ヶ月前 | 0

回答済み
Slicing variable in parfor loop
In this case, you don't actually have a data dependency between the loop iterations. You can use a parfor reduction to do this, ...

6ヶ月前 | 0

| 採用済み

回答済み
GPU0 and GPU1 in matlab?
GPU Computing in MATLAB supports only NVIDIA devices, so your Intel graphics card cannot be used by gpuArray.

6ヶ月前 | 1

| 採用済み

回答済み
Sliced Variables in N Choose K Search
This is a limitation of the parfor analysis when it comes to indexing sliced variables in a nested for loop. There is another wo...

6ヶ月前 | 0

| 採用済み

回答済み
Use Parfoor Loop for Parameter Sweep Optimization
You can do this using a custom reduction function in parfor. Like this: p = 1:10; someFcn = @sin; % Use a 2-element vector to...

7ヶ月前 | 2

| 採用済み

回答済み
SMPD block getting stuck and not executing
I suspect the problem here is that the way that you're using spmdSend and spmdReceive doesn't quite match how they work. When yo...

7ヶ月前 | 0

| 採用済み

回答済み
How can I Ensure Transparency in parfor-Loops when using cell2table ?
Most of the table-building functions can have this problem if you do not specify 'VariableNames', like this (tested in R2019a): ...

7ヶ月前 | 2

回答済み
Parrallel run using parfor and institute server?
The problem with converting the outer loop to parfor is described in the error message that you get when you try: Error: When i...

8ヶ月前 | 0

回答済み
Incompatible indexing of variable for parfor
The total size in bytes of Network is 5*12*76*8 = 36480. That is tiny. Ignore the parfor "broadcast" warning - that is intended ...

8ヶ月前 | 0

回答済み
Minimum/maximum CUDA Toolkit requirement for R2022a
To run code using gpuArray, you do not need to install a CUDA Toolkit. You only need a CUDA driver. You should always* install t...

9ヶ月前 | 0

回答済み
Is there an easy way to find out which workers are running on the same host in a Generic Cluster job so I can efficiently allgather?
You can use gop to perform general MPI-style all-reduce operations, and a special case of that is gcat which can operate as an M...

9ヶ月前 | 0

| 採用済み

回答済み
Unsure why parfor loop does not work in this case
The problematic variables appear to be both M and P. For M, you have multiple different "reads" from the variable after the init...

9ヶ月前 | 0

回答済み
Writing to .mat simultaneously with parfor loop
Don't attempt to save from multiple workers to the same file, this will sometimes fail (exactly when/how it fails depends on you...

10ヶ月前 | 2

| 採用済み

回答済み
SPMD to process different iteration on different worker
It's not entirely clear to me quite what you're after. You might want for (drange) which spreads the iterations of a for loop ov...

10ヶ月前 | 0

回答済み
process based parpool: keep the data in the workers
Mike has already suggested looking at parfeval. The other option, which may be appropriate for your problem is to use spmd. This...

10ヶ月前 | 0

| 採用済み

回答済み
GUI program with parfeval
You should be able to cause the GUI to update by using wait in a loop, together with drawnow. A bit like this: while ~wait(thre...

10ヶ月前 | 0

| 採用済み

さらに読み込む