I would like to accelerate processing of a large set of radar event data using Parallel Computing. I have a server with 48-cores and 512GB of RAM so all of the data I need to process will fit into the local computer's memory with enough cores to process each independent set of events. The data I want each core to process consists of 8 channels of IQ data which is a matrix of S samples x P pulses -- i.e., each I would like to distribute an 8 x S x P matrix to each worker.
Currently the data is loaded from Nx8 files into an Nx8xSxP matrix which I would like to distribute to N workers. The file reading is actually quite slow since it is done by a single processor so perhaps the first question is whether or I could have each worker load their own Nx8 set of files.
Otherwise, how do I distribute each 8xSxP matrix to my workers?
4 件のコメント
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_889823
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_889823
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_893966
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_893966
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_894113
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_894113
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_894368
このコメントへの直接リンク
https://jp.mathworks.com/matlabcentral/answers/544760-how-do-i-distribute-n-3-dimensional-large-arrays-for-processing-across-n-workers#comment_894368
サインインしてコメントする。