Speed up 'dlgradient' with parallelism?

Hi all,

I am wondering if there is a way to speed up the 'dlgradient' function evaluation using parallelism or GPUs.

Answer 1

[Jon Cherrie]

You can use a GPU for the dlgradient computation by using a gpuArray with dlarray.

In this example, the minibtachqueue, puts data on to the GPU and thus the GPU is used for the rest of the computation, both the "forward" pass the "backward" (gradient) pass:

• https://www.mathworks.com/help/deeplearning/ug/train-network-using-custom-training-loop.html?#TrainNetworkUsingCustomTrainingLoopExample-5

[Luis Hernandez]

Hello.

I've been trying to use the functions 'dlgradient' and 'dlfeval' with gpuArray inputs so that matlab will use my GPU. Unofrtunately, they only work when I pass dlarray inputs.

What is the workaround for this? what is the minibatch doing that allows you to work with gpuArray?

Thanks!

-L