Deep network behavior in custom training loop on shared layers

1 ビュー (過去 30 日間)
John Smith
John Smith 2019 年 12 月 25 日
Hello,
The example is clear. My question is about how it'd work if a dropout layer were added to the sub-network.
The question arises because dropout behaves differently in training (forward) and predicting (predict). During training the layer randomly sets input elements to zero given by the dropout mask each time it is invoked and at prediction the output of the layer is equal to its input (https://www.mathworks.com/help/deeplearning/ref/nnet.cnn.layer.dropoutlayer.html?s_tid=doc_ta). Therefore, it'd reason that the mask would be different for each image in the input images pair! But this is NOT what we want!
Please advise,
D

回答 (0 件)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by