Is it normal to stop and save a network for more than 14 hours?

5 ビュー (過去 30 日間)
Yi Wei
Yi Wei 2020 年 11 月 30 日
編集済み: Yi Wei 2020 年 11 月 30 日
I saved my network using the following function when it completed training progress(Fig.1). But after more than 14 hours, the network still has not finished saving process. The GPU has always been running during the saving process (Fig.2). The training data is about 8T.
net = trainNetwork(trainData,lgraph,options);
save([dir,'Anet'],'net','-v7.3')
Fig. 1
Fig. 2

回答 (1 件)

Yi Wei
Yi Wei 2020 年 11 月 30 日
I do not know if it is because I used the normalization layer. My training data volume is about 8T, since TrainedMean and TrainedVariance are calculated after the training is finished,so this process costs a lot of time.

カテゴリ

Help Center および File ExchangeDeep Learning Toolbox についてさらに検索

製品


リリース

R2020b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by