why is my final validation accuracy much lower than the validation accuracy during training?
조회 수: 21(최근 30일)
표시 이전 댓글
YA 2020년 8월 19일
답변: Raunak Gupta 2020년 8월 29일
my FINAL validation is: 21%, while most of my validation accuracy measurements is ~70. what could be the reason for that?
Raunak Gupta 2020년 8월 29일
This can happen due to presence of batchNormalizationlayer in the Layer graph. Since in batch normalization layers the mean and variance of data is calculated for whole training data at the end of the training it can produce different result than that seen in training phase (because there these statistics are calculated for mini batches only). Also, I see there is no increase in the loss in the last iteration which suggest that the model hasn’t changed much (So, this decrease looks only due to the batchNormalizationlayer). This shows that the training data is not shuffled while training and, I think you can train the model for more epochs.
You may set the Shuffle option to ‘every-epoch’ for better distribution of data while training.
Find more on Recognition, Object Detection, and Semantic Segmentation in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!Start Hunting!