Can we say that overfitting occur in this plot?

Performance plot from ANN is obtained as shown below.Does overfitting happen here?

답변 (1개)

Greg Heath
Greg Heath 2018년 8월 23일

1 개 추천

This is a case of
*OVERTRAINING AN OVERFIT NET*
There are at least 3 ways to avoid this:
1. *DO NOT OVERFIT:*
Make sure that the number of unknown weights, Nw does not
exceed the number of training equations, Ntrneq.
2. *DO NOT OVERTRAIN*
In particular, the problem is not necessarily the
overfitting. Overfitting is easily mitigated by NOT
OVERTRAINING
a. Use a VALIDATION set to implement "EARLY STOPPING".
b. Use "REGULARIZATION" via TRAINBR to implement
"BAYESIAN RREGULARIZATION"
See
https://www.mathworks.com/matlabcentral/answers/280818-how-to-solve-overtrained-nn-with-validation-stop
Hope this helps.
Thank you for formally accepting my answer
Greg

댓글 수: 4

KAE
KAE 2018년 8월 24일
What plot features indicate this overtraining is occurring, compared to the plot in the documentation, which is copied below?
The increase in the val error rate (grn) for 6(default) continuous epochs (9 to 15) while the training error (blu) is still decreasing.
Hope this helps.
Greg
KAE
KAE 2018년 9월 5일
편집: KAE 2018년 9월 5일
And in the first plot (original question), the val error rate only increases for 5 continuous epochs, during epoch 6-11, while the training error is decreasing. Since 5 is less than the default of 6, the first plot shows overtraining. Is this interpretation right?
5 - 11 not 6 - 11
Greg

댓글을 달려면 로그인하십시오.

카테고리

도움말 센터File Exchange에서 Deep Learning Toolbox에 대해 자세히 알아보기

질문:

2018년 8월 22일

댓글:

2018년 9월 23일

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by