필터 지우기
필터 지우기

Why do i obtain good results but poor input error cross correlation plot?

조회 수: 2 (최근 30일)
WT
WT 2014년 11월 6일
댓글: Greg Heath 2014년 11월 7일
Hi,
May i know why do i obtain a low MSE and good predicted outputs but poor input error cross correlation plot?The correlations do not fall within the confidence limit. I am using neural networks time series tool. Why does the confidence limit varies for different MSE results? Currently mine my confidence limit is at +- 2000. Other MSE results can give me confidence limit of +- 4000 but with higher MSE. May i know the reason for this?
Thank you

채택된 답변

Greg Heath
Greg Heath 2014년 11월 6일
If the input/error cross-correlation is large, then a different set of weights could use that correlation to further improve performance.
The best result would be an error that is not at all correlated with either input or output.
Hope this helps.
Thank you for formally accepting my answer
Greg
  댓글 수: 3
Greg Heath
Greg Heath 2014년 11월 7일
How are you obtaining the MSE confidence limit?
Why not use normalized MSE values (divide by average target variance, MSE00) to remove the obscuration of target scaling?
Different weights associated with a different design.
a. divideblock instead of dividerand
b. Better choice of delays (See my correlation function method of choosing delays). Search NEWSGROUP and ANSWERS using
greg ncorr
c. Better combination of hidden nodes and random initial weights See my double for loop method of optimizing number of hidden nodes and initial weights):
greg narxnet Ntrials
Hope this helps.
Thank you for formally accepting my answer
Greg
Greg Heath
Greg Heath 2014년 11월 7일
To be clear:
Training results are biased because the data used to obtain performance summaries are the same data used to design the model. However, if the number of training equations is larger than the number of unknown weights, a degree of freedom correction is useful.
Validation results are also biased because the data is used to determine when to stop the design. However, the bias is much smaller. Therefore, the val performance should be used to choose among competing designs.
Therefore, test performance which, in no way is involved in design, is the only UNBIASED prediction of performance on unseen data.
Hope this helps.
Greg

댓글을 달려면 로그인하십시오.

추가 답변 (0개)

카테고리

Help CenterFile Exchange에서 Sequence and Numeric Feature Data Workflows에 대해 자세히 알아보기

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by