How to tune the regularization parameter in extreme learning machine?
조회 수: 4 (최근 30일)
이전 댓글 표시
I train ELM on my dataset and gives test accuracy of 92.13. I wonder how to tune parameters to gain more test accuracy?
댓글 수: 1
BERGHOUT Tarek
2019년 2월 3일
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.
채택된 답변
BERGHOUT Tarek
2019년 2월 4일
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.
댓글 수: 0
추가 답변 (0개)
참고 항목
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!