L1 and L2 Regularization for matlab

조회 수: 69 (최근 30일)
Abdussalam Elhanashi
Abdussalam Elhanashi 2019년 10월 17일
답변: Divya Gaddipati 2019년 10월 21일
Hi Guys
I would like to know how to add regularization L1 & L2 for following layers to reduce overfitting
imageInputLayer([32 32 3],"Name","imageinput")
convolution2dLayer([5 5],32,"Name","conv","BiasLearnRateFactor",2,"Padding",[2 2 2 2],"WeightsInitializer","narrow-normal")
batchNormalizationLayer
maxPooling2dLayer([3 3],"Name","maxpool","Stride",[2 2])
preluLayer(20,'prelu')
averagePooling2dLayer([3 3],"Name","avgpool","Stride",[2 2])
fullyConnectedLayer(2,"Name","fc_rcnn","BiasL2Factor",1,"BiasLearnRateFactor",10,"WeightLearnRateFactor",20,"WeightsInitializer","narrow-normal")
dropoutLayer(0.65,'Name','drop1')
softmaxLayer("Name","softmax")
classificationLayer("Name","classoutput")];

답변 (1개)

Divya Gaddipati
Divya Gaddipati 2019년 10월 21일
You can set the L2 regularization for selected layers using the setl2factor function.
You can refer to the following link for more understanding:

카테고리

Help CenterFile Exchange에서 Get Started with MATLAB에 대해 자세히 알아보기

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by