Custom Layer Learnable Parameters Initialization.
조회 수: 4 (최근 30일)
이전 댓글 표시
Hi!
I created a Custom Layer with Learnable Parameters (https://www.mathworks.com/help/deeplearning/ug/define-custom-deep-learning-layer.html)
However, to initialize these parameters I need to know the outputsize of the previous layer. I noticed that some pre-defined layers such as FullyConnected automaticly initialize its own weights using information from previous layers. Is there a way to automatize the weights initialization on custom layers at network initialization?
David
댓글 수: 1
채택된 답변
Joss Knight
2023년 1월 16일
This is now supported via the optional method initialize: https://www-integ2.mathworks.com/help/deeplearning/ug/define-custom-deep-learning-intermediate-layers.html#mw_87362c7c-37d3-40c2-b5c8-c45ded304bcb
추가 답변 (1개)
John Smith
2021년 10월 4일
Unfortunately, at least as of version 2021a, Matlab doesn't provide staright forward capabilities to automatically initialize learnable parameters of a custom layer similar to its built-in layers.
There's a workaround though using a shadow built-in network nested inside your custom layer (see here). Matlab will automatically initialize this layer from which learnable parameters you can pick up the values that you need.
It's a kludge, but it works (I've implemented such a scheme myself.
참고 항목
카테고리
Help Center 및 File Exchange에서 Image Data Workflows에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!