Custom Layer Learnable Parameters Initialization.

조회 수: 5(최근 30일)
David Ernesto Caro
David Ernesto Caro 2020년 3월 8일
댓글: Jose Cortes-Briones 2023년 1월 16일
I created a Custom Layer with Learnable Parameters (
However, to initialize these parameters I need to know the outputsize of the previous layer. I noticed that some pre-defined layers such as FullyConnected automaticly initialize its own weights using information from previous layers. Is there a way to automatize the weights initialization on custom layers at network initialization?
  댓글 수: 1
Jose Cortes-Briones
Jose Cortes-Briones 2020년 9월 9일
I asked a similar question a while ago and never got a response :/

댓글을 달려면 로그인하십시오.


John Smith
John Smith 2021년 10월 4일
Unfortunately, at least as of version 2021a, Matlab doesn't provide staright forward capabilities to automatically initialize learnable parameters of a custom layer similar to its built-in layers.
There's a workaround though using a shadow built-in network nested inside your custom layer (see here). Matlab will automatically initialize this layer from which learnable parameters you can pick up the values that you need.
It's a kludge, but it works (I've implemented such a scheme myself.

Joss Knight
Joss Knight 2023년 1월 16일





Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by