Speed up inference or/and training of a 3D deep neural network (U-net) for a regression task

조회 수: 9(최근 30일)
Hi all,
I am working on a (volumetric) regression task using a 3D deep neural network.
Its architecture is based on the 3D U-net model provided by the output of Matlab's function unet3dLayers(). I modified its architecture by switching the upscaling transposedConv3dLayer layers with resize3dLayer layers. Furthermore, I removed the PixelClassificationLayer and defined a custom deep learning loop and loss function as described here: https://de.mathworks.com/help/deeplearning/ug/train-network-using-custom-training-loop.html.
The training and inference work well, but their duration is too long for the later use case. Thus, I tried to use the "Deep Network Quantizer" to speed up the inference time, but the toolbox does not support 3D layers. Also, other optimisation strategies for inference/training do not seem to be supported for 3D layers.
So my questions is: Is there any other technique to speed up the inference and/or the training of this type of network architecture?
Many thanks in advance!

채택된 답변

Joss Knight
Joss Knight 2022년 9월 1일
Have you tried using dlaccelerate? As well as ensuring any Custom Layers are using the Acceleratable mixin?
  댓글 수: 2
Joss Knight
Joss Knight 2022년 9월 10일
Hi Emanuel. Yes, if you do not have any Custom Layers then everything is already Acceleratable. The Acceleratable mixin was introduced in R2022a.
You can accelerate most code that uses dlarrays (that is traceable), so for instance you can accelerate any preprocessing you do to the input before passing it to your modelLoss function, validation during training or testing and post-processing after training. We are working on extending acceleration to the parameter update part of training.

댓글을 달려면 로그인하십시오.

추가 답변(0개)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by