Learning Rate Drop Period

Hi!

I am using the 'trainNetwork' function for my net training.

Is there any way to set the 'LearnRateDropPeriod' to be less than 1 epoch? I need it to be updated more frequently.

Thanks in advance!

Answer 1

[Srivardhan Gadila]

For most tasks, you can control the training algorithm details using the trainingOptions and trainNetwork functions. If the trainingOptions function does not provide the options you need for your task (for example, a custom learn rate schedule), then you can define your own custom training loop using automatic differentiation.

For an example showing how to train a network with a custom learn rate schedule, see Train Network Using Custom Training Loop.

Refer to Define Custom Training Loops, Loss Functions, and Networks, Solver Options.

[Serhii Bahdasariants]

Thank you!