"Relu" activation function and "Adam" optimizer for Time delay neural network

I wanna design Time delay neural network, but I can't find the leaky rectified linear unit (Relu) activation function and "Adam" optimization algorithm in such type of networks (Time delay neural network).

댓글 수: 2

Not all deep learning modules are shipped with the toolbox. Did you try to search the "Add-on Explorer"?
I already add Deep Learning Toolbox but I don't know how to integrate the relu activation function and "Adam" optimizer within the "Time Delay neural network" structure.
As the time delay neural network is defined as follow
Net = timedelaynet(inputDelays,hiddenSizes,trainFcn)
where the trainFcn is limited to the folloeing types:
'trainlm'
Levenberg-Marquardt
'trainbr'
Bayesian Regularization
'trainbfg'
BFGS Quasi-Newton
'trainrp'
Resilient Backpropagation
'trainscg'
Scaled Conjugate Gradient
'traincgb'
Conjugate Gradient with Powell/Beale Restarts
'traincgf'
Fletcher-Powell Conjugate Gradient
'traincgp'
Polak-Ribiére Conjugate Gradient
'trainoss'
One Step Secant
'traingdx'
Variable Learning Rate Gradient Descent
'traingdm'
Gradient Descent with Momentum
'traingd'
Gradient Descent

댓글을 달려면 로그인하십시오.

답변 (0개)

카테고리

도움말 센터 및 File Exchange에서 Deep Learning Toolbox에 대해 자세히 알아보기

질문:

2020년 6월 14일

댓글:

2020년 6월 14일

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by